2024-09-16T15:27:38.600 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-16T15:27:38.905 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-16T15:27:39.022 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/avan-2024-09-16_15:21:40-fs:volumes-wip-athakkar-testing-2024-09-16-1454-distro-default-smithi/7907356 branch: wip-athakkar-testing-2024-09-16-1454 description: fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/finisher_per_module}} email: athakkar@redhat.com first_in_suite: false job_id: '7907356' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: avan-2024-09-16_15:21:40-fs:volumes-wip-athakkar-testing-2024-09-16-1454-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-athakkar-testing-2024-09-16-1454 ceph: cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mon: mon op complaint time: 120 mon warn on pool no app: false osd: osd op complaint time: 180 conf: client: pid file: '' global: ms die on skipped message: false mgr: client mount timeout: 30 debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: 33f95d2ae1bcbe7eb04404303f179eeeaa6982df ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 33f95d2ae1bcbe7eb04404303f179eeeaa6982df kclient: syntax: v1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-athakkar-testing-2024-09-16-1454 sha1: 33f95d2ae1bcbe7eb04404303f179eeeaa6982df owner: scheduled_avan@teuthology priority: 80 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 3077 sha1: 33f95d2ae1bcbe7eb04404303f179eeeaa6982df sleep_before_teardown: 0 subset: 1/20 suite: fs:volumes suite_branch: wip-athakkar-testing-2024-09-16-1454 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_33f95d2ae1bcbe7eb04404303f179eeeaa6982df/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 33f95d2ae1bcbe7eb04404303f179eeeaa6982df syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi098.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIFO86mnTKEVQsFzMGaQ43qmexpW5DcqGVmmCb8eNp7NNUCLR2aMwPIFf/IEySVcthQgKQYmyoGZVhsifOspRTY= smithi135.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGi7xFYHMfQJ1cwmPOewx9N9/zxHfMPlsLTIy77jt6r3KADoYSo06RPrwOcc52fFU7yA+UpiQxRVqHyfPp6WGSw= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - check-counter: counters: mgr: - min: 4 name: finisher-volumes.complete_latency.avgcount - expected_val: 0 name: finisher-volumes.queue_len - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_volumes.TestPerModuleFinsherThread teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-16_15:21:40 tube: smithi user: avan verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-16T15:27:39.023 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_33f95d2ae1bcbe7eb04404303f179eeeaa6982df/qa; will attempt to use it 2024-09-16T15:27:39.023 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_33f95d2ae1bcbe7eb04404303f179eeeaa6982df/qa/tasks 2024-09-16T15:27:39.023 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-16T15:27:39.025 INFO:teuthology.task.internal:Checking packages... 2024-09-16T15:27:39.044 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '33f95d2ae1bcbe7eb04404303f179eeeaa6982df' 2024-09-16T15:27:39.044 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-16T15:27:39.044 INFO:teuthology.packaging:ref: None 2024-09-16T15:27:39.044 INFO:teuthology.packaging:tag: None 2024-09-16T15:27:39.045 INFO:teuthology.packaging:branch: wip-athakkar-testing-2024-09-16-1454 2024-09-16T15:27:39.045 INFO:teuthology.packaging:sha1: 33f95d2ae1bcbe7eb04404303f179eeeaa6982df 2024-09-16T15:27:39.045 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-athakkar-testing-2024-09-16-1454 2024-09-16T15:27:39.180 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4938.g33f95d2a 2024-09-16T15:27:39.182 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-16T15:27:39.188 INFO:teuthology.task.internal:no buildpackages task found 2024-09-16T15:27:39.188 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-16T15:27:39.194 INFO:teuthology.task.internal:Saving configuration 2024-09-16T15:27:39.211 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-16T15:27:39.217 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-16T15:27:39.241 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi098.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/avan-2024-09-16_15:21:40-fs:volumes-wip-athakkar-testing-2024-09-16-1454-distro-default-smithi/7907356', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-16 15:22:50.001816', 'locked_by': 'scheduled_avan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIFO86mnTKEVQsFzMGaQ43qmexpW5DcqGVmmCb8eNp7NNUCLR2aMwPIFf/IEySVcthQgKQYmyoGZVhsifOspRTY='} 2024-09-16T15:27:39.262 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi135.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/avan-2024-09-16_15:21:40-fs:volumes-wip-athakkar-testing-2024-09-16-1454-distro-default-smithi/7907356', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-16 15:22:50.003213', 'locked_by': 'scheduled_avan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGi7xFYHMfQJ1cwmPOewx9N9/zxHfMPlsLTIy77jt6r3KADoYSo06RPrwOcc52fFU7yA+UpiQxRVqHyfPp6WGSw='} 2024-09-16T15:27:39.262 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-16T15:27:39.268 INFO:teuthology.task.internal:roles: ubuntu@smithi098.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-09-16T15:27:39.269 INFO:teuthology.task.internal:roles: ubuntu@smithi135.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-09-16T15:27:39.269 INFO:teuthology.run_tasks:Running task console_log... 2024-09-16T15:27:39.323 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa15e31fbe0>, signals=[15]) 2024-09-16T15:27:39.323 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-16T15:27:39.329 INFO:teuthology.task.internal:Opening connections... 2024-09-16T15:27:39.329 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi098.front.sepia.ceph.com 2024-09-16T15:27:39.330 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T15:27:39.405 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi135.front.sepia.ceph.com 2024-09-16T15:27:39.406 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T15:27:39.478 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-16T15:27:39.484 DEBUG:teuthology.orchestra.run.smithi098:> uname -m 2024-09-16T15:27:39.503 INFO:teuthology.orchestra.run.smithi098.stdout:x86_64 2024-09-16T15:27:39.504 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release 2024-09-16T15:27:39.562 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="CentOS Stream" 2024-09-16T15:27:39.562 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="9" 2024-09-16T15:27:39.562 INFO:teuthology.orchestra.run.smithi098.stdout:ID="centos" 2024-09-16T15:27:39.562 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE="rhel fedora" 2024-09-16T15:27:39.562 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="9" 2024-09-16T15:27:39.562 INFO:teuthology.orchestra.run.smithi098.stdout:PLATFORM_ID="platform:el9" 2024-09-16T15:27:39.562 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-16T15:27:39.562 INFO:teuthology.orchestra.run.smithi098.stdout:ANSI_COLOR="0;31" 2024-09-16T15:27:39.562 INFO:teuthology.orchestra.run.smithi098.stdout:LOGO="fedora-logo-icon" 2024-09-16T15:27:39.562 INFO:teuthology.orchestra.run.smithi098.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-16T15:27:39.562 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://centos.org/" 2024-09-16T15:27:39.563 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-16T15:27:39.563 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-16T15:27:39.563 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-16T15:27:39.563 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server 2024-09-16T15:27:39.583 DEBUG:teuthology.orchestra.run.smithi135:> uname -m 2024-09-16T15:27:39.601 INFO:teuthology.orchestra.run.smithi135.stdout:x86_64 2024-09-16T15:27:39.602 DEBUG:teuthology.orchestra.run.smithi135:> cat /etc/os-release 2024-09-16T15:27:39.659 INFO:teuthology.orchestra.run.smithi135.stdout:NAME="CentOS Stream" 2024-09-16T15:27:39.660 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION="9" 2024-09-16T15:27:39.660 INFO:teuthology.orchestra.run.smithi135.stdout:ID="centos" 2024-09-16T15:27:39.660 INFO:teuthology.orchestra.run.smithi135.stdout:ID_LIKE="rhel fedora" 2024-09-16T15:27:39.660 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION_ID="9" 2024-09-16T15:27:39.660 INFO:teuthology.orchestra.run.smithi135.stdout:PLATFORM_ID="platform:el9" 2024-09-16T15:27:39.660 INFO:teuthology.orchestra.run.smithi135.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-16T15:27:39.660 INFO:teuthology.orchestra.run.smithi135.stdout:ANSI_COLOR="0;31" 2024-09-16T15:27:39.660 INFO:teuthology.orchestra.run.smithi135.stdout:LOGO="fedora-logo-icon" 2024-09-16T15:27:39.660 INFO:teuthology.orchestra.run.smithi135.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-16T15:27:39.660 INFO:teuthology.orchestra.run.smithi135.stdout:HOME_URL="https://centos.org/" 2024-09-16T15:27:39.660 INFO:teuthology.orchestra.run.smithi135.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-16T15:27:39.661 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-16T15:27:39.661 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-16T15:27:39.661 INFO:teuthology.lock.ops:Updating smithi135.front.sepia.ceph.com on lock server 2024-09-16T15:27:39.683 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-16T15:27:39.695 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-16T15:27:39.700 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-16T15:27:39.700 DEBUG:teuthology.orchestra.run.smithi098:> test '!' -e /home/ubuntu/cephtest 2024-09-16T15:27:39.702 DEBUG:teuthology.orchestra.run.smithi135:> test '!' -e /home/ubuntu/cephtest 2024-09-16T15:27:39.719 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-16T15:27:39.724 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-16T15:27:39.724 DEBUG:teuthology.orchestra.run.smithi098:> test -z $(ls -A /var/lib/ceph) 2024-09-16T15:27:39.759 DEBUG:teuthology.orchestra.run.smithi135:> test -z $(ls -A /var/lib/ceph) 2024-09-16T15:27:40.084 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-16T15:27:40.146 INFO:teuthology.run_tasks:Running task kernel... 2024-09-16T15:27:40.160 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-16T15:27:40.160 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2024-09-16T15:27:40.160 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2024-09-16T15:27:40.160 DEBUG:teuthology.orchestra.run.smithi098:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-16T15:27:40.161 DEBUG:teuthology.orchestra.run.smithi135:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-16T15:27:40.178 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T15:27:40.178 DEBUG:teuthology.orchestra.run.smithi135:> uname -r 2024-09-16T15:27:40.179 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T15:27:40.179 DEBUG:teuthology.orchestra.run.smithi098:> uname -r 2024-09-16T15:27:40.236 INFO:teuthology.orchestra.run.smithi135.stdout:5.14.0-503.el9.x86_64 2024-09-16T15:27:40.237 INFO:teuthology.task.kernel:Running kernel on smithi135: 5.14.0-503.el9.x86_64 2024-09-16T15:27:40.237 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum install -y kernel 2024-09-16T15:27:40.238 INFO:teuthology.orchestra.run.smithi098.stdout:5.14.0-503.el9.x86_64 2024-09-16T15:27:40.238 INFO:teuthology.task.kernel:Running kernel on smithi098: 5.14.0-503.el9.x86_64 2024-09-16T15:27:40.238 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum install -y kernel 2024-09-16T15:27:42.690 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.2 MB 00:00 2024-09-16T15:27:42.839 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 8.2 MB 00:00 2024-09-16T15:27:44.450 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - AppStream 32 MB/s | 20 MB 00:00 2024-09-16T15:27:45.007 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - AppStream 19 MB/s | 20 MB 00:01 2024-09-16T15:27:50.042 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - CRB 3.7 MB/s | 6.5 MB 00:01 2024-09-16T15:27:50.899 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - CRB 3.1 MB/s | 6.5 MB 00:02 2024-09-16T15:27:52.483 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - Extras packages 50 kB/s | 19 kB 00:00 2024-09-16T15:27:52.510 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - Extras packages 15 kB/s | 19 kB 00:01 2024-09-16T15:27:54.596 INFO:teuthology.orchestra.run.smithi098.stdout:Extra Packages for Enterprise Linux 11 MB/s | 23 MB 00:01 2024-09-16T15:27:54.639 INFO:teuthology.orchestra.run.smithi135.stdout:Extra Packages for Enterprise Linux 11 MB/s | 23 MB 00:01 2024-09-16T15:28:00.085 INFO:teuthology.orchestra.run.smithi098.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-16T15:28:00.197 INFO:teuthology.orchestra.run.smithi135.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-09-16T15:28:02.100 INFO:teuthology.orchestra.run.smithi098.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-16T15:28:02.100 INFO:teuthology.orchestra.run.smithi098.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-16T15:28:02.182 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-16T15:28:02.192 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-16T15:28:02.192 INFO:teuthology.orchestra.run.smithi098.stdout: Package Architecture Version Repository Size 2024-09-16T15:28:02.192 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-16T15:28:02.193 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-16T15:28:02.193 INFO:teuthology.orchestra.run.smithi098.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-16T15:28:02.193 INFO:teuthology.orchestra.run.smithi098.stdout:Installing dependencies: 2024-09-16T15:28:02.193 INFO:teuthology.orchestra.run.smithi098.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-16T15:28:02.193 INFO:teuthology.orchestra.run.smithi098.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-16T15:28:02.193 INFO:teuthology.orchestra.run.smithi098.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-16T15:28:02.194 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:28:02.194 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-16T15:28:02.194 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-16T15:28:02.194 INFO:teuthology.orchestra.run.smithi098.stdout:Install 4 Packages 2024-09-16T15:28:02.194 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:28:02.195 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 79 M 2024-09-16T15:28:02.195 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 126 M 2024-09-16T15:28:02.195 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-16T15:28:02.212 INFO:teuthology.orchestra.run.smithi135.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-16T15:28:02.212 INFO:teuthology.orchestra.run.smithi135.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-16T15:28:02.314 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-09-16T15:28:02.321 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-09-16T15:28:02.321 INFO:teuthology.orchestra.run.smithi135.stdout: Package Architecture Version Repository Size 2024-09-16T15:28:02.321 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-09-16T15:28:02.322 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2024-09-16T15:28:02.322 INFO:teuthology.orchestra.run.smithi135.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-16T15:28:02.322 INFO:teuthology.orchestra.run.smithi135.stdout:Installing dependencies: 2024-09-16T15:28:02.322 INFO:teuthology.orchestra.run.smithi135.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-16T15:28:02.322 INFO:teuthology.orchestra.run.smithi135.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-16T15:28:02.323 INFO:teuthology.orchestra.run.smithi135.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-16T15:28:02.323 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-16T15:28:02.323 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-09-16T15:28:02.323 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-09-16T15:28:02.323 INFO:teuthology.orchestra.run.smithi135.stdout:Install 4 Packages 2024-09-16T15:28:02.323 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-16T15:28:02.323 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 79 M 2024-09-16T15:28:02.323 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 126 M 2024-09-16T15:28:02.323 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-09-16T15:28:02.345 INFO:teuthology.orchestra.run.smithi098.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 215 kB/s | 23 kB 00:00 2024-09-16T15:28:02.449 INFO:teuthology.orchestra.run.smithi135.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 280 kB/s | 23 kB 00:00 2024-09-16T15:28:03.112 INFO:teuthology.orchestra.run.smithi098.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 18 MB/s | 16 MB 00:00 2024-09-16T15:28:03.646 INFO:teuthology.orchestra.run.smithi098.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 22 MB/s | 29 MB 00:01 2024-09-16T15:28:03.962 INFO:teuthology.orchestra.run.smithi098.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 20 MB/s | 35 MB 00:01 2024-09-16T15:28:03.963 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-16T15:28:03.963 INFO:teuthology.orchestra.run.smithi098.stdout:Total 45 MB/s | 79 MB 00:01 2024-09-16T15:28:04.644 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-16T15:28:04.999 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-16T15:28:04.999 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-16T15:28:05.532 INFO:teuthology.orchestra.run.smithi135.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 4.9 MB/s | 16 MB 00:03 2024-09-16T15:28:05.956 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-16T15:28:05.956 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-16T15:28:07.365 INFO:teuthology.orchestra.run.smithi135.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 6.9 MB/s | 35 MB 00:04 2024-09-16T15:28:07.691 INFO:teuthology.orchestra.run.smithi135.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 5.4 MB/s | 29 MB 00:05 2024-09-16T15:28:07.691 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-09-16T15:28:07.691 INFO:teuthology.orchestra.run.smithi135.stdout:Total 15 MB/s | 79 MB 00:05 2024-09-16T15:28:08.376 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-09-16T15:28:08.400 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-16T15:28:08.761 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-09-16T15:28:08.761 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-09-16T15:28:09.037 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-16T15:28:09.123 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T15:28:09.765 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-09-16T15:28:09.765 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-09-16T15:28:11.898 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T15:28:12.043 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T15:28:12.238 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-09-16T15:28:12.941 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-16T15:28:13.032 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T15:28:15.820 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T15:28:15.958 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T15:28:16.840 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T15:28:16.877 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-16T15:28:20.784 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T15:28:20.908 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-16T15:28:21.740 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T15:28:25.901 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T15:29:00.119 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T15:29:00.157 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-16T15:29:00.490 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-16T15:29:00.490 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-16T15:29:00.491 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T15:29:00.491 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T15:29:01.316 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T15:29:01.316 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:29:01.317 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-16T15:29:01.317 INFO:teuthology.orchestra.run.smithi098.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-16T15:29:01.317 INFO:teuthology.orchestra.run.smithi098.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-16T15:29:01.317 INFO:teuthology.orchestra.run.smithi098.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-16T15:29:01.317 INFO:teuthology.orchestra.run.smithi098.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-16T15:29:01.317 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:29:01.317 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-16T15:29:01.689 DEBUG:teuthology.orchestra.run.smithi098:> rpm -q kernel | sort -rV | head -n 1 2024-09-16T15:29:01.770 INFO:teuthology.orchestra.run.smithi098.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-16T15:29:01.771 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-16T15:29:01.771 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-16T15:29:01.771 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-16T15:29:01.771 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-16T15:29:01.771 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-16T15:29:01.772 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi098.front.sepia.ceph.com, path=None, version=distro) 2024-09-16T15:29:01.772 DEBUG:teuthology.orchestra.run.smithi098:> rpm -q kernel | sort -rV | head -n 1 2024-09-16T15:29:01.830 INFO:teuthology.orchestra.run.smithi098.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-16T15:29:01.831 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-16T15:29:01.831 DEBUG:teuthology.orchestra.run.smithi098:> sudo rpm -qi grub2-tools 2024-09-16T15:29:01.862 INFO:teuthology.orchestra.run.smithi098.stdout:Name : grub2-tools 2024-09-16T15:29:01.862 INFO:teuthology.orchestra.run.smithi098.stdout:Epoch : 1 2024-09-16T15:29:01.862 INFO:teuthology.orchestra.run.smithi098.stdout:Version : 2.06 2024-09-16T15:29:01.862 INFO:teuthology.orchestra.run.smithi098.stdout:Release : 82.el9 2024-09-16T15:29:01.863 INFO:teuthology.orchestra.run.smithi098.stdout:Architecture: x86_64 2024-09-16T15:29:01.863 INFO:teuthology.orchestra.run.smithi098.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-16T15:29:01.863 INFO:teuthology.orchestra.run.smithi098.stdout:Group : Unspecified 2024-09-16T15:29:01.863 INFO:teuthology.orchestra.run.smithi098.stdout:Size : 8274670 2024-09-16T15:29:01.863 INFO:teuthology.orchestra.run.smithi098.stdout:License : GPLv3+ 2024-09-16T15:29:01.863 INFO:teuthology.orchestra.run.smithi098.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-16T15:29:01.863 INFO:teuthology.orchestra.run.smithi098.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-16T15:29:01.863 INFO:teuthology.orchestra.run.smithi098.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-16T15:29:01.863 INFO:teuthology.orchestra.run.smithi098.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-16T15:29:01.864 INFO:teuthology.orchestra.run.smithi098.stdout:Packager : builder@centos.org 2024-09-16T15:29:01.864 INFO:teuthology.orchestra.run.smithi098.stdout:Vendor : CentOS 2024-09-16T15:29:01.864 INFO:teuthology.orchestra.run.smithi098.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-16T15:29:01.864 INFO:teuthology.orchestra.run.smithi098.stdout:Summary : Support tools for GRUB. 2024-09-16T15:29:01.864 INFO:teuthology.orchestra.run.smithi098.stdout:Description : 2024-09-16T15:29:01.864 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:29:01.864 INFO:teuthology.orchestra.run.smithi098.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-16T15:29:01.864 INFO:teuthology.orchestra.run.smithi098.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-16T15:29:01.864 INFO:teuthology.orchestra.run.smithi098.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-16T15:29:01.864 INFO:teuthology.orchestra.run.smithi098.stdout:hardware devices. 2024-09-16T15:29:01.865 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:29:01.865 INFO:teuthology.orchestra.run.smithi098.stdout:This subpackage provides tools for support of all platforms. 2024-09-16T15:29:01.866 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-16T15:29:01.866 INFO:teuthology.task.kernel:Updating grub on smithi098 to boot 5.14.0-505.el9.x86_64 2024-09-16T15:29:01.866 DEBUG:teuthology.orchestra.run.smithi098:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-16T15:29:02.469 INFO:teuthology.orchestra.run.smithi098.stderr:Generating grub configuration file ... 2024-09-16T15:29:03.792 INFO:teuthology.orchestra.run.smithi098.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-16T15:29:03.820 INFO:teuthology.orchestra.run.smithi098.stderr:done 2024-09-16T15:29:03.825 DEBUG:teuthology.orchestra.run.smithi098:> mktemp 2024-09-16T15:29:03.842 INFO:teuthology.orchestra.run.smithi098.stdout:/tmp/tmp.V8MQDDoUdS 2024-09-16T15:29:03.842 DEBUG:teuthology.orchestra.run.smithi098:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.V8MQDDoUdS 2024-09-16T15:29:03.909 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 0666 /tmp/tmp.V8MQDDoUdS 2024-09-16T15:29:04.057 DEBUG:teuthology.orchestra.remote:smithi098:/tmp/tmp.V8MQDDoUdS is 6KB 2024-09-16T15:29:04.106 DEBUG:teuthology.orchestra.run.smithi098:> rm -fr /tmp/tmp.V8MQDDoUdS 2024-09-16T15:29:04.121 DEBUG:teuthology.orchestra.run.smithi098:> sudo /bin/ls /boot/loader/entries || true 2024-09-16T15:29:04.138 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T15:29:04.178 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-16T15:29:04.192 INFO:teuthology.orchestra.run.smithi098.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-16T15:29:04.192 INFO:teuthology.orchestra.run.smithi098.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-16T15:29:04.192 INFO:teuthology.orchestra.run.smithi098.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-16T15:29:04.192 INFO:teuthology.orchestra.run.smithi098.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-16T15:29:04.194 DEBUG:teuthology.orchestra.run.smithi098:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-16T15:29:04.356 DEBUG:teuthology.orchestra.run.smithi098:> sudo shutdown -r now 2024-09-16T15:29:04.541 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-16T15:29:04.541 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-16T15:29:04.541 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T15:29:04.541 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T15:29:05.426 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T15:29:05.426 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-16T15:29:05.426 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2024-09-16T15:29:05.426 INFO:teuthology.orchestra.run.smithi135.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-16T15:29:05.426 INFO:teuthology.orchestra.run.smithi135.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-16T15:29:05.426 INFO:teuthology.orchestra.run.smithi135.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-16T15:29:05.426 INFO:teuthology.orchestra.run.smithi135.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-16T15:29:05.426 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-16T15:29:05.426 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-09-16T15:29:05.825 DEBUG:teuthology.orchestra.run.smithi135:> rpm -q kernel | sort -rV | head -n 1 2024-09-16T15:29:05.914 INFO:teuthology.orchestra.run.smithi135.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-16T15:29:05.915 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-16T15:29:05.915 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-16T15:29:05.915 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-16T15:29:05.915 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-16T15:29:05.916 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2024-09-16T15:29:05.916 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi135.front.sepia.ceph.com, path=None, version=distro) 2024-09-16T15:29:05.916 DEBUG:teuthology.orchestra.run.smithi135:> rpm -q kernel | sort -rV | head -n 1 2024-09-16T15:29:05.975 INFO:teuthology.orchestra.run.smithi135.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-16T15:29:05.975 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-16T15:29:05.975 DEBUG:teuthology.orchestra.run.smithi135:> sudo rpm -qi grub2-tools 2024-09-16T15:29:06.007 INFO:teuthology.orchestra.run.smithi135.stdout:Name : grub2-tools 2024-09-16T15:29:06.007 INFO:teuthology.orchestra.run.smithi135.stdout:Epoch : 1 2024-09-16T15:29:06.007 INFO:teuthology.orchestra.run.smithi135.stdout:Version : 2.06 2024-09-16T15:29:06.007 INFO:teuthology.orchestra.run.smithi135.stdout:Release : 82.el9 2024-09-16T15:29:06.007 INFO:teuthology.orchestra.run.smithi135.stdout:Architecture: x86_64 2024-09-16T15:29:06.007 INFO:teuthology.orchestra.run.smithi135.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-16T15:29:06.007 INFO:teuthology.orchestra.run.smithi135.stdout:Group : Unspecified 2024-09-16T15:29:06.007 INFO:teuthology.orchestra.run.smithi135.stdout:Size : 8274670 2024-09-16T15:29:06.007 INFO:teuthology.orchestra.run.smithi135.stdout:License : GPLv3+ 2024-09-16T15:29:06.008 INFO:teuthology.orchestra.run.smithi135.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-16T15:29:06.008 INFO:teuthology.orchestra.run.smithi135.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-16T15:29:06.008 INFO:teuthology.orchestra.run.smithi135.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-16T15:29:06.008 INFO:teuthology.orchestra.run.smithi135.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-16T15:29:06.008 INFO:teuthology.orchestra.run.smithi135.stdout:Packager : builder@centos.org 2024-09-16T15:29:06.008 INFO:teuthology.orchestra.run.smithi135.stdout:Vendor : CentOS 2024-09-16T15:29:06.008 INFO:teuthology.orchestra.run.smithi135.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-16T15:29:06.008 INFO:teuthology.orchestra.run.smithi135.stdout:Summary : Support tools for GRUB. 2024-09-16T15:29:06.008 INFO:teuthology.orchestra.run.smithi135.stdout:Description : 2024-09-16T15:29:06.008 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-16T15:29:06.008 INFO:teuthology.orchestra.run.smithi135.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-16T15:29:06.008 INFO:teuthology.orchestra.run.smithi135.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-16T15:29:06.008 INFO:teuthology.orchestra.run.smithi135.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-16T15:29:06.008 INFO:teuthology.orchestra.run.smithi135.stdout:hardware devices. 2024-09-16T15:29:06.009 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-16T15:29:06.009 INFO:teuthology.orchestra.run.smithi135.stdout:This subpackage provides tools for support of all platforms. 2024-09-16T15:29:06.009 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-16T15:29:06.009 INFO:teuthology.task.kernel:Updating grub on smithi135 to boot 5.14.0-505.el9.x86_64 2024-09-16T15:29:06.010 DEBUG:teuthology.orchestra.run.smithi135:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-16T15:29:06.730 INFO:teuthology.orchestra.run.smithi135.stderr:Generating grub configuration file ... 2024-09-16T15:29:08.103 INFO:teuthology.orchestra.run.smithi135.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-16T15:29:08.127 INFO:teuthology.orchestra.run.smithi135.stderr:done 2024-09-16T15:29:08.134 DEBUG:teuthology.orchestra.run.smithi135:> mktemp 2024-09-16T15:29:08.150 INFO:teuthology.orchestra.run.smithi135.stdout:/tmp/tmp.plwoZrJEdw 2024-09-16T15:29:08.150 DEBUG:teuthology.orchestra.run.smithi135:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.plwoZrJEdw 2024-09-16T15:29:08.216 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 0666 /tmp/tmp.plwoZrJEdw 2024-09-16T15:29:08.358 DEBUG:teuthology.orchestra.remote:smithi135:/tmp/tmp.plwoZrJEdw is 6KB 2024-09-16T15:29:08.407 DEBUG:teuthology.orchestra.run.smithi135:> rm -fr /tmp/tmp.plwoZrJEdw 2024-09-16T15:29:08.486 DEBUG:teuthology.orchestra.run.smithi135:> sudo /bin/ls /boot/loader/entries || true 2024-09-16T15:29:08.509 INFO:teuthology.orchestra.run.smithi135.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-16T15:29:08.509 INFO:teuthology.orchestra.run.smithi135.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-16T15:29:08.510 INFO:teuthology.orchestra.run.smithi135.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-16T15:29:08.510 INFO:teuthology.orchestra.run.smithi135.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-16T15:29:08.511 DEBUG:teuthology.orchestra.run.smithi135:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-16T15:29:08.657 DEBUG:teuthology.orchestra.run.smithi135:> sudo shutdown -r now 2024-09-16T15:29:34.385 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-16T15:29:34.385 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-09-16T15:29:34.386 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T15:29:38.665 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-09-16T15:29:38.665 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-09-16T15:29:38.665 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T15:30:34.445 DEBUG:teuthology.orchestra.remote:timed out 2024-09-16T15:30:38.671 DEBUG:teuthology.orchestra.remote:timed out 2024-09-16T15:30:43.451 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-09-16T15:30:43.452 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T15:30:43.910 DEBUG:teuthology.orchestra.run.smithi098:> true 2024-09-16T15:30:44.468 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-09-16T15:30:44.468 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-505.el9.x86_64"... 2024-09-16T15:30:44.468 DEBUG:teuthology.orchestra.run.smithi098:> uname -r 2024-09-16T15:30:44.482 INFO:teuthology.orchestra.run.smithi098.stdout:5.14.0-505.el9.x86_64 2024-09-16T15:30:44.482 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-16T15:30:44.482 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-16T15:30:44.482 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-16T15:30:45.484 DEBUG:teuthology.parallel:result is None 2024-09-16T15:30:47.671 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-09-16T15:30:47.672 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T15:30:48.340 DEBUG:teuthology.orchestra.run.smithi135:> true 2024-09-16T15:30:48.788 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-09-16T15:30:48.788 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "5.14.0-505.el9.x86_64"... 2024-09-16T15:30:48.789 DEBUG:teuthology.orchestra.run.smithi135:> uname -r 2024-09-16T15:30:48.803 INFO:teuthology.orchestra.run.smithi135.stdout:5.14.0-505.el9.x86_64 2024-09-16T15:30:48.803 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-16T15:30:48.803 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-16T15:30:48.803 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-16T15:30:49.805 DEBUG:teuthology.parallel:result is None 2024-09-16T15:30:49.805 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-16T15:30:49.812 INFO:teuthology.task.internal:Creating test directory... 2024-09-16T15:30:49.812 DEBUG:teuthology.orchestra.run.smithi098:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-16T15:30:49.815 DEBUG:teuthology.orchestra.run.smithi135:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-16T15:30:49.830 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-16T15:30:49.836 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-16T15:30:49.843 INFO:teuthology.task.internal:Creating archive directory... 2024-09-16T15:30:49.844 DEBUG:teuthology.orchestra.run.smithi098:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-16T15:30:49.873 DEBUG:teuthology.orchestra.run.smithi135:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-16T15:30:49.938 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-16T15:30:49.944 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-16T15:30:49.944 DEBUG:teuthology.orchestra.run.smithi098:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-16T15:30:49.947 DEBUG:teuthology.orchestra.run.smithi135:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-16T15:30:50.047 INFO:teuthology.orchestra.run.smithi135.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T15:30:50.084 INFO:teuthology.orchestra.run.smithi098.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T15:30:50.106 INFO:teuthology.orchestra.run.smithi135.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T15:30:50.442 INFO:teuthology.orchestra.run.smithi098.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T15:30:50.444 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-16T15:30:50.451 INFO:teuthology.task.internal:Configuring sudo... 2024-09-16T15:30:50.451 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-16T15:30:50.453 DEBUG:teuthology.orchestra.run.smithi135:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-16T15:30:50.480 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-16T15:30:50.489 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-16T15:30:50.490 DEBUG:teuthology.orchestra.run.smithi098:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-16T15:30:50.532 DEBUG:teuthology.orchestra.run.smithi135:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-16T15:30:50.566 DEBUG:teuthology.orchestra.run.smithi098:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T15:30:50.692 DEBUG:teuthology.orchestra.run.smithi098:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T15:30:50.771 DEBUG:teuthology.orchestra.run.smithi098:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T15:30:50.843 DEBUG:teuthology.orchestra.run.smithi098:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T15:30:50.891 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-16T15:30:50.891 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-16T15:30:50.945 DEBUG:teuthology.orchestra.run.smithi135:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T15:30:50.987 DEBUG:teuthology.orchestra.run.smithi135:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T15:30:51.031 DEBUG:teuthology.orchestra.run.smithi135:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T15:30:51.109 DEBUG:teuthology.orchestra.run.smithi135:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T15:30:51.154 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-16T15:30:51.154 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-16T15:30:51.243 DEBUG:teuthology.orchestra.run.smithi098:> sudo service rsyslog restart 2024-09-16T15:30:51.248 DEBUG:teuthology.orchestra.run.smithi135:> sudo service rsyslog restart 2024-09-16T15:30:51.336 INFO:teuthology.orchestra.run.smithi098.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-16T15:30:51.344 INFO:teuthology.orchestra.run.smithi135.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-16T15:30:51.751 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-16T15:30:51.758 INFO:teuthology.task.internal:Starting timer... 2024-09-16T15:30:51.758 INFO:teuthology.run_tasks:Running task pcp... 2024-09-16T15:30:51.782 INFO:teuthology.run_tasks:Running task selinux... 2024-09-16T15:30:51.791 DEBUG:teuthology.orchestra.run.smithi098:> sudo service auditd rotate 2024-09-16T15:30:52.079 INFO:teuthology.orchestra.run.smithi098.stdout:Rotating logs: 2024-09-16T15:30:52.081 DEBUG:teuthology.orchestra.run.smithi135:> sudo service auditd rotate 2024-09-16T15:30:52.139 INFO:teuthology.orchestra.run.smithi135.stdout:Rotating logs: 2024-09-16T15:30:52.140 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-16T15:30:52.141 DEBUG:teuthology.orchestra.run.smithi098:> /usr/sbin/getenforce 2024-09-16T15:30:52.189 INFO:teuthology.orchestra.run.smithi098.stdout:Permissive 2024-09-16T15:30:52.189 DEBUG:teuthology.orchestra.run.smithi135:> /usr/sbin/getenforce 2024-09-16T15:30:52.220 INFO:teuthology.orchestra.run.smithi135.stdout:Permissive 2024-09-16T15:30:52.221 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi098.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi135.front.sepia.ceph.com': 'permissive'} 2024-09-16T15:30:52.221 DEBUG:teuthology.orchestra.run.smithi098:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-16T15:30:52.247 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T15:30:52.248 DEBUG:teuthology.orchestra.run.smithi135:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-16T15:30:52.289 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T15:30:52.290 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-16T15:30:52.290 DEBUG:teuthology.orchestra.run.smithi098:> sudo /usr/sbin/setenforce permissive 2024-09-16T15:30:52.349 DEBUG:teuthology.orchestra.run.smithi135:> sudo /usr/sbin/setenforce permissive 2024-09-16T15:30:52.381 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-16T15:30:52.391 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-16T15:30:52.435 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-16T15:30:52.874 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-16T15:30:52.912 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-16T15:30:52.913 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi098.front.sepia.ceph.com,smithi135.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-16T15:34:36.175 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi098.front.sepia.ceph.com'), Remote(name='ubuntu@smithi135.front.sepia.ceph.com')] 2024-09-16T15:34:36.177 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-09-16T15:34:36.178 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T15:34:36.258 DEBUG:teuthology.orchestra.run.smithi098:> true 2024-09-16T15:34:36.336 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-09-16T15:34:36.336 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-09-16T15:34:36.337 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T15:34:36.411 DEBUG:teuthology.orchestra.run.smithi135:> true 2024-09-16T15:34:36.489 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-09-16T15:34:36.489 INFO:teuthology.run_tasks:Running task clock... 2024-09-16T15:34:36.500 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-16T15:34:36.500 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-16T15:34:36.501 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T15:34:36.503 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-16T15:34:36.503 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T15:34:36.530 INFO:teuthology.orchestra.run.smithi098.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-16T15:34:36.545 INFO:teuthology.orchestra.run.smithi098.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-16T15:34:36.560 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-16T15:34:36.569 INFO:teuthology.orchestra.run.smithi098.stderr:sudo: ntpd: command not found 2024-09-16T15:34:36.575 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-16T15:34:36.580 INFO:teuthology.orchestra.run.smithi098.stdout:506 Cannot talk to daemon 2024-09-16T15:34:36.594 INFO:teuthology.orchestra.run.smithi098.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-16T15:34:36.600 INFO:teuthology.orchestra.run.smithi135.stderr:sudo: ntpd: command not found 2024-09-16T15:34:36.607 INFO:teuthology.orchestra.run.smithi098.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-16T15:34:36.612 INFO:teuthology.orchestra.run.smithi135.stdout:506 Cannot talk to daemon 2024-09-16T15:34:36.626 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-16T15:34:36.640 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-16T15:34:36.662 INFO:teuthology.orchestra.run.smithi098.stderr:bash: line 1: ntpq: command not found 2024-09-16T15:34:36.666 INFO:teuthology.orchestra.run.smithi098.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-16T15:34:36.666 INFO:teuthology.orchestra.run.smithi098.stdout:=============================================================================== 2024-09-16T15:34:36.666 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T15:34:36.666 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T15:34:36.666 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T15:34:36.666 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T15:34:36.698 INFO:teuthology.orchestra.run.smithi135.stderr:bash: line 1: ntpq: command not found 2024-09-16T15:34:36.701 INFO:teuthology.orchestra.run.smithi135.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-16T15:34:36.701 INFO:teuthology.orchestra.run.smithi135.stdout:=============================================================================== 2024-09-16T15:34:36.701 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T15:34:36.701 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T15:34:36.701 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T15:34:36.702 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T15:34:36.702 INFO:teuthology.run_tasks:Running task install... 2024-09-16T15:34:36.717 DEBUG:teuthology.task.install:project ceph 2024-09-16T15:34:36.717 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '33f95d2ae1bcbe7eb04404303f179eeeaa6982df'}} 2024-09-16T15:34:36.717 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '33f95d2ae1bcbe7eb04404303f179eeeaa6982df'} 2024-09-16T15:34:36.717 INFO:teuthology.task.install:Using flavor: default 2024-09-16T15:34:36.723 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-16T15:34:36.723 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-16T15:34:36.724 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '33f95d2ae1bcbe7eb04404303f179eeeaa6982df', 'tag': None, 'wait_for_package': False} 2024-09-16T15:34:36.724 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=33f95d2ae1bcbe7eb04404303f179eeeaa6982df 2024-09-16T15:34:36.726 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '33f95d2ae1bcbe7eb04404303f179eeeaa6982df', 'tag': None, 'wait_for_package': False} 2024-09-16T15:34:36.727 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=33f95d2ae1bcbe7eb04404303f179eeeaa6982df 2024-09-16T15:34:36.872 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-1454/33f95d2ae1bcbe7eb04404303f179eeeaa6982df/centos/9/flavors/default/ 2024-09-16T15:34:36.872 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4938.g33f95d2a 2024-09-16T15:34:36.888 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-1454/33f95d2ae1bcbe7eb04404303f179eeeaa6982df/centos/9/flavors/default/ 2024-09-16T15:34:36.888 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4938.g33f95d2a 2024-09-16T15:34:36.987 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-1454/33f95d2ae1bcbe7eb04404303f179eeeaa6982df/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-1454/33f95d2ae1bcbe7eb04404303f179eeeaa6982df/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-1454/33f95d2ae1bcbe7eb04404303f179eeeaa6982df/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-16T15:34:36.988 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-16T15:34:36.988 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-16T15:34:36.998 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-1454/33f95d2ae1bcbe7eb04404303f179eeeaa6982df/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-1454/33f95d2ae1bcbe7eb04404303f179eeeaa6982df/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-1454/33f95d2ae1bcbe7eb04404303f179eeeaa6982df/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-16T15:34:36.998 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-16T15:34:36.998 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-16T15:34:37.013 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-16T15:34:37.014 DEBUG:teuthology.orchestra.run.smithi098:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/33f95d2ae1bcbe7eb04404303f179eeeaa6982df/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-16T15:34:37.026 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-16T15:34:37.027 DEBUG:teuthology.orchestra.run.smithi135:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/33f95d2ae1bcbe7eb04404303f179eeeaa6982df/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-16T15:34:37.080 DEBUG:teuthology.orchestra.run.smithi098:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-16T15:34:37.094 DEBUG:teuthology.orchestra.run.smithi135:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-16T15:34:37.154 DEBUG:teuthology.orchestra.run.smithi098:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-16T15:34:37.170 DEBUG:teuthology.orchestra.run.smithi135:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-16T15:34:37.219 INFO:teuthology.orchestra.run.smithi098.stdout:check_obsoletes = 1 2024-09-16T15:34:37.220 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum clean all 2024-09-16T15:34:37.236 INFO:teuthology.orchestra.run.smithi135.stdout:check_obsoletes = 1 2024-09-16T15:34:37.237 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum clean all 2024-09-16T15:34:37.462 INFO:teuthology.orchestra.run.smithi098.stdout:45 files removed 2024-09-16T15:34:37.471 INFO:teuthology.orchestra.run.smithi135.stdout:45 files removed 2024-09-16T15:34:37.492 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-16T15:34:37.498 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-16T15:34:38.063 INFO:teuthology.orchestra.run.smithi135.stdout:ceph packages for x86_64 304 kB/s | 84 kB 00:00 2024-09-16T15:34:38.095 INFO:teuthology.orchestra.run.smithi098.stdout:ceph packages for x86_64 265 kB/s | 84 kB 00:00 2024-09-16T15:34:38.371 INFO:teuthology.orchestra.run.smithi135.stdout:ceph noarch packages 91 kB/s | 24 kB 00:00 2024-09-16T15:34:38.387 INFO:teuthology.orchestra.run.smithi098.stdout:ceph noarch packages 97 kB/s | 24 kB 00:00 2024-09-16T15:34:38.655 INFO:teuthology.orchestra.run.smithi135.stdout:ceph source packages 7.8 kB/s | 1.9 kB 00:00 2024-09-16T15:34:38.663 INFO:teuthology.orchestra.run.smithi098.stdout:ceph source packages 8.1 kB/s | 1.9 kB 00:00 2024-09-16T15:34:39.222 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.2 MB 00:00 2024-09-16T15:34:40.355 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - BaseOS 5.0 MB/s | 8.2 MB 00:01 2024-09-16T15:34:41.781 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - AppStream 14 MB/s | 20 MB 00:01 2024-09-16T15:34:42.297 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - AppStream 24 MB/s | 20 MB 00:00 2024-09-16T15:34:46.116 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.5 MB 00:00 2024-09-16T15:34:46.899 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - CRB 8.6 MB/s | 6.5 MB 00:00 2024-09-16T15:34:47.500 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - Extras packages 118 kB/s | 19 kB 00:00 2024-09-16T15:34:48.666 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - Extras packages 48 kB/s | 19 kB 00:00 2024-09-16T15:34:49.296 INFO:teuthology.orchestra.run.smithi135.stdout:Extra Packages for Enterprise Linux 14 MB/s | 23 MB 00:01 2024-09-16T15:34:50.637 INFO:teuthology.orchestra.run.smithi098.stdout:Extra Packages for Enterprise Linux 12 MB/s | 23 MB 00:01 2024-09-16T15:34:54.818 INFO:teuthology.orchestra.run.smithi135.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-16T15:34:56.110 INFO:teuthology.orchestra.run.smithi098.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-16T15:34:57.189 INFO:teuthology.orchestra.run.smithi135.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-16T15:34:57.190 INFO:teuthology.orchestra.run.smithi135.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-16T15:34:57.203 INFO:teuthology.orchestra.run.smithi135.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-16T15:34:57.204 INFO:teuthology.orchestra.run.smithi135.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-16T15:34:57.205 INFO:teuthology.orchestra.run.smithi135.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-16T15:34:57.206 INFO:teuthology.orchestra.run.smithi135.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-16T15:34:57.207 INFO:teuthology.orchestra.run.smithi135.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-16T15:34:57.210 INFO:teuthology.orchestra.run.smithi135.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-16T15:34:57.211 INFO:teuthology.orchestra.run.smithi135.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-16T15:34:57.274 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-09-16T15:34:57.295 INFO:teuthology.orchestra.run.smithi135.stdout:======================================================================================= 2024-09-16T15:34:57.295 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repository Size 2024-09-16T15:34:57.295 INFO:teuthology.orchestra.run.smithi135.stdout:======================================================================================= 2024-09-16T15:34:57.295 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2024-09-16T15:34:57.295 INFO:teuthology.orchestra.run.smithi135.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-16T15:34:57.296 INFO:teuthology.orchestra.run.smithi135.stdout: ceph x86_64 2:19.3.0-4938.g33f95d2a.el9 ceph 6.6 k 2024-09-16T15:34:57.296 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-base x86_64 2:19.3.0-4938.g33f95d2a.el9 ceph 5.5 M 2024-09-16T15:34:57.296 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-fuse x86_64 2:19.3.0-4938.g33f95d2a.el9 ceph 900 k 2024-09-16T15:34:57.296 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4938.g33f95d2a.el9 ceph 145 k 2024-09-16T15:34:57.296 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr x86_64 2:19.3.0-4938.g33f95d2a.el9 ceph 1.5 M 2024-09-16T15:34:57.296 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4938.g33f95d2a.el9 ceph-noarch 154 k 2024-09-16T15:34:57.296 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4938.g33f95d2a.el9 ceph-noarch 14 M 2024-09-16T15:34:57.296 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4938.g33f95d2a.el9 ceph-noarch 7.4 M 2024-09-16T15:34:57.296 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-rook noarch 2:19.3.0-4938.g33f95d2a.el9 ceph-noarch 49 k 2024-09-16T15:34:57.296 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-radosgw x86_64 2:19.3.0-4938.g33f95d2a.el9 ceph 11 M 2024-09-16T15:34:57.296 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-test x86_64 2:19.3.0-4938.g33f95d2a.el9 ceph 46 M 2024-09-16T15:34:57.297 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-volume noarch 2:19.3.0-4938.g33f95d2a.el9 ceph-noarch 285 k 2024-09-16T15:34:57.297 INFO:teuthology.orchestra.run.smithi135.stdout: cephadm noarch 2:19.3.0-4938.g33f95d2a.el9 ceph-noarch 784 k 2024-09-16T15:34:57.297 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-mirror x86_64 2:19.3.0-4938.g33f95d2a.el9 ceph 225 k 2024-09-16T15:34:57.297 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-shell x86_64 2:19.3.0-4938.g33f95d2a.el9 ceph 27 k 2024-09-16T15:34:57.297 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-top noarch 2:19.3.0-4938.g33f95d2a.el9 ceph-noarch 18 k 2024-09-16T15:34:57.297 INFO:teuthology.orchestra.run.smithi135.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-16T15:34:57.297 INFO:teuthology.orchestra.run.smithi135.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-16T15:34:57.297 INFO:teuthology.orchestra.run.smithi135.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-16T15:34:57.297 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs-devel x86_64 2:19.3.0-4938.g33f95d2a.el9 ceph 32 k 2024-09-16T15:34:57.297 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs2 x86_64 2:19.3.0-4938.g33f95d2a.el9 ceph 756 k 2024-09-16T15:34:57.297 INFO:teuthology.orchestra.run.smithi135.stdout: librados-devel x86_64 2:19.3.0-4938.g33f95d2a.el9 ceph 127 k 2024-09-16T15:34:57.297 INFO:teuthology.orchestra.run.smithi135.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-16T15:34:57.297 INFO:teuthology.orchestra.run.smithi135.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-16T15:34:57.298 INFO:teuthology.orchestra.run.smithi135.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-16T15:34:57.298 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-16T15:34:57.298 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-16T15:34:57.298 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-16T15:34:57.298 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cephfs x86_64 2:19.3.0-4938.g33f95d2a.el9 ceph 161 k 2024-09-16T15:34:57.298 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rados x86_64 2:19.3.0-4938.g33f95d2a.el9 ceph 321 k 2024-09-16T15:34:57.298 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rbd x86_64 2:19.3.0-4938.g33f95d2a.el9 ceph 306 k 2024-09-16T15:34:57.298 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rgw x86_64 2:19.3.0-4938.g33f95d2a.el9 ceph 99 k 2024-09-16T15:34:57.298 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-fuse x86_64 2:19.3.0-4938.g33f95d2a.el9 ceph 85 k 2024-09-16T15:34:57.298 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-mirror x86_64 2:19.3.0-4938.g33f95d2a.el9 ceph 3.2 M 2024-09-16T15:34:57.298 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-nbd x86_64 2:19.3.0-4938.g33f95d2a.el9 ceph 170 k 2024-09-16T15:34:57.299 INFO:teuthology.orchestra.run.smithi135.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-16T15:34:57.299 INFO:teuthology.orchestra.run.smithi135.stdout:Upgrading: 2024-09-16T15:34:57.299 INFO:teuthology.orchestra.run.smithi135.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-16T15:34:57.299 INFO:teuthology.orchestra.run.smithi135.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-16T15:34:57.299 INFO:teuthology.orchestra.run.smithi135.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-16T15:34:57.299 INFO:teuthology.orchestra.run.smithi135.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-16T15:34:57.299 INFO:teuthology.orchestra.run.smithi135.stdout: librados2 x86_64 2:19.3.0-4938.g33f95d2a.el9 ceph 3.5 M 2024-09-16T15:34:57.299 INFO:teuthology.orchestra.run.smithi135.stdout: librbd1 x86_64 2:19.3.0-4938.g33f95d2a.el9 ceph 3.2 M 2024-09-16T15:34:57.299 INFO:teuthology.orchestra.run.smithi135.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-16T15:34:57.299 INFO:teuthology.orchestra.run.smithi135.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-16T15:34:57.299 INFO:teuthology.orchestra.run.smithi135.stdout:Installing dependencies: 2024-09-16T15:34:57.299 INFO:teuthology.orchestra.run.smithi135.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-16T15:34:57.299 INFO:teuthology.orchestra.run.smithi135.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-16T15:34:57.300 INFO:teuthology.orchestra.run.smithi135.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-16T15:34:57.300 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-common x86_64 2:19.3.0-4938.g33f95d2a.el9 ceph 22 M 2024-09-16T15:34:57.300 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4938.g33f95d2a.el9 ceph-noarch 34 k 2024-09-16T15:34:57.300 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mds x86_64 2:19.3.0-4938.g33f95d2a.el9 ceph 2.4 M 2024-09-16T15:34:57.300 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4938.g33f95d2a.el9 ceph-noarch 291 k 2024-09-16T15:34:57.300 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mon x86_64 2:19.3.0-4938.g33f95d2a.el9 ceph 4.8 M 2024-09-16T15:34:57.300 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-osd x86_64 2:19.3.0-4938.g33f95d2a.el9 ceph 17 M 2024-09-16T15:34:57.300 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4938.g33f95d2a.el9 ceph-noarch 16 k 2024-09-16T15:34:57.300 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-selinux x86_64 2:19.3.0-4938.g33f95d2a.el9 ceph 25 k 2024-09-16T15:34:57.300 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-16T15:34:57.300 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-16T15:34:57.300 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-16T15:34:57.301 INFO:teuthology.orchestra.run.smithi135.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-16T15:34:57.301 INFO:teuthology.orchestra.run.smithi135.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-16T15:34:57.301 INFO:teuthology.orchestra.run.smithi135.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-16T15:34:57.301 INFO:teuthology.orchestra.run.smithi135.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-16T15:34:57.301 INFO:teuthology.orchestra.run.smithi135.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-16T15:34:57.301 INFO:teuthology.orchestra.run.smithi135.stdout: libcephsqlite x86_64 2:19.3.0-4938.g33f95d2a.el9 ceph 161 k 2024-09-16T15:34:57.301 INFO:teuthology.orchestra.run.smithi135.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-16T15:34:57.301 INFO:teuthology.orchestra.run.smithi135.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-16T15:34:57.301 INFO:teuthology.orchestra.run.smithi135.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-16T15:34:57.301 INFO:teuthology.orchestra.run.smithi135.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-16T15:34:57.301 INFO:teuthology.orchestra.run.smithi135.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-16T15:34:57.301 INFO:teuthology.orchestra.run.smithi135.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-16T15:34:57.301 INFO:teuthology.orchestra.run.smithi135.stdout: libradosstriper1 x86_64 2:19.3.0-4938.g33f95d2a.el9 ceph 508 k 2024-09-16T15:34:57.302 INFO:teuthology.orchestra.run.smithi135.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-16T15:34:57.302 INFO:teuthology.orchestra.run.smithi135.stdout: librgw2 x86_64 2:19.3.0-4938.g33f95d2a.el9 ceph 5.5 M 2024-09-16T15:34:57.302 INFO:teuthology.orchestra.run.smithi135.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-16T15:34:57.302 INFO:teuthology.orchestra.run.smithi135.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-16T15:34:57.302 INFO:teuthology.orchestra.run.smithi135.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-16T15:34:57.302 INFO:teuthology.orchestra.run.smithi135.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-16T15:34:57.302 INFO:teuthology.orchestra.run.smithi135.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-16T15:34:57.302 INFO:teuthology.orchestra.run.smithi135.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-16T15:34:57.302 INFO:teuthology.orchestra.run.smithi135.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-16T15:34:57.302 INFO:teuthology.orchestra.run.smithi135.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-16T15:34:57.302 INFO:teuthology.orchestra.run.smithi135.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-16T15:34:57.302 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-16T15:34:57.302 INFO:teuthology.orchestra.run.smithi135.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-16T15:34:57.303 INFO:teuthology.orchestra.run.smithi135.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-16T15:34:57.303 INFO:teuthology.orchestra.run.smithi135.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-16T15:34:57.303 INFO:teuthology.orchestra.run.smithi135.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-16T15:34:57.303 INFO:teuthology.orchestra.run.smithi135.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-16T15:34:57.303 INFO:teuthology.orchestra.run.smithi135.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-16T15:34:57.303 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-16T15:34:57.303 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-argparse x86_64 2:19.3.0-4938.g33f95d2a.el9 ceph 45 k 2024-09-16T15:34:57.303 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-common x86_64 2:19.3.0-4938.g33f95d2a.el9 ceph 148 k 2024-09-16T15:34:57.303 INFO:teuthology.orchestra.run.smithi135.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-16T15:34:57.303 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-16T15:34:57.303 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-16T15:34:57.303 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-16T15:34:57.303 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-16T15:34:57.304 INFO:teuthology.orchestra.run.smithi135.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-16T15:34:57.304 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-16T15:34:57.304 INFO:teuthology.orchestra.run.smithi135.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-16T15:34:57.304 INFO:teuthology.orchestra.run.smithi135.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-16T15:34:57.304 INFO:teuthology.orchestra.run.smithi135.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-16T15:34:57.304 INFO:teuthology.orchestra.run.smithi135.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-16T15:34:57.304 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-16T15:34:57.304 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-16T15:34:57.304 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-16T15:34:57.304 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-16T15:34:57.304 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-16T15:34:57.304 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-16T15:34:57.304 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-16T15:34:57.305 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-16T15:34:57.305 INFO:teuthology.orchestra.run.smithi135.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-16T15:34:57.305 INFO:teuthology.orchestra.run.smithi135.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-16T15:34:57.305 INFO:teuthology.orchestra.run.smithi135.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-16T15:34:57.305 INFO:teuthology.orchestra.run.smithi135.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-16T15:34:57.305 INFO:teuthology.orchestra.run.smithi135.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-16T15:34:57.305 INFO:teuthology.orchestra.run.smithi135.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-16T15:34:57.305 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-16T15:34:57.305 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-16T15:34:57.305 INFO:teuthology.orchestra.run.smithi135.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-16T15:34:57.305 INFO:teuthology.orchestra.run.smithi135.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-16T15:34:57.305 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-16T15:34:57.305 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-16T15:34:57.305 INFO:teuthology.orchestra.run.smithi135.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-16T15:34:57.306 INFO:teuthology.orchestra.run.smithi135.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-16T15:34:57.306 INFO:teuthology.orchestra.run.smithi135.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-16T15:34:57.306 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-16T15:34:57.306 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-16T15:34:57.306 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-16T15:34:57.306 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-16T15:34:57.306 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-16T15:34:57.306 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-16T15:34:57.306 INFO:teuthology.orchestra.run.smithi135.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-16T15:34:57.306 INFO:teuthology.orchestra.run.smithi135.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-16T15:34:57.306 INFO:teuthology.orchestra.run.smithi135.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-16T15:34:57.306 INFO:teuthology.orchestra.run.smithi135.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-16T15:34:57.306 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-16T15:34:57.306 INFO:teuthology.orchestra.run.smithi135.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-16T15:34:57.307 INFO:teuthology.orchestra.run.smithi135.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-16T15:34:57.307 INFO:teuthology.orchestra.run.smithi135.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-16T15:34:57.307 INFO:teuthology.orchestra.run.smithi135.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-16T15:34:57.307 INFO:teuthology.orchestra.run.smithi135.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-16T15:34:57.307 INFO:teuthology.orchestra.run.smithi135.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-16T15:34:57.307 INFO:teuthology.orchestra.run.smithi135.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-16T15:34:57.307 INFO:teuthology.orchestra.run.smithi135.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-16T15:34:57.307 INFO:teuthology.orchestra.run.smithi135.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-16T15:34:57.307 INFO:teuthology.orchestra.run.smithi135.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-16T15:34:57.307 INFO:teuthology.orchestra.run.smithi135.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-16T15:34:57.307 INFO:teuthology.orchestra.run.smithi135.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-16T15:34:57.307 INFO:teuthology.orchestra.run.smithi135.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-16T15:34:57.307 INFO:teuthology.orchestra.run.smithi135.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-16T15:34:57.308 INFO:teuthology.orchestra.run.smithi135.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-16T15:34:57.308 INFO:teuthology.orchestra.run.smithi135.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-16T15:34:57.308 INFO:teuthology.orchestra.run.smithi135.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-16T15:34:57.308 INFO:teuthology.orchestra.run.smithi135.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-16T15:34:57.308 INFO:teuthology.orchestra.run.smithi135.stdout:Installing weak dependencies: 2024-09-16T15:34:57.308 INFO:teuthology.orchestra.run.smithi135.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-16T15:34:57.308 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-16T15:34:57.308 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-09-16T15:34:57.308 INFO:teuthology.orchestra.run.smithi135.stdout:======================================================================================= 2024-09-16T15:34:57.308 INFO:teuthology.orchestra.run.smithi135.stdout:Install 149 Packages 2024-09-16T15:34:57.308 INFO:teuthology.orchestra.run.smithi135.stdout:Upgrade 8 Packages 2024-09-16T15:34:57.308 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-16T15:34:57.309 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 235 M 2024-09-16T15:34:57.309 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-09-16T15:34:58.120 INFO:teuthology.orchestra.run.smithi135.stdout:(1/157): ceph-19.3.0-4938.g33f95d2a.el9.x86_64. 45 kB/s | 6.6 kB 00:00 2024-09-16T15:34:58.345 INFO:teuthology.orchestra.run.smithi135.stdout:(2/157): ceph-fuse-19.3.0-4938.g33f95d2a.el9.x8 3.9 MB/s | 900 kB 00:00 2024-09-16T15:34:58.453 INFO:teuthology.orchestra.run.smithi135.stdout:(3/157): ceph-base-19.3.0-4938.g33f95d2a.el9.x8 11 MB/s | 5.5 MB 00:00 2024-09-16T15:34:58.478 INFO:teuthology.orchestra.run.smithi135.stdout:(4/157): ceph-immutable-object-cache-19.3.0-493 1.1 MB/s | 145 kB 00:00 2024-09-16T15:34:58.571 INFO:teuthology.orchestra.run.smithi098.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-16T15:34:58.572 INFO:teuthology.orchestra.run.smithi098.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-16T15:34:58.585 INFO:teuthology.orchestra.run.smithi098.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-16T15:34:58.586 INFO:teuthology.orchestra.run.smithi098.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-16T15:34:58.587 INFO:teuthology.orchestra.run.smithi098.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-16T15:34:58.588 INFO:teuthology.orchestra.run.smithi098.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-16T15:34:58.590 INFO:teuthology.orchestra.run.smithi098.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-16T15:34:58.593 INFO:teuthology.orchestra.run.smithi098.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-16T15:34:58.594 INFO:teuthology.orchestra.run.smithi098.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-16T15:34:58.595 INFO:teuthology.orchestra.run.smithi135.stdout:(5/157): ceph-mds-19.3.0-4938.g33f95d2a.el9.x86 17 MB/s | 2.4 MB 00:00 2024-09-16T15:34:58.659 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-16T15:34:58.681 INFO:teuthology.orchestra.run.smithi098.stdout:======================================================================================= 2024-09-16T15:34:58.682 INFO:teuthology.orchestra.run.smithi098.stdout: Package Arch Version Repository Size 2024-09-16T15:34:58.682 INFO:teuthology.orchestra.run.smithi098.stdout:======================================================================================= 2024-09-16T15:34:58.682 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-16T15:34:58.682 INFO:teuthology.orchestra.run.smithi098.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-16T15:34:58.682 INFO:teuthology.orchestra.run.smithi098.stdout: ceph x86_64 2:19.3.0-4938.g33f95d2a.el9 ceph 6.6 k 2024-09-16T15:34:58.682 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-base x86_64 2:19.3.0-4938.g33f95d2a.el9 ceph 5.5 M 2024-09-16T15:34:58.682 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-fuse x86_64 2:19.3.0-4938.g33f95d2a.el9 ceph 900 k 2024-09-16T15:34:58.682 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4938.g33f95d2a.el9 ceph 145 k 2024-09-16T15:34:58.683 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr x86_64 2:19.3.0-4938.g33f95d2a.el9 ceph 1.5 M 2024-09-16T15:34:58.683 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4938.g33f95d2a.el9 ceph-noarch 154 k 2024-09-16T15:34:58.683 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4938.g33f95d2a.el9 ceph-noarch 14 M 2024-09-16T15:34:58.683 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4938.g33f95d2a.el9 ceph-noarch 7.4 M 2024-09-16T15:34:58.683 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-rook noarch 2:19.3.0-4938.g33f95d2a.el9 ceph-noarch 49 k 2024-09-16T15:34:58.683 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-radosgw x86_64 2:19.3.0-4938.g33f95d2a.el9 ceph 11 M 2024-09-16T15:34:58.683 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-test x86_64 2:19.3.0-4938.g33f95d2a.el9 ceph 46 M 2024-09-16T15:34:58.683 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-volume noarch 2:19.3.0-4938.g33f95d2a.el9 ceph-noarch 285 k 2024-09-16T15:34:58.683 INFO:teuthology.orchestra.run.smithi098.stdout: cephadm noarch 2:19.3.0-4938.g33f95d2a.el9 ceph-noarch 784 k 2024-09-16T15:34:58.683 INFO:teuthology.orchestra.run.smithi098.stdout: cephfs-mirror x86_64 2:19.3.0-4938.g33f95d2a.el9 ceph 225 k 2024-09-16T15:34:58.683 INFO:teuthology.orchestra.run.smithi098.stdout: cephfs-shell x86_64 2:19.3.0-4938.g33f95d2a.el9 ceph 27 k 2024-09-16T15:34:58.683 INFO:teuthology.orchestra.run.smithi098.stdout: cephfs-top noarch 2:19.3.0-4938.g33f95d2a.el9 ceph-noarch 18 k 2024-09-16T15:34:58.683 INFO:teuthology.orchestra.run.smithi098.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-16T15:34:58.683 INFO:teuthology.orchestra.run.smithi098.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-16T15:34:58.684 INFO:teuthology.orchestra.run.smithi098.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-16T15:34:58.684 INFO:teuthology.orchestra.run.smithi098.stdout: libcephfs-devel x86_64 2:19.3.0-4938.g33f95d2a.el9 ceph 32 k 2024-09-16T15:34:58.684 INFO:teuthology.orchestra.run.smithi098.stdout: libcephfs2 x86_64 2:19.3.0-4938.g33f95d2a.el9 ceph 756 k 2024-09-16T15:34:58.684 INFO:teuthology.orchestra.run.smithi098.stdout: librados-devel x86_64 2:19.3.0-4938.g33f95d2a.el9 ceph 127 k 2024-09-16T15:34:58.684 INFO:teuthology.orchestra.run.smithi098.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-16T15:34:58.684 INFO:teuthology.orchestra.run.smithi098.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-16T15:34:58.684 INFO:teuthology.orchestra.run.smithi098.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-16T15:34:58.684 INFO:teuthology.orchestra.run.smithi098.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-16T15:34:58.684 INFO:teuthology.orchestra.run.smithi098.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-16T15:34:58.684 INFO:teuthology.orchestra.run.smithi098.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-16T15:34:58.685 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cephfs x86_64 2:19.3.0-4938.g33f95d2a.el9 ceph 161 k 2024-09-16T15:34:58.685 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rados x86_64 2:19.3.0-4938.g33f95d2a.el9 ceph 321 k 2024-09-16T15:34:58.685 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rbd x86_64 2:19.3.0-4938.g33f95d2a.el9 ceph 306 k 2024-09-16T15:34:58.685 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rgw x86_64 2:19.3.0-4938.g33f95d2a.el9 ceph 99 k 2024-09-16T15:34:58.685 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-fuse x86_64 2:19.3.0-4938.g33f95d2a.el9 ceph 85 k 2024-09-16T15:34:58.685 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-mirror x86_64 2:19.3.0-4938.g33f95d2a.el9 ceph 3.2 M 2024-09-16T15:34:58.685 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-nbd x86_64 2:19.3.0-4938.g33f95d2a.el9 ceph 170 k 2024-09-16T15:34:58.685 INFO:teuthology.orchestra.run.smithi098.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-16T15:34:58.685 INFO:teuthology.orchestra.run.smithi098.stdout:Upgrading: 2024-09-16T15:34:58.685 INFO:teuthology.orchestra.run.smithi098.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-16T15:34:58.685 INFO:teuthology.orchestra.run.smithi098.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-16T15:34:58.686 INFO:teuthology.orchestra.run.smithi098.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-16T15:34:58.686 INFO:teuthology.orchestra.run.smithi098.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-16T15:34:58.686 INFO:teuthology.orchestra.run.smithi098.stdout: librados2 x86_64 2:19.3.0-4938.g33f95d2a.el9 ceph 3.5 M 2024-09-16T15:34:58.686 INFO:teuthology.orchestra.run.smithi098.stdout: librbd1 x86_64 2:19.3.0-4938.g33f95d2a.el9 ceph 3.2 M 2024-09-16T15:34:58.686 INFO:teuthology.orchestra.run.smithi098.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-16T15:34:58.686 INFO:teuthology.orchestra.run.smithi098.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-16T15:34:58.686 INFO:teuthology.orchestra.run.smithi098.stdout:Installing dependencies: 2024-09-16T15:34:58.686 INFO:teuthology.orchestra.run.smithi098.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-16T15:34:58.686 INFO:teuthology.orchestra.run.smithi098.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-16T15:34:58.686 INFO:teuthology.orchestra.run.smithi098.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-16T15:34:58.687 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-common x86_64 2:19.3.0-4938.g33f95d2a.el9 ceph 22 M 2024-09-16T15:34:58.687 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4938.g33f95d2a.el9 ceph-noarch 34 k 2024-09-16T15:34:58.687 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mds x86_64 2:19.3.0-4938.g33f95d2a.el9 ceph 2.4 M 2024-09-16T15:34:58.687 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4938.g33f95d2a.el9 ceph-noarch 291 k 2024-09-16T15:34:58.687 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mon x86_64 2:19.3.0-4938.g33f95d2a.el9 ceph 4.8 M 2024-09-16T15:34:58.687 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-osd x86_64 2:19.3.0-4938.g33f95d2a.el9 ceph 17 M 2024-09-16T15:34:58.687 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4938.g33f95d2a.el9 ceph-noarch 16 k 2024-09-16T15:34:58.687 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-selinux x86_64 2:19.3.0-4938.g33f95d2a.el9 ceph 25 k 2024-09-16T15:34:58.687 INFO:teuthology.orchestra.run.smithi098.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-16T15:34:58.687 INFO:teuthology.orchestra.run.smithi098.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-16T15:34:58.688 INFO:teuthology.orchestra.run.smithi098.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-16T15:34:58.688 INFO:teuthology.orchestra.run.smithi098.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-16T15:34:58.688 INFO:teuthology.orchestra.run.smithi098.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-16T15:34:58.688 INFO:teuthology.orchestra.run.smithi098.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-16T15:34:58.688 INFO:teuthology.orchestra.run.smithi098.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-16T15:34:58.688 INFO:teuthology.orchestra.run.smithi098.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-16T15:34:58.688 INFO:teuthology.orchestra.run.smithi098.stdout: libcephsqlite x86_64 2:19.3.0-4938.g33f95d2a.el9 ceph 161 k 2024-09-16T15:34:58.688 INFO:teuthology.orchestra.run.smithi098.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-16T15:34:58.688 INFO:teuthology.orchestra.run.smithi098.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-16T15:34:58.689 INFO:teuthology.orchestra.run.smithi098.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-16T15:34:58.689 INFO:teuthology.orchestra.run.smithi098.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-16T15:34:58.689 INFO:teuthology.orchestra.run.smithi098.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-16T15:34:58.689 INFO:teuthology.orchestra.run.smithi098.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-16T15:34:58.689 INFO:teuthology.orchestra.run.smithi098.stdout: libradosstriper1 x86_64 2:19.3.0-4938.g33f95d2a.el9 ceph 508 k 2024-09-16T15:34:58.689 INFO:teuthology.orchestra.run.smithi098.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-16T15:34:58.689 INFO:teuthology.orchestra.run.smithi098.stdout: librgw2 x86_64 2:19.3.0-4938.g33f95d2a.el9 ceph 5.5 M 2024-09-16T15:34:58.689 INFO:teuthology.orchestra.run.smithi098.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-16T15:34:58.689 INFO:teuthology.orchestra.run.smithi098.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-16T15:34:58.689 INFO:teuthology.orchestra.run.smithi098.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-16T15:34:58.689 INFO:teuthology.orchestra.run.smithi098.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-16T15:34:58.689 INFO:teuthology.orchestra.run.smithi098.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-16T15:34:58.690 INFO:teuthology.orchestra.run.smithi098.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-16T15:34:58.690 INFO:teuthology.orchestra.run.smithi098.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-16T15:34:58.690 INFO:teuthology.orchestra.run.smithi098.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-16T15:34:58.690 INFO:teuthology.orchestra.run.smithi098.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-16T15:34:58.690 INFO:teuthology.orchestra.run.smithi098.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-16T15:34:58.690 INFO:teuthology.orchestra.run.smithi098.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-16T15:34:58.690 INFO:teuthology.orchestra.run.smithi098.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-16T15:34:58.690 INFO:teuthology.orchestra.run.smithi098.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-16T15:34:58.690 INFO:teuthology.orchestra.run.smithi098.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-16T15:34:58.690 INFO:teuthology.orchestra.run.smithi098.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-16T15:34:58.690 INFO:teuthology.orchestra.run.smithi098.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-16T15:34:58.690 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-16T15:34:58.690 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ceph-argparse x86_64 2:19.3.0-4938.g33f95d2a.el9 ceph 45 k 2024-09-16T15:34:58.691 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ceph-common x86_64 2:19.3.0-4938.g33f95d2a.el9 ceph 148 k 2024-09-16T15:34:58.691 INFO:teuthology.orchestra.run.smithi098.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-16T15:34:58.691 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-16T15:34:58.691 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-16T15:34:58.691 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-16T15:34:58.691 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-16T15:34:58.691 INFO:teuthology.orchestra.run.smithi098.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-16T15:34:58.691 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-16T15:34:58.691 INFO:teuthology.orchestra.run.smithi098.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-16T15:34:58.691 INFO:teuthology.orchestra.run.smithi098.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-16T15:34:58.691 INFO:teuthology.orchestra.run.smithi098.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-16T15:34:58.691 INFO:teuthology.orchestra.run.smithi098.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-16T15:34:58.691 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-16T15:34:58.691 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-16T15:34:58.692 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-16T15:34:58.692 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-16T15:34:58.692 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-16T15:34:58.692 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-16T15:34:58.692 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-16T15:34:58.692 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-16T15:34:58.692 INFO:teuthology.orchestra.run.smithi098.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-16T15:34:58.692 INFO:teuthology.orchestra.run.smithi098.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-16T15:34:58.692 INFO:teuthology.orchestra.run.smithi098.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-16T15:34:58.692 INFO:teuthology.orchestra.run.smithi098.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-16T15:34:58.692 INFO:teuthology.orchestra.run.smithi098.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-16T15:34:58.692 INFO:teuthology.orchestra.run.smithi098.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-16T15:34:58.693 INFO:teuthology.orchestra.run.smithi098.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-16T15:34:58.693 INFO:teuthology.orchestra.run.smithi098.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-16T15:34:58.693 INFO:teuthology.orchestra.run.smithi098.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-16T15:34:58.693 INFO:teuthology.orchestra.run.smithi098.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-16T15:34:58.693 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-16T15:34:58.693 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-16T15:34:58.693 INFO:teuthology.orchestra.run.smithi098.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-16T15:34:58.693 INFO:teuthology.orchestra.run.smithi098.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-16T15:34:58.693 INFO:teuthology.orchestra.run.smithi098.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-16T15:34:58.693 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-16T15:34:58.693 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-16T15:34:58.693 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-16T15:34:58.693 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-16T15:34:58.694 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-16T15:34:58.694 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-16T15:34:58.694 INFO:teuthology.orchestra.run.smithi098.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-16T15:34:58.694 INFO:teuthology.orchestra.run.smithi098.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-16T15:34:58.694 INFO:teuthology.orchestra.run.smithi098.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-16T15:34:58.694 INFO:teuthology.orchestra.run.smithi098.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-16T15:34:58.694 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-16T15:34:58.694 INFO:teuthology.orchestra.run.smithi098.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-16T15:34:58.694 INFO:teuthology.orchestra.run.smithi098.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-16T15:34:58.694 INFO:teuthology.orchestra.run.smithi098.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-16T15:34:58.694 INFO:teuthology.orchestra.run.smithi098.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-16T15:34:58.694 INFO:teuthology.orchestra.run.smithi098.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-16T15:34:58.694 INFO:teuthology.orchestra.run.smithi098.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-16T15:34:58.695 INFO:teuthology.orchestra.run.smithi098.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-16T15:34:58.695 INFO:teuthology.orchestra.run.smithi098.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-16T15:34:58.695 INFO:teuthology.orchestra.run.smithi098.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-16T15:34:58.695 INFO:teuthology.orchestra.run.smithi098.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-16T15:34:58.695 INFO:teuthology.orchestra.run.smithi098.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-16T15:34:58.695 INFO:teuthology.orchestra.run.smithi098.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-16T15:34:58.695 INFO:teuthology.orchestra.run.smithi098.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-16T15:34:58.695 INFO:teuthology.orchestra.run.smithi098.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-16T15:34:58.695 INFO:teuthology.orchestra.run.smithi098.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-16T15:34:58.695 INFO:teuthology.orchestra.run.smithi098.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-16T15:34:58.695 INFO:teuthology.orchestra.run.smithi098.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-16T15:34:58.695 INFO:teuthology.orchestra.run.smithi098.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-16T15:34:58.695 INFO:teuthology.orchestra.run.smithi098.stdout:Installing weak dependencies: 2024-09-16T15:34:58.695 INFO:teuthology.orchestra.run.smithi098.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-16T15:34:58.695 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:34:58.696 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-16T15:34:58.696 INFO:teuthology.orchestra.run.smithi098.stdout:======================================================================================= 2024-09-16T15:34:58.696 INFO:teuthology.orchestra.run.smithi098.stdout:Install 149 Packages 2024-09-16T15:34:58.696 INFO:teuthology.orchestra.run.smithi098.stdout:Upgrade 8 Packages 2024-09-16T15:34:58.696 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:34:58.696 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 235 M 2024-09-16T15:34:58.697 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-16T15:34:58.721 INFO:teuthology.orchestra.run.smithi135.stdout:(6/157): ceph-mgr-19.3.0-4938.g33f95d2a.el9.x86 6.3 MB/s | 1.5 MB 00:00 2024-09-16T15:34:58.871 INFO:teuthology.orchestra.run.smithi135.stdout:(7/157): ceph-mon-19.3.0-4938.g33f95d2a.el9.x86 17 MB/s | 4.8 MB 00:00 2024-09-16T15:34:59.097 INFO:teuthology.orchestra.run.smithi135.stdout:(8/157): ceph-common-19.3.0-4938.g33f95d2a.el9. 19 MB/s | 22 MB 00:01 2024-09-16T15:34:59.138 INFO:teuthology.orchestra.run.smithi135.stdout:(9/157): ceph-selinux-19.3.0-4938.g33f95d2a.el9 611 kB/s | 25 kB 00:00 2024-09-16T15:34:59.461 INFO:teuthology.orchestra.run.smithi098.stdout:(1/157): ceph-19.3.0-4938.g33f95d2a.el9.x86_64. 39 kB/s | 6.6 kB 00:00 2024-09-16T15:34:59.472 INFO:teuthology.orchestra.run.smithi135.stdout:(10/157): ceph-radosgw-19.3.0-4938.g33f95d2a.el 18 MB/s | 11 MB 00:00 2024-09-16T15:34:59.522 INFO:teuthology.orchestra.run.smithi135.stdout:(11/157): cephfs-mirror-19.3.0-4938.g33f95d2a.e 4.4 MB/s | 225 kB 00:00 2024-09-16T15:34:59.581 INFO:teuthology.orchestra.run.smithi135.stdout:(12/157): cephfs-shell-19.3.0-4938.g33f95d2a.el 463 kB/s | 27 kB 00:00 2024-09-16T15:34:59.648 INFO:teuthology.orchestra.run.smithi135.stdout:(13/157): libcephfs-devel-19.3.0-4938.g33f95d2a 478 kB/s | 32 kB 00:00 2024-09-16T15:34:59.740 INFO:teuthology.orchestra.run.smithi135.stdout:(14/157): libcephfs2-19.3.0-4938.g33f95d2a.el9. 8.1 MB/s | 756 kB 00:00 2024-09-16T15:34:59.794 INFO:teuthology.orchestra.run.smithi098.stdout:(2/157): ceph-fuse-19.3.0-4938.g33f95d2a.el9.x8 2.6 MB/s | 900 kB 00:00 2024-09-16T15:34:59.823 INFO:teuthology.orchestra.run.smithi135.stdout:(15/157): libcephsqlite-19.3.0-4938.g33f95d2a.e 1.9 MB/s | 161 kB 00:00 2024-09-16T15:34:59.862 INFO:teuthology.orchestra.run.smithi098.stdout:(3/157): ceph-immutable-object-cache-19.3.0-493 2.1 MB/s | 145 kB 00:00 2024-09-16T15:34:59.899 INFO:teuthology.orchestra.run.smithi135.stdout:(16/157): librados-devel-19.3.0-4938.g33f95d2a. 1.7 MB/s | 127 kB 00:00 2024-09-16T15:34:59.999 INFO:teuthology.orchestra.run.smithi135.stdout:(17/157): libradosstriper1-19.3.0-4938.g33f95d2 5.0 MB/s | 508 kB 00:00 2024-09-16T15:35:00.507 INFO:teuthology.orchestra.run.smithi135.stdout:(18/157): librgw2-19.3.0-4938.g33f95d2a.el9.x86 11 MB/s | 5.5 MB 00:00 2024-09-16T15:35:00.600 INFO:teuthology.orchestra.run.smithi135.stdout:(19/157): python3-ceph-argparse-19.3.0-4938.g33 493 kB/s | 45 kB 00:00 2024-09-16T15:35:00.612 INFO:teuthology.orchestra.run.smithi098.stdout:(4/157): ceph-base-19.3.0-4938.g33f95d2a.el9.x8 4.2 MB/s | 5.5 MB 00:01 2024-09-16T15:35:00.662 INFO:teuthology.orchestra.run.smithi098.stdout:(5/157): ceph-mds-19.3.0-4938.g33f95d2a.el9.x86 3.0 MB/s | 2.4 MB 00:00 2024-09-16T15:35:00.783 INFO:teuthology.orchestra.run.smithi135.stdout:(20/157): ceph-osd-19.3.0-4938.g33f95d2a.el9.x8 8.3 MB/s | 17 MB 00:02 2024-09-16T15:35:00.808 INFO:teuthology.orchestra.run.smithi135.stdout:(21/157): python3-ceph-common-19.3.0-4938.g33f9 710 kB/s | 148 kB 00:00 2024-09-16T15:35:00.829 INFO:teuthology.orchestra.run.smithi098.stdout:(6/157): ceph-mgr-19.3.0-4938.g33f95d2a.el9.x86 7.0 MB/s | 1.5 MB 00:00 2024-09-16T15:35:00.833 INFO:teuthology.orchestra.run.smithi135.stdout:(22/157): python3-cephfs-19.3.0-4938.g33f95d2a. 3.2 MB/s | 161 kB 00:00 2024-09-16T15:35:00.867 INFO:teuthology.orchestra.run.smithi135.stdout:(23/157): python3-rados-19.3.0-4938.g33f95d2a.e 5.3 MB/s | 321 kB 00:00 2024-09-16T15:35:00.901 INFO:teuthology.orchestra.run.smithi135.stdout:(24/157): python3-rbd-19.3.0-4938.g33f95d2a.el9 4.5 MB/s | 306 kB 00:00 2024-09-16T15:35:00.934 INFO:teuthology.orchestra.run.smithi135.stdout:(25/157): python3-rgw-19.3.0-4938.g33f95d2a.el9 1.5 MB/s | 99 kB 00:00 2024-09-16T15:35:00.960 INFO:teuthology.orchestra.run.smithi135.stdout:(26/157): rbd-fuse-19.3.0-4938.g33f95d2a.el9.x8 1.4 MB/s | 85 kB 00:00 2024-09-16T15:35:01.027 INFO:teuthology.orchestra.run.smithi135.stdout:(27/157): rbd-nbd-19.3.0-4938.g33f95d2a.el9.x86 2.5 MB/s | 170 kB 00:00 2024-09-16T15:35:01.038 INFO:teuthology.orchestra.run.smithi098.stdout:(7/157): ceph-common-19.3.0-4938.g33f95d2a.el9. 12 MB/s | 22 MB 00:01 2024-09-16T15:35:01.152 INFO:teuthology.orchestra.run.smithi135.stdout:(28/157): rbd-mirror-19.3.0-4938.g33f95d2a.el9. 15 MB/s | 3.2 MB 00:00 2024-09-16T15:35:01.177 INFO:teuthology.orchestra.run.smithi135.stdout:(29/157): ceph-grafana-dashboards-19.3.0-4938.g 228 kB/s | 34 kB 00:00 2024-09-16T15:35:01.253 INFO:teuthology.orchestra.run.smithi135.stdout:(30/157): ceph-mgr-cephadm-19.3.0-4938.g33f95d2 1.5 MB/s | 154 kB 00:00 2024-09-16T15:35:01.463 INFO:teuthology.orchestra.run.smithi098.stdout:(8/157): ceph-mon-19.3.0-4938.g33f95d2a.el9.x86 6.0 MB/s | 4.8 MB 00:00 2024-09-16T15:35:01.530 INFO:teuthology.orchestra.run.smithi098.stdout:(9/157): ceph-selinux-19.3.0-4938.g33f95d2a.el9 377 kB/s | 25 kB 00:00 2024-09-16T15:35:01.764 INFO:teuthology.orchestra.run.smithi098.stdout:(10/157): ceph-radosgw-19.3.0-4938.g33f95d2a.el 15 MB/s | 11 MB 00:00 2024-09-16T15:35:01.822 INFO:teuthology.orchestra.run.smithi098.stdout:(11/157): cephfs-mirror-19.3.0-4938.g33f95d2a.e 3.8 MB/s | 225 kB 00:00 2024-09-16T15:35:01.872 INFO:teuthology.orchestra.run.smithi098.stdout:(12/157): cephfs-shell-19.3.0-4938.g33f95d2a.el 539 kB/s | 27 kB 00:00 2024-09-16T15:35:01.931 INFO:teuthology.orchestra.run.smithi098.stdout:(13/157): libcephfs-devel-19.3.0-4938.g33f95d2a 543 kB/s | 32 kB 00:00 2024-09-16T15:35:01.989 INFO:teuthology.orchestra.run.smithi135.stdout:(31/157): ceph-test-19.3.0-4938.g33f95d2a.el9.x 16 MB/s | 46 MB 00:02 2024-09-16T15:35:02.015 INFO:teuthology.orchestra.run.smithi098.stdout:(14/157): libcephfs2-19.3.0-4938.g33f95d2a.el9. 8.9 MB/s | 756 kB 00:00 2024-09-16T15:35:02.099 INFO:teuthology.orchestra.run.smithi098.stdout:(15/157): libcephsqlite-19.3.0-4938.g33f95d2a.e 1.9 MB/s | 161 kB 00:00 2024-09-16T15:35:02.153 INFO:teuthology.orchestra.run.smithi135.stdout:(32/157): ceph-mgr-modules-core-19.3.0-4938.g33 1.7 MB/s | 291 kB 00:00 2024-09-16T15:35:02.190 INFO:teuthology.orchestra.run.smithi098.stdout:(16/157): librados-devel-19.3.0-4938.g33f95d2a. 1.3 MB/s | 127 kB 00:00 2024-09-16T15:35:02.228 INFO:teuthology.orchestra.run.smithi135.stdout:(33/157): ceph-mgr-rook-19.3.0-4938.g33f95d2a.e 659 kB/s | 49 kB 00:00 2024-09-16T15:35:02.282 INFO:teuthology.orchestra.run.smithi098.stdout:(17/157): libradosstriper1-19.3.0-4938.g33f95d2 5.4 MB/s | 508 kB 00:00 2024-09-16T15:35:02.387 INFO:teuthology.orchestra.run.smithi135.stdout:(34/157): ceph-mgr-diskprediction-local-19.3.0- 6.5 MB/s | 7.4 MB 00:01 2024-09-16T15:35:02.421 INFO:teuthology.orchestra.run.smithi135.stdout:(35/157): ceph-prometheus-alerts-19.3.0-4938.g3 86 kB/s | 16 kB 00:00 2024-09-16T15:35:02.488 INFO:teuthology.orchestra.run.smithi135.stdout:(36/157): ceph-volume-19.3.0-4938.g33f95d2a.el9 2.8 MB/s | 285 kB 00:00 2024-09-16T15:35:02.588 INFO:teuthology.orchestra.run.smithi135.stdout:(37/157): cephfs-top-19.3.0-4938.g33f95d2a.el9. 182 kB/s | 18 kB 00:00 2024-09-16T15:35:02.655 INFO:teuthology.orchestra.run.smithi135.stdout:(38/157): cephadm-19.3.0-4938.g33f95d2a.el9.noa 3.3 MB/s | 784 kB 00:00 2024-09-16T15:35:02.730 INFO:teuthology.orchestra.run.smithi135.stdout:(39/157): fuse-2.9.9-16.el9.x86_64.rpm 562 kB/s | 80 kB 00:00 2024-09-16T15:35:02.749 INFO:teuthology.orchestra.run.smithi098.stdout:(18/157): ceph-osd-19.3.0-4938.g33f95d2a.el9.x8 8.9 MB/s | 17 MB 00:01 2024-09-16T15:35:02.822 INFO:teuthology.orchestra.run.smithi135.stdout:(40/157): libquadmath-11.5.0-2.el9.x86_64.rpm 2.0 MB/s | 191 kB 00:00 2024-09-16T15:35:02.881 INFO:teuthology.orchestra.run.smithi135.stdout:(41/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.2 MB/s | 253 kB 00:00 2024-09-16T15:35:02.900 INFO:teuthology.orchestra.run.smithi098.stdout:(19/157): librgw2-19.3.0-4938.g33f95d2a.el9.x86 8.9 MB/s | 5.5 MB 00:00 2024-09-16T15:35:02.923 INFO:teuthology.orchestra.run.smithi135.stdout:(42/157): libgfortran-11.5.0-2.el9.x86_64.rpm 2.9 MB/s | 801 kB 00:00 2024-09-16T15:35:02.925 INFO:teuthology.orchestra.run.smithi098.stdout:(20/157): python3-ceph-argparse-19.3.0-4938.g33 258 kB/s | 45 kB 00:00 2024-09-16T15:35:02.950 INFO:teuthology.orchestra.run.smithi098.stdout:(21/157): python3-ceph-common-19.3.0-4938.g33f9 2.9 MB/s | 148 kB 00:00 2024-09-16T15:35:02.975 INFO:teuthology.orchestra.run.smithi098.stdout:(22/157): python3-cephfs-19.3.0-4938.g33f95d2a. 3.1 MB/s | 161 kB 00:00 2024-09-16T15:35:02.981 INFO:teuthology.orchestra.run.smithi135.stdout:(43/157): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-16T15:35:03.026 INFO:teuthology.orchestra.run.smithi098.stdout:(23/157): python3-rados-19.3.0-4938.g33f95d2a.e 4.2 MB/s | 321 kB 00:00 2024-09-16T15:35:03.040 INFO:teuthology.orchestra.run.smithi135.stdout:(44/157): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-09-16T15:35:03.051 INFO:teuthology.orchestra.run.smithi098.stdout:(24/157): python3-rbd-19.3.0-4938.g33f95d2a.el9 4.0 MB/s | 306 kB 00:00 2024-09-16T15:35:03.082 INFO:teuthology.orchestra.run.smithi135.stdout:(45/157): python3-cryptography-36.0.1-4.el9.x86 6.1 MB/s | 1.2 MB 00:00 2024-09-16T15:35:03.101 INFO:teuthology.orchestra.run.smithi098.stdout:(25/157): python3-rgw-19.3.0-4938.g33f95d2a.el9 1.3 MB/s | 99 kB 00:00 2024-09-16T15:35:03.107 INFO:teuthology.orchestra.run.smithi135.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 1.8 MB/s | 125 kB 00:00 2024-09-16T15:35:03.127 INFO:teuthology.orchestra.run.smithi098.stdout:(26/157): rbd-fuse-19.3.0-4938.g33f95d2a.el9.x8 1.1 MB/s | 85 kB 00:00 2024-09-16T15:35:03.141 INFO:teuthology.orchestra.run.smithi135.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-09-16T15:35:03.219 INFO:teuthology.orchestra.run.smithi098.stdout:(27/157): rbd-nbd-19.3.0-4938.g33f95d2a.el9.x86 1.8 MB/s | 170 kB 00:00 2024-09-16T15:35:03.291 INFO:teuthology.orchestra.run.smithi135.stdout:(48/157): ceph-mgr-dashboard-19.3.0-4938.g33f95 6.7 MB/s | 14 MB 00:02 2024-09-16T15:35:03.311 INFO:teuthology.orchestra.run.smithi098.stdout:(28/157): ceph-grafana-dashboards-19.3.0-4938.g 374 kB/s | 34 kB 00:00 2024-09-16T15:35:03.375 INFO:teuthology.orchestra.run.smithi135.stdout:(49/157): automake-1.16.2-8.el9.noarch.rpm 2.5 MB/s | 689 kB 00:00 2024-09-16T15:35:03.386 INFO:teuthology.orchestra.run.smithi098.stdout:(29/157): rbd-mirror-19.3.0-4938.g33f95d2a.el9. 11 MB/s | 3.2 MB 00:00 2024-09-16T15:35:03.411 INFO:teuthology.orchestra.run.smithi098.stdout:(30/157): ceph-mgr-cephadm-19.3.0-4938.g33f95d2 1.5 MB/s | 154 kB 00:00 2024-09-16T15:35:03.483 INFO:teuthology.orchestra.run.smithi135.stdout:(50/157): bison-3.7.4-5.el9.x86_64.rpm 2.7 MB/s | 943 kB 00:00 2024-09-16T15:35:03.533 INFO:teuthology.orchestra.run.smithi135.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 137 kB/s | 22 kB 00:00 2024-09-16T15:35:03.559 INFO:teuthology.orchestra.run.smithi135.stdout:(52/157): boost-program-options-1.75.0-8.el9.x8 400 kB/s | 107 kB 00:00 2024-09-16T15:35:03.584 INFO:teuthology.orchestra.run.smithi135.stdout:(53/157): flex-2.6.4-9.el9.x86_64.rpm 3.0 MB/s | 313 kB 00:00 2024-09-16T15:35:03.618 INFO:teuthology.orchestra.run.smithi135.stdout:(54/157): flexiblas-3.0.4-8.el9.x86_64.rpm 390 kB/s | 33 kB 00:00 2024-09-16T15:35:03.651 INFO:teuthology.orchestra.run.smithi135.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 272 kB/s | 18 kB 00:00 2024-09-16T15:35:03.710 INFO:teuthology.orchestra.run.smithi135.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 121 kB/s | 11 kB 00:00 2024-09-16T15:35:03.735 INFO:teuthology.orchestra.run.smithi135.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 2.0 MB/s | 171 kB 00:00 2024-09-16T15:35:03.802 INFO:teuthology.orchestra.run.smithi135.stdout:(58/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 12 MB/s | 3.0 MB 00:00 2024-09-16T15:35:03.827 INFO:teuthology.orchestra.run.smithi135.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 492 kB/s | 45 kB 00:00 2024-09-16T15:35:03.853 INFO:teuthology.orchestra.run.smithi135.stdout:(60/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.1 MB/s | 160 kB 00:00 2024-09-16T15:35:03.878 INFO:teuthology.orchestra.run.smithi135.stdout:(61/157): librdkafka-1.6.1-102.el9.x86_64.rpm 8.6 MB/s | 662 kB 00:00 2024-09-16T15:35:03.903 INFO:teuthology.orchestra.run.smithi135.stdout:(62/157): libtool-2.4.6-46.el9.x86_64.rpm 7.5 MB/s | 581 kB 00:00 2024-09-16T15:35:03.928 INFO:teuthology.orchestra.run.smithi135.stdout:(63/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 324 kB/s | 24 kB 00:00 2024-09-16T15:35:03.954 INFO:teuthology.orchestra.run.smithi135.stdout:(64/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 626 kB/s | 47 kB 00:00 2024-09-16T15:35:03.979 INFO:teuthology.orchestra.run.smithi135.stdout:(65/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.8 MB/s | 292 kB 00:00 2024-09-16T15:35:04.046 INFO:teuthology.orchestra.run.smithi135.stdout:(66/157): lua-5.4.4-4.el9.x86_64.rpm 1.6 MB/s | 188 kB 00:00 2024-09-16T15:35:04.071 INFO:teuthology.orchestra.run.smithi135.stdout:(67/157): openblas-0.3.26-2.el9.x86_64.rpm 328 kB/s | 38 kB 00:00 2024-09-16T15:35:04.172 INFO:teuthology.orchestra.run.smithi135.stdout:(68/157): openblas-openmp-0.3.26-2.el9.x86_64.r 26 MB/s | 4.9 MB 00:00 2024-09-16T15:35:04.214 INFO:teuthology.orchestra.run.smithi135.stdout:(69/157): postgresql-13.16-1.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-09-16T15:35:04.256 INFO:teuthology.orchestra.run.smithi135.stdout:(70/157): postgresql-contrib-13.16-1.el9.x86_64 11 MB/s | 910 kB 00:00 2024-09-16T15:35:04.281 INFO:teuthology.orchestra.run.smithi135.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-09-16T15:35:04.348 INFO:teuthology.orchestra.run.smithi135.stdout:(72/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2024-09-16T15:35:04.362 INFO:teuthology.orchestra.run.smithi098.stdout:(31/157): ceph-mgr-dashboard-19.3.0-4938.g33f95 15 MB/s | 14 MB 00:00 2024-09-16T15:35:04.382 INFO:teuthology.orchestra.run.smithi135.stdout:(73/157): protobuf-3.14.0-13.el9.x86_64.rpm 10 MB/s | 1.0 MB 00:00 2024-09-16T15:35:04.462 INFO:teuthology.orchestra.run.smithi098.stdout:(32/157): ceph-mgr-modules-core-19.3.0-4938.g33 2.9 MB/s | 291 kB 00:00 2024-09-16T15:35:04.473 INFO:teuthology.orchestra.run.smithi135.stdout:(74/157): postgresql-server-13.16-1.el9.x86_64. 27 MB/s | 5.8 MB 00:00 2024-09-16T15:35:04.507 INFO:teuthology.orchestra.run.smithi135.stdout:(75/157): python3-attrs-20.3.0-7.el9.noarch.rpm 551 kB/s | 87 kB 00:00 2024-09-16T15:35:04.529 INFO:teuthology.orchestra.run.smithi098.stdout:(33/157): ceph-mgr-rook-19.3.0-4938.g33f95d2a.e 742 kB/s | 49 kB 00:00 2024-09-16T15:35:04.541 INFO:teuthology.orchestra.run.smithi135.stdout:(76/157): python3-colorama-0.4.6-3.el9.noarch.r 918 kB/s | 61 kB 00:00 2024-09-16T15:35:04.621 INFO:teuthology.orchestra.run.smithi098.stdout:(34/157): ceph-mgr-diskprediction-local-19.3.0- 6.1 MB/s | 7.4 MB 00:01 2024-09-16T15:35:04.646 INFO:teuthology.orchestra.run.smithi098.stdout:(35/157): ceph-prometheus-alerts-19.3.0-4938.g3 140 kB/s | 16 kB 00:00 2024-09-16T15:35:04.649 INFO:teuthology.orchestra.run.smithi135.stdout:(77/157): python3-babel-2.9.1-2.el9.noarch.rpm 22 MB/s | 6.0 MB 00:00 2024-09-16T15:35:04.675 INFO:teuthology.orchestra.run.smithi135.stdout:(78/157): python3-devel-3.9.19-8.el9.x86_64.rpm 1.4 MB/s | 245 kB 00:00 2024-09-16T15:35:04.700 INFO:teuthology.orchestra.run.smithi135.stdout:(79/157): python3-jinja2-2.11.3-6.el9.noarch.rp 1.5 MB/s | 248 kB 00:00 2024-09-16T15:35:04.717 INFO:teuthology.orchestra.run.smithi135.stdout:(80/157): python3-jsonpatch-1.21-16.el9.noarch. 382 kB/s | 26 kB 00:00 2024-09-16T15:35:04.734 INFO:teuthology.orchestra.run.smithi135.stdout:(81/157): python3-jsonpointer-2.0-4.el9.noarch. 325 kB/s | 19 kB 00:00 2024-09-16T15:35:04.784 INFO:teuthology.orchestra.run.smithi135.stdout:(82/157): python3-mako-1.1.4-6.el9.noarch.rpm 2.0 MB/s | 172 kB 00:00 2024-09-16T15:35:04.801 INFO:teuthology.orchestra.run.smithi135.stdout:(83/157): python3-markupsafe-1.1.1-12.el9.x86_6 414 kB/s | 35 kB 00:00 2024-09-16T15:35:04.860 INFO:teuthology.orchestra.run.smithi135.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.3 MB/s | 250 kB 00:00 2024-09-16T15:35:04.885 INFO:teuthology.orchestra.run.smithi135.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 2.6 MB/s | 222 kB 00:00 2024-09-16T15:35:04.943 INFO:teuthology.orchestra.run.smithi135.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 927 kB/s | 77 kB 00:00 2024-09-16T15:35:04.969 INFO:teuthology.orchestra.run.smithi135.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 505 kB/s | 42 kB 00:00 2024-09-16T15:35:05.036 INFO:teuthology.orchestra.run.smithi135.stdout:(88/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 17 MB/s | 5.1 MB 00:00 2024-09-16T15:35:05.061 INFO:teuthology.orchestra.run.smithi135.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 159 kB 00:00 2024-09-16T15:35:05.086 INFO:teuthology.orchestra.run.smithi135.stdout:(90/157): python3-protobuf-3.14.0-13.el9.noarch 1.8 MB/s | 269 kB 00:00 2024-09-16T15:35:05.088 INFO:teuthology.orchestra.run.smithi098.stdout:(36/157): ceph-test-19.3.0-4938.g33f95d2a.el9.x 13 MB/s | 46 MB 00:03 2024-09-16T15:35:05.122 INFO:teuthology.orchestra.run.smithi098.stdout:(37/157): ceph-volume-19.3.0-4938.g33f95d2a.el9 569 kB/s | 285 kB 00:00 2024-09-16T15:35:05.128 INFO:teuthology.orchestra.run.smithi135.stdout:(91/157): python3-pyasn1-modules-0.4.8-6.el9.no 3.0 MB/s | 279 kB 00:00 2024-09-16T15:35:05.153 INFO:teuthology.orchestra.run.smithi135.stdout:(92/157): python3-pytz-2021.1-5.el9.noarch.rpm 553 kB/s | 51 kB 00:00 2024-09-16T15:35:05.156 INFO:teuthology.orchestra.run.smithi098.stdout:(38/157): cephadm-19.3.0-4938.g33f95d2a.el9.noa 1.5 MB/s | 784 kB 00:00 2024-09-16T15:35:05.179 INFO:teuthology.orchestra.run.smithi135.stdout:(93/157): python3-requests-oauthlib-1.3.0-12.el 583 kB/s | 54 kB 00:00 2024-09-16T15:35:05.181 INFO:teuthology.orchestra.run.smithi098.stdout:(39/157): cephfs-top-19.3.0-4938.g33f95d2a.el9. 198 kB/s | 18 kB 00:00 2024-09-16T15:35:05.246 INFO:teuthology.orchestra.run.smithi135.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 624 kB/s | 42 kB 00:00 2024-09-16T15:35:05.271 INFO:teuthology.orchestra.run.smithi135.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 480 kB/s | 44 kB 00:00 2024-09-16T15:35:05.298 INFO:teuthology.orchestra.run.smithi098.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 455 kB/s | 80 kB 00:00 2024-09-16T15:35:05.313 INFO:teuthology.orchestra.run.smithi135.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 3.2 MB/s | 221 kB 00:00 2024-09-16T15:35:05.338 INFO:teuthology.orchestra.run.smithi135.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 537 kB/s | 36 kB 00:00 2024-09-16T15:35:05.373 INFO:teuthology.orchestra.run.smithi098.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 995 kB/s | 191 kB 00:00 2024-09-16T15:35:05.380 INFO:teuthology.orchestra.run.smithi135.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 710 kB/s | 47 kB 00:00 2024-09-16T15:35:05.414 INFO:teuthology.orchestra.run.smithi135.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 3.9 MB/s | 304 kB 00:00 2024-09-16T15:35:05.432 INFO:teuthology.orchestra.run.smithi098.stdout:(42/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.9 MB/s | 253 kB 00:00 2024-09-16T15:35:05.456 INFO:teuthology.orchestra.run.smithi135.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 769 kB/s | 58 kB 00:00 2024-09-16T15:35:05.457 INFO:teuthology.orchestra.run.smithi098.stdout:(43/157): libgfortran-11.5.0-2.el9.x86_64.rpm 2.6 MB/s | 801 kB 00:00 2024-09-16T15:35:05.481 INFO:teuthology.orchestra.run.smithi135.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.4 MB/s | 96 kB 00:00 2024-09-16T15:35:05.491 INFO:teuthology.orchestra.run.smithi098.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-16T15:35:05.516 INFO:teuthology.orchestra.run.smithi098.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 2.2 MB/s | 135 kB 00:00 2024-09-16T15:35:05.523 INFO:teuthology.orchestra.run.smithi135.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 952 kB/s | 64 kB 00:00 2024-09-16T15:35:05.548 INFO:teuthology.orchestra.run.smithi135.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 669 kB/s | 45 kB 00:00 2024-09-16T15:35:05.549 INFO:teuthology.orchestra.run.smithi098.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-09-16T15:35:05.575 INFO:teuthology.orchestra.run.smithi098.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-09-16T15:35:05.617 INFO:teuthology.orchestra.run.smithi098.stdout:(48/157): python3-cryptography-36.0.1-4.el9.x86 5.0 MB/s | 1.2 MB 00:00 2024-09-16T15:35:05.792 INFO:teuthology.orchestra.run.smithi135.stdout:(104/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 25 MB/s | 16 MB 00:00 2024-09-16T15:35:05.907 INFO:teuthology.orchestra.run.smithi135.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 4.6 MB/s | 548 kB 00:00 2024-09-16T15:35:05.958 INFO:teuthology.orchestra.run.smithi135.stdout:(106/157): gperftools-libs-2.9.1-3.el9.x86_64.r 6.0 MB/s | 308 kB 00:00 2024-09-16T15:35:05.991 INFO:teuthology.orchestra.run.smithi135.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 611 kB/s | 19 kB 00:00 2024-09-16T15:35:06.167 INFO:teuthology.orchestra.run.smithi098.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 194 kB/s | 107 kB 00:00 2024-09-16T15:35:06.200 INFO:teuthology.orchestra.run.smithi135.stdout:(108/157): lua-devel-5.4.4-4.el9.x86_64.rpm 33 kB/s | 22 kB 00:00 2024-09-16T15:35:06.258 INFO:teuthology.orchestra.run.smithi135.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 446 kB/s | 26 kB 00:00 2024-09-16T15:35:06.276 INFO:teuthology.orchestra.run.smithi098.stdout:(50/157): elfutils-libelf-devel-0.191-4.el9.x86 200 kB/s | 22 kB 00:00 2024-09-16T15:35:06.292 INFO:teuthology.orchestra.run.smithi135.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.4 MB/s | 49 kB 00:00 2024-09-16T15:35:06.301 INFO:teuthology.orchestra.run.smithi098.stdout:(51/157): automake-1.16.2-8.el9.noarch.rpm 917 kB/s | 689 kB 00:00 2024-09-16T15:35:06.334 INFO:teuthology.orchestra.run.smithi135.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2024-09-16T15:35:06.376 INFO:teuthology.orchestra.run.smithi135.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 3.6 MB/s | 151 kB 00:00 2024-09-16T15:35:06.401 INFO:teuthology.orchestra.run.smithi098.stdout:(52/157): bison-3.7.4-5.el9.x86_64.rpm 1.1 MB/s | 943 kB 00:00 2024-09-16T15:35:06.426 INFO:teuthology.orchestra.run.smithi098.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 261 kB/s | 33 kB 00:00 2024-09-16T15:35:06.509 INFO:teuthology.orchestra.run.smithi135.stdout:(113/157): libarrow-9.0.0-11.el9.x86_64.rpm 8.5 MB/s | 4.4 MB 00:00 2024-09-16T15:35:06.535 INFO:teuthology.orchestra.run.smithi098.stdout:(54/157): flexiblas-openblas-openmp-3.0.4-8.el9 168 kB/s | 18 kB 00:00 2024-09-16T15:35:06.551 INFO:teuthology.orchestra.run.smithi135.stdout:(114/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 4.7 MB/s | 839 kB 00:00 2024-09-16T15:35:06.585 INFO:teuthology.orchestra.run.smithi135.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.3 MB/s | 43 kB 00:00 2024-09-16T15:35:06.619 INFO:teuthology.orchestra.run.smithi135.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 965 kB/s | 32 kB 00:00 2024-09-16T15:35:06.644 INFO:teuthology.orchestra.run.smithi098.stdout:(55/157): libaio-devel-0.3.111-13.el9.x86_64.rp 103 kB/s | 11 kB 00:00 2024-09-16T15:35:06.652 INFO:teuthology.orchestra.run.smithi135.stdout:(117/157): protobuf-compiler-3.14.0-13.el9.x86_ 782 kB/s | 863 kB 00:01 2024-09-16T15:35:06.669 INFO:teuthology.orchestra.run.smithi098.stdout:(56/157): flex-2.6.4-9.el9.x86_64.rpm 798 kB/s | 313 kB 00:00 2024-09-16T15:35:06.686 INFO:teuthology.orchestra.run.smithi135.stdout:(118/157): python3-asyncssh-2.13.2-5.el9.noarch 3.0 MB/s | 548 kB 00:00 2024-09-16T15:35:06.711 INFO:teuthology.orchestra.run.smithi135.stdout:(119/157): python3-certifi-2023.05.07-4.el9.noa 153 kB/s | 14 kB 00:00 2024-09-16T15:35:06.736 INFO:teuthology.orchestra.run.smithi135.stdout:(120/157): python3-cheroot-8.6.0-4.el9.noarch.r 2.0 MB/s | 172 kB 00:00 2024-09-16T15:35:06.769 INFO:teuthology.orchestra.run.smithi098.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 1.3 MB/s | 171 kB 00:00 2024-09-16T15:35:06.770 INFO:teuthology.orchestra.run.smithi135.stdout:(121/157): python3-cherrypy-18.6.1-2.el9.noarch 4.2 MB/s | 358 kB 00:00 2024-09-16T15:35:06.795 INFO:teuthology.orchestra.run.smithi098.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.2 MB/s | 160 kB 00:00 2024-09-16T15:35:06.803 INFO:teuthology.orchestra.run.smithi135.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 3.6 MB/s | 220 kB 00:00 2024-09-16T15:35:06.845 INFO:teuthology.orchestra.run.smithi098.stdout:(59/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 6.7 MB/s | 3.0 MB 00:00 2024-09-16T15:35:06.854 INFO:teuthology.orchestra.run.smithi135.stdout:(123/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.1 MB/s | 303 kB 00:00 2024-09-16T15:35:06.878 INFO:teuthology.orchestra.run.smithi098.stdout:(60/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 416 kB/s | 45 kB 00:00 2024-09-16T15:35:06.879 INFO:teuthology.orchestra.run.smithi135.stdout:(124/157): python3-grpcio-tools-1.46.7-10.el9.x 1.9 MB/s | 144 kB 00:00 2024-09-16T15:35:06.896 INFO:teuthology.orchestra.run.smithi135.stdout:(125/157): python3-jaraco-8.2.1-3.el9.noarch.rp 255 kB/s | 11 kB 00:00 2024-09-16T15:35:06.913 INFO:teuthology.orchestra.run.smithi135.stdout:(126/157): python3-jaraco-classes-3.2.1-5.el9.n 529 kB/s | 18 kB 00:00 2024-09-16T15:35:06.930 INFO:teuthology.orchestra.run.smithi135.stdout:(127/157): python3-jaraco-collections-3.0.0-8.e 695 kB/s | 23 kB 00:00 2024-09-16T15:35:06.947 INFO:teuthology.orchestra.run.smithi135.stdout:(128/157): python3-jaraco-functools-3.5.0-2.el9 580 kB/s | 19 kB 00:00 2024-09-16T15:35:06.962 INFO:teuthology.orchestra.run.smithi098.stdout:(61/157): libtool-2.4.6-46.el9.x86_64.rpm 4.8 MB/s | 581 kB 00:00 2024-09-16T15:35:06.964 INFO:teuthology.orchestra.run.smithi135.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 585 kB/s | 20 kB 00:00 2024-09-16T15:35:06.987 INFO:teuthology.orchestra.run.smithi098.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 225 kB/s | 24 kB 00:00 2024-09-16T15:35:07.023 INFO:teuthology.orchestra.run.smithi135.stdout:(130/157): python3-grpcio-1.46.7-10.el9.x86_64. 8.1 MB/s | 2.0 MB 00:00 2024-09-16T15:35:07.040 INFO:teuthology.orchestra.run.smithi135.stdout:(131/157): python3-logutils-0.3.5-21.el9.noarch 616 kB/s | 46 kB 00:00 2024-09-16T15:35:07.065 INFO:teuthology.orchestra.run.smithi135.stdout:(132/157): python3-more-itertools-8.12.0-2.el9. 1.8 MB/s | 79 kB 00:00 2024-09-16T15:35:07.071 INFO:teuthology.orchestra.run.smithi098.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 437 kB/s | 47 kB 00:00 2024-09-16T15:35:07.082 INFO:teuthology.orchestra.run.smithi135.stdout:(133/157): python3-natsort-7.1.1-5.el9.noarch.r 1.3 MB/s | 58 kB 00:00 2024-09-16T15:35:07.104 INFO:teuthology.orchestra.run.smithi098.stdout:(64/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-09-16T15:35:07.115 INFO:teuthology.orchestra.run.smithi135.stdout:(134/157): python3-kubernetes-26.1.0-2.el9.noar 6.1 MB/s | 1.0 MB 00:00 2024-09-16T15:35:07.132 INFO:teuthology.orchestra.run.smithi135.stdout:(135/157): python3-portend-3.1.0-2.el9.noarch.r 327 kB/s | 16 kB 00:00 2024-09-16T15:35:07.138 INFO:teuthology.orchestra.run.smithi098.stdout:(65/157): librdkafka-1.6.1-102.el9.x86_64.rpm 1.9 MB/s | 662 kB 00:00 2024-09-16T15:35:07.158 INFO:teuthology.orchestra.run.smithi135.stdout:(136/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 2.1 MB/s | 90 kB 00:00 2024-09-16T15:35:07.180 INFO:teuthology.orchestra.run.smithi098.stdout:(66/157): lua-5.4.4-4.el9.x86_64.rpm 1.7 MB/s | 188 kB 00:00 2024-09-16T15:35:07.183 INFO:teuthology.orchestra.run.smithi135.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 562 kB/s | 28 kB 00:00 2024-09-16T15:35:07.208 INFO:teuthology.orchestra.run.smithi135.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 614 kB/s | 31 kB 00:00 2024-09-16T15:35:07.214 INFO:teuthology.orchestra.run.smithi098.stdout:(67/157): openblas-0.3.26-2.el9.x86_64.rpm 353 kB/s | 38 kB 00:00 2024-09-16T15:35:07.233 INFO:teuthology.orchestra.run.smithi135.stdout:(139/157): python3-pecan-1.4.2-3.el9.noarch.rpm 1.6 MB/s | 272 kB 00:00 2024-09-16T15:35:07.268 INFO:teuthology.orchestra.run.smithi135.stdout:(140/157): python3-rsa-4.9-2.el9.noarch.rpm 998 kB/s | 59 kB 00:00 2024-09-16T15:35:07.293 INFO:teuthology.orchestra.run.smithi135.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 604 kB/s | 36 kB 00:00 2024-09-16T15:35:07.318 INFO:teuthology.orchestra.run.smithi135.stdout:(142/157): python3-routes-2.5.1-5.el9.noarch.rp 1.4 MB/s | 188 kB 00:00 2024-09-16T15:35:07.345 INFO:teuthology.orchestra.run.smithi135.stdout:(143/157): python3-typing-extensions-4.12.2-2.e 989 kB/s | 74 kB 00:00 2024-09-16T15:35:07.369 INFO:teuthology.orchestra.run.smithi135.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-16T15:35:07.394 INFO:teuthology.orchestra.run.smithi135.stdout:(145/157): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-16T15:35:07.419 INFO:teuthology.orchestra.run.smithi135.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 397 kB/s | 20 kB 00:00 2024-09-16T15:35:07.453 INFO:teuthology.orchestra.run.smithi135.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-16T15:35:07.503 INFO:teuthology.orchestra.run.smithi135.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 2.6 MB/s | 427 kB 00:00 2024-09-16T15:35:07.523 INFO:teuthology.orchestra.run.smithi098.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 5.1 MB/s | 1.6 MB 00:00 2024-09-16T15:35:07.620 INFO:teuthology.orchestra.run.smithi135.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 7.9 MB/s | 1.6 MB 00:00 2024-09-16T15:35:07.656 INFO:teuthology.orchestra.run.smithi098.stdout:(69/157): postgresql-contrib-13.16-1.el9.x86_64 6.7 MB/s | 910 kB 00:00 2024-09-16T15:35:07.782 INFO:teuthology.orchestra.run.smithi098.stdout:(70/157): postgresql-private-libs-13.16-1.el9.x 1.1 MB/s | 137 kB 00:00 2024-09-16T15:35:07.904 INFO:teuthology.orchestra.run.smithi135.stdout:(150/157): NetworkManager-1.49.90-1.el9.x86_64. 8.2 MB/s | 2.3 MB 00:00 2024-09-16T15:35:08.004 INFO:teuthology.orchestra.run.smithi135.stdout:(151/157): NetworkManager-libnm-1.49.90-1.el9.x 18 MB/s | 1.8 MB 00:00 2024-09-16T15:35:08.054 INFO:teuthology.orchestra.run.smithi135.stdout:(152/157): NetworkManager-team-1.49.90-1.el9.x8 816 kB/s | 41 kB 00:00 2024-09-16T15:35:08.122 INFO:teuthology.orchestra.run.smithi135.stdout:(153/157): NetworkManager-tui-1.49.90-1.el9.x86 3.6 MB/s | 249 kB 00:00 2024-09-16T15:35:08.205 INFO:teuthology.orchestra.run.smithi135.stdout:(154/157): openssl-3.2.2-6.el9.x86_64.rpm 16 MB/s | 1.4 MB 00:00 2024-09-16T15:35:08.322 INFO:teuthology.orchestra.run.smithi135.stdout:(155/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 20 MB/s | 2.4 MB 00:00 2024-09-16T15:35:08.439 INFO:teuthology.orchestra.run.smithi135.stdout:(156/157): librados2-19.3.0-4938.g33f95d2a.el9. 3.5 MB/s | 3.5 MB 00:00 2024-09-16T15:35:08.990 INFO:teuthology.orchestra.run.smithi098.stdout:(71/157): openblas-openmp-0.3.26-2.el9.x86_64.r 2.7 MB/s | 4.9 MB 00:01 2024-09-16T15:35:10.297 INFO:teuthology.orchestra.run.smithi135.stdout:(157/157): librbd1-19.3.0-4938.g33f95d2a.el9.x8 1.2 MB/s | 3.2 MB 00:02 2024-09-16T15:35:10.304 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-09-16T15:35:10.305 INFO:teuthology.orchestra.run.smithi135.stdout:Total 18 MB/s | 235 MB 00:13 2024-09-16T15:35:10.565 INFO:teuthology.orchestra.run.smithi098.stdout:(72/157): protobuf-3.14.0-13.el9.x86_64.rpm 656 kB/s | 1.0 MB 00:01 2024-09-16T15:35:10.757 INFO:teuthology.orchestra.run.smithi098.stdout:(73/157): python3-attrs-20.3.0-7.el9.noarch.rpm 456 kB/s | 87 kB 00:00 2024-09-16T15:35:10.967 INFO:teuthology.orchestra.run.smithi098.stdout:(74/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 1.2 MB/s | 4.4 MB 00:03 2024-09-16T15:35:11.083 INFO:teuthology.orchestra.run.smithi098.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 525 kB/s | 61 kB 00:00 2024-09-16T15:35:11.458 INFO:teuthology.orchestra.run.smithi098.stdout:(76/157): python3-devel-3.9.19-8.el9.x86_64.rpm 653 kB/s | 245 kB 00:00 2024-09-16T15:35:11.565 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-09-16T15:35:11.720 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-09-16T15:35:11.720 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-09-16T15:35:11.825 INFO:teuthology.orchestra.run.smithi098.stdout:(77/157): python3-jinja2-2.11.3-6.el9.noarch.rp 677 kB/s | 248 kB 00:00 2024-09-16T15:35:11.933 INFO:teuthology.orchestra.run.smithi098.stdout:(78/157): python3-jsonpatch-1.21-16.el9.noarch. 237 kB/s | 26 kB 00:00 2024-09-16T15:35:12.042 INFO:teuthology.orchestra.run.smithi098.stdout:(79/157): python3-jsonpointer-2.0-4.el9.noarch. 177 kB/s | 19 kB 00:00 2024-09-16T15:35:12.334 INFO:teuthology.orchestra.run.smithi098.stdout:(80/157): python3-mako-1.1.4-6.el9.noarch.rpm 590 kB/s | 172 kB 00:00 2024-09-16T15:35:12.451 INFO:teuthology.orchestra.run.smithi098.stdout:(81/157): python3-markupsafe-1.1.1-12.el9.x86_6 297 kB/s | 35 kB 00:00 2024-09-16T15:35:14.015 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-09-16T15:35:14.016 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-09-16T15:35:14.017 INFO:teuthology.orchestra.run.smithi098.stdout:(82/157): postgresql-server-13.16-1.el9.x86_64. 948 kB/s | 5.8 MB 00:06 2024-09-16T15:35:14.393 INFO:teuthology.orchestra.run.smithi098.stdout:(83/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 669 kB/s | 250 kB 00:00 2024-09-16T15:35:14.776 INFO:teuthology.orchestra.run.smithi098.stdout:(84/157): python3-oauthlib-3.1.1-5.el9.noarch.r 580 kB/s | 222 kB 00:00 2024-09-16T15:35:14.969 INFO:teuthology.orchestra.run.smithi098.stdout:(85/157): python3-packaging-20.9-5.el9.noarch.r 402 kB/s | 77 kB 00:00 2024-09-16T15:35:15.077 INFO:teuthology.orchestra.run.smithi098.stdout:(86/157): python3-prettytable-0.7.2-27.el9.noar 390 kB/s | 42 kB 00:00 2024-09-16T15:35:15.544 INFO:teuthology.orchestra.run.smithi098.stdout:(87/157): python3-protobuf-3.14.0-13.el9.noarch 577 kB/s | 269 kB 00:00 2024-09-16T15:35:15.828 INFO:teuthology.orchestra.run.smithi098.stdout:(88/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 560 kB/s | 159 kB 00:00 2024-09-16T15:35:16.286 INFO:teuthology.orchestra.run.smithi098.stdout:(89/157): python3-pyasn1-modules-0.4.8-6.el9.no 608 kB/s | 279 kB 00:00 2024-09-16T15:35:16.395 INFO:teuthology.orchestra.run.smithi098.stdout:(90/157): python3-pytz-2021.1-5.el9.noarch.rpm 471 kB/s | 51 kB 00:00 2024-09-16T15:35:16.503 INFO:teuthology.orchestra.run.smithi098.stdout:(91/157): python3-requests-oauthlib-1.3.0-12.el 495 kB/s | 54 kB 00:00 2024-09-16T15:35:19.837 INFO:teuthology.orchestra.run.smithi098.stdout:(92/157): python3-babel-2.9.1-2.el9.noarch.rpm 672 kB/s | 6.0 MB 00:09 2024-09-16T15:35:19.904 INFO:teuthology.orchestra.run.smithi098.stdout:(93/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 700 kB/s | 5.1 MB 00:07 2024-09-16T15:35:19.937 INFO:teuthology.orchestra.run.smithi098.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 417 kB/s | 42 kB 00:00 2024-09-16T15:35:20.012 INFO:teuthology.orchestra.run.smithi098.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 407 kB/s | 44 kB 00:00 2024-09-16T15:35:20.121 INFO:teuthology.orchestra.run.smithi098.stdout:(96/157): qatlib-service-24.02.0-1.el9.x86_64.r 331 kB/s | 36 kB 00:00 2024-09-16T15:35:20.222 INFO:teuthology.orchestra.run.smithi098.stdout:(97/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 474 kB/s | 47 kB 00:00 2024-09-16T15:35:20.330 INFO:teuthology.orchestra.run.smithi098.stdout:(98/157): qatlib-24.02.0-1.el9.x86_64.rpm 562 kB/s | 221 kB 00:00 2024-09-16T15:35:20.447 INFO:teuthology.orchestra.run.smithi098.stdout:(99/157): uuid-1.6.2-55.el9.x86_64.rpm 495 kB/s | 58 kB 00:00 2024-09-16T15:35:20.571 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-09-16T15:35:20.656 INFO:teuthology.orchestra.run.smithi098.stdout:(100/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 460 kB/s | 96 kB 00:00 2024-09-16T15:35:20.681 INFO:teuthology.orchestra.run.smithi098.stdout:(101/157): socat-1.7.4.1-6.el9.x86_64.rpm 662 kB/s | 304 kB 00:00 2024-09-16T15:35:20.685 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-16T15:35:20.787 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-16T15:35:20.789 INFO:teuthology.orchestra.run.smithi098.stdout:(102/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 413 kB/s | 45 kB 00:00 2024-09-16T15:35:20.856 INFO:teuthology.orchestra.run.smithi098.stdout:(103/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 317 kB/s | 64 kB 00:00 2024-09-16T15:35:20.898 INFO:teuthology.orchestra.run.smithi098.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 205 kB/s | 22 kB 00:00 2024-09-16T15:35:20.991 INFO:teuthology.orchestra.run.smithi098.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 5.8 MB/s | 548 kB 00:00 2024-09-16T15:35:21.032 INFO:teuthology.orchestra.run.smithi098.stdout:(106/157): gperftools-libs-2.9.1-3.el9.x86_64.r 7.2 MB/s | 308 kB 00:00 2024-09-16T15:35:21.036 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-16T15:35:21.058 INFO:teuthology.orchestra.run.smithi098.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 779 kB/s | 19 kB 00:00 2024-09-16T15:35:21.077 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-16T15:35:21.102 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-16T15:35:21.163 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-16T15:35:21.275 INFO:teuthology.orchestra.run.smithi098.stdout:(108/157): libarrow-9.0.0-11.el9.x86_64.rpm 20 MB/s | 4.4 MB 00:00 2024-09-16T15:35:21.300 INFO:teuthology.orchestra.run.smithi098.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-16T15:35:21.325 INFO:teuthology.orchestra.run.smithi098.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-16T15:35:21.350 INFO:teuthology.orchestra.run.smithi098.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-16T15:35:21.376 INFO:teuthology.orchestra.run.smithi098.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-09-16T15:35:21.443 INFO:teuthology.orchestra.run.smithi098.stdout:(113/157): protobuf-compiler-3.14.0-13.el9.x86_ 1.4 MB/s | 863 kB 00:00 2024-09-16T15:35:21.485 INFO:teuthology.orchestra.run.smithi098.stdout:(114/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.5 MB/s | 839 kB 00:00 2024-09-16T15:35:21.504 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-16T15:35:21.510 INFO:teuthology.orchestra.run.smithi098.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.8 MB/s | 43 kB 00:00 2024-09-16T15:35:21.535 INFO:teuthology.orchestra.run.smithi098.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-16T15:35:21.560 INFO:teuthology.orchestra.run.smithi098.stdout:(117/157): python3-certifi-2023.05.07-4.el9.noa 566 kB/s | 14 kB 00:00 2024-09-16T15:35:21.586 INFO:teuthology.orchestra.run.smithi098.stdout:(118/157): python3-asyncssh-2.13.2-5.el9.noarch 3.8 MB/s | 548 kB 00:00 2024-09-16T15:35:21.611 INFO:teuthology.orchestra.run.smithi098.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-16T15:35:21.628 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : librados2-2:19.3.0-4938.g33f95d2a.el9.x86_64 8/165 2024-09-16T15:35:21.636 INFO:teuthology.orchestra.run.smithi098.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-09-16T15:35:21.662 INFO:teuthology.orchestra.run.smithi098.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2024-09-16T15:35:21.687 INFO:teuthology.orchestra.run.smithi098.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-16T15:35:21.729 INFO:teuthology.orchestra.run.smithi098.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 3.4 MB/s | 144 kB 00:00 2024-09-16T15:35:21.751 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librados2-2:19.3.0-4938.g33f95d2a.el9.x86_64 8/165 2024-09-16T15:35:21.754 INFO:teuthology.orchestra.run.smithi098.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 423 kB/s | 11 kB 00:00 2024-09-16T15:35:21.779 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libcephfs2-2:19.3.0-4938.g33f95d2a.el9.x86_64 9/165 2024-09-16T15:35:21.780 INFO:teuthology.orchestra.run.smithi098.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 707 kB/s | 18 kB 00:00 2024-09-16T15:35:21.805 INFO:teuthology.orchestra.run.smithi098.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 935 kB/s | 23 kB 00:00 2024-09-16T15:35:21.830 INFO:teuthology.orchestra.run.smithi098.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 781 kB/s | 19 kB 00:00 2024-09-16T15:35:21.871 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libcephfs2-2:19.3.0-4938.g33f95d2a.el9.x86_64 9/165 2024-09-16T15:35:21.880 INFO:teuthology.orchestra.run.smithi098.stdout:(128/157): python3-grpcio-1.46.7-10.el9.x86_64. 9.3 MB/s | 2.0 MB 00:00 2024-09-16T15:35:21.905 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rados-2:19.3.0-4938.g33f95d2a.el9.x86_64 10/165 2024-09-16T15:35:21.906 INFO:teuthology.orchestra.run.smithi098.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 261 kB/s | 20 kB 00:00 2024-09-16T15:35:21.931 INFO:teuthology.orchestra.run.smithi098.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-16T15:35:21.944 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-16T15:35:21.965 INFO:teuthology.orchestra.run.smithi098.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-16T15:35:21.998 INFO:teuthology.orchestra.run.smithi098.stdout:(132/157): python3-kubernetes-26.1.0-2.el9.noar 8.7 MB/s | 1.0 MB 00:00 2024-09-16T15:35:22.024 INFO:teuthology.orchestra.run.smithi098.stdout:(133/157): python3-natsort-7.1.1-5.el9.noarch.r 984 kB/s | 58 kB 00:00 2024-09-16T15:35:22.049 INFO:teuthology.orchestra.run.smithi098.stdout:(134/157): python3-pecan-1.4.2-3.el9.noarch.rpm 5.3 MB/s | 272 kB 00:00 2024-09-16T15:35:22.074 INFO:teuthology.orchestra.run.smithi098.stdout:(135/157): python3-portend-3.1.0-2.el9.noarch.r 328 kB/s | 16 kB 00:00 2024-09-16T15:35:22.091 INFO:teuthology.orchestra.run.smithi098.stdout:(136/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 2.1 MB/s | 90 kB 00:00 2024-09-16T15:35:22.108 INFO:teuthology.orchestra.run.smithi098.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 840 kB/s | 28 kB 00:00 2024-09-16T15:35:22.122 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-16T15:35:22.125 INFO:teuthology.orchestra.run.smithi098.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 921 kB/s | 31 kB 00:00 2024-09-16T15:35:22.142 INFO:teuthology.orchestra.run.smithi098.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 3.5 MB/s | 59 kB 00:00 2024-09-16T15:35:22.167 INFO:teuthology.orchestra.run.smithi098.stdout:(140/157): python3-routes-2.5.1-5.el9.noarch.rp 3.1 MB/s | 188 kB 00:00 2024-09-16T15:35:22.181 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-16T15:35:22.184 INFO:teuthology.orchestra.run.smithi098.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 858 kB/s | 36 kB 00:00 2024-09-16T15:35:22.209 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libcephsqlite-2:19.3.0-4938.g33f95d2a.el9.x86_64 14/165 2024-09-16T15:35:22.210 INFO:teuthology.orchestra.run.smithi098.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.7 MB/s | 74 kB 00:00 2024-09-16T15:35:22.235 INFO:teuthology.orchestra.run.smithi098.stdout:(143/157): python3-webob-1.8.8-2.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2024-09-16T15:35:22.260 INFO:teuthology.orchestra.run.smithi098.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-16T15:35:22.285 INFO:teuthology.orchestra.run.smithi098.stdout:(145/157): python3-zc-lockfile-2.0-10.el9.noarc 800 kB/s | 20 kB 00:00 2024-09-16T15:35:22.297 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4938.g33f95d2a.el9.x86_64 14/165 2024-09-16T15:35:22.311 INFO:teuthology.orchestra.run.smithi098.stdout:(146/157): python3-werkzeug-2.0.3-3.el9.1.noarc 5.5 MB/s | 427 kB 00:00 2024-09-16T15:35:22.327 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libradosstriper1-2:19.3.0-4938.g33f95d2a.el9.x86 15/165 2024-09-16T15:35:22.336 INFO:teuthology.orchestra.run.smithi098.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-16T15:35:22.373 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4938.g33f95d2a.el9.x86 15/165 2024-09-16T15:35:22.394 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-16T15:35:22.420 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-16T15:35:22.486 INFO:teuthology.orchestra.run.smithi098.stdout:(148/157): thrift-0.15.0-2.el9.x86_64.rpm 9.0 MB/s | 1.6 MB 00:00 2024-09-16T15:35:22.580 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-16T15:35:22.755 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-16T15:35:22.796 INFO:teuthology.orchestra.run.smithi098.stdout:(149/157): librados2-19.3.0-4938.g33f95d2a.el9. 7.5 MB/s | 3.5 MB 00:00 2024-09-16T15:35:22.881 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 18/165 2024-09-16T15:35:22.992 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-16T15:35:23.069 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-16T15:35:23.145 INFO:teuthology.orchestra.run.smithi098.stdout:(150/157): librbd1-19.3.0-4938.g33f95d2a.el9.x8 4.9 MB/s | 3.2 MB 00:00 2024-09-16T15:35:23.297 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-16T15:35:23.408 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-16T15:35:23.441 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-16T15:35:23.475 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-16T15:35:23.529 INFO:teuthology.orchestra.run.smithi098.stdout:(151/157): NetworkManager-1.49.90-1.el9.x86_64. 3.2 MB/s | 2.3 MB 00:00 2024-09-16T15:35:23.539 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-16T15:35:23.566 INFO:teuthology.orchestra.run.smithi098.stdout:(152/157): NetworkManager-libnm-1.49.90-1.el9.x 4.3 MB/s | 1.8 MB 00:00 2024-09-16T15:35:23.588 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-16T15:35:23.591 INFO:teuthology.orchestra.run.smithi098.stdout:(153/157): NetworkManager-team-1.49.90-1.el9.x8 658 kB/s | 41 kB 00:00 2024-09-16T15:35:23.625 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-16T15:35:23.669 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-16T15:35:23.702 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-16T15:35:23.708 INFO:teuthology.orchestra.run.smithi098.stdout:(154/157): NetworkManager-tui-1.49.90-1.el9.x86 1.7 MB/s | 249 kB 00:00 2024-09-16T15:35:23.729 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-16T15:35:23.814 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-16T15:35:23.876 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-16T15:35:23.908 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-16T15:35:23.952 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-16T15:35:24.033 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-16T15:35:24.079 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-ceph-common-2:19.3.0-4938.g33f95d2a.el9. 34/165 2024-09-16T15:35:24.123 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-ceph-argparse-2:19.3.0-4938.g33f95d2a.el 35/165 2024-09-16T15:35:24.150 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cephfs-2:19.3.0-4938.g33f95d2a.el9.x86_6 36/165 2024-09-16T15:35:24.221 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-16T15:35:24.274 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-16T15:35:24.292 INFO:teuthology.orchestra.run.smithi098.stdout:(155/157): openssl-3.2.2-6.el9.x86_64.rpm 1.9 MB/s | 1.4 MB 00:00 2024-09-16T15:35:24.356 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-16T15:35:24.489 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-16T15:35:24.542 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-16T15:35:24.925 INFO:teuthology.orchestra.run.smithi098.stdout:(156/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 2.0 MB/s | 2.4 MB 00:01 2024-09-16T15:35:25.068 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-16T15:35:25.171 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-16T15:35:25.201 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-16T15:35:25.244 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-16T15:35:25.281 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librados-devel-2:19.3.0-4938.g33f95d2a.el9.x86_6 46/165 2024-09-16T15:35:25.324 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-16T15:35:25.486 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-16T15:35:25.560 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-16T15:35:25.650 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-16T15:35:25.707 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-16T15:35:25.781 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-16T15:35:25.812 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-16T15:35:25.848 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-16T15:35:25.903 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-16T15:35:25.939 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-16T15:35:25.982 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-16T15:35:26.023 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-16T15:35:26.371 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-16T15:35:26.429 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-16T15:35:26.470 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-16T15:35:26.575 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-16T15:35:26.613 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-16T15:35:26.665 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-16T15:35:26.695 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-16T15:35:26.719 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-16T15:35:26.809 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-16T15:35:26.945 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-16T15:35:26.994 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-16T15:35:27.025 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-16T15:35:27.068 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-16T15:35:27.111 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-16T15:35:27.143 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-16T15:35:27.173 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-16T15:35:27.208 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-16T15:35:27.241 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-16T15:35:27.283 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-16T15:35:27.317 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-16T15:35:27.403 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-16T15:35:27.448 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-16T15:35:27.487 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-16T15:35:27.590 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-16T15:35:27.646 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-16T15:35:28.365 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-16T15:35:28.419 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-16T15:35:28.452 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-16T15:35:28.551 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-16T15:35:28.631 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-16T15:35:28.966 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-16T15:35:29.199 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-16T15:35:29.239 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-16T15:35:29.432 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-16T15:35:29.469 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-16T15:35:29.556 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-16T15:35:30.215 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-16T15:35:30.325 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-16T15:35:31.593 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-16T15:35:31.692 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-16T15:35:31.720 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-16T15:35:31.752 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-16T15:35:32.109 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-16T15:35:32.166 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : librbd1-2:19.3.0-4938.g33f95d2a.el9.x86_64 102/165 2024-09-16T15:35:32.265 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librbd1-2:19.3.0-4938.g33f95d2a.el9.x86_64 102/165 2024-09-16T15:35:32.304 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rbd-2:19.3.0-4938.g33f95d2a.el9.x86_64 103/165 2024-09-16T15:35:32.357 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-16T15:35:32.853 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-16T15:35:32.885 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librgw2-2:19.3.0-4938.g33f95d2a.el9.x86_64 106/165 2024-09-16T15:35:32.956 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librgw2-2:19.3.0-4938.g33f95d2a.el9.x86_64 106/165 2024-09-16T15:35:32.978 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rgw-2:19.3.0-4938.g33f95d2a.el9.x86_64 107/165 2024-09-16T15:35:35.296 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-common-2:19.3.0-4938.g33f95d2a.el9.x86_64 108/165 2024-09-16T15:35:35.350 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-common-2:19.3.0-4938.g33f95d2a.el9.x86_64 108/165 2024-09-16T15:35:35.908 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-common-2:19.3.0-4938.g33f95d2a.el9.x86_64 108/165 2024-09-16T15:35:35.953 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-base-2:19.3.0-4938.g33f95d2a.el9.x86_64 109/165 2024-09-16T15:35:36.051 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-base-2:19.3.0-4938.g33f95d2a.el9.x86_64 109/165 2024-09-16T15:35:36.051 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-16T15:35:36.051 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-16T15:35:36.051 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-16T15:35:36.105 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-selinux-2:19.3.0-4938.g33f95d2a.el9.x86_64 110/165 2024-09-16T15:35:36.825 INFO:teuthology.orchestra.run.smithi098.stdout:(157/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 819 kB/s | 16 MB 00:20 2024-09-16T15:35:36.829 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-16T15:35:36.829 INFO:teuthology.orchestra.run.smithi098.stdout:Total 6.2 MB/s | 235 MB 00:38 2024-09-16T15:35:38.028 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-16T15:35:38.179 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-16T15:35:38.179 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-16T15:35:40.539 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-16T15:35:40.540 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-16T15:35:46.927 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-16T15:35:47.046 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-16T15:35:47.089 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-16T15:35:47.161 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-16T15:35:47.196 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-16T15:35:47.222 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-16T15:35:47.272 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-16T15:35:47.648 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-16T15:35:47.723 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : librados2-2:19.3.0-4938.g33f95d2a.el9.x86_64 8/165 2024-09-16T15:35:47.845 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librados2-2:19.3.0-4938.g33f95d2a.el9.x86_64 8/165 2024-09-16T15:35:47.874 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libcephfs2-2:19.3.0-4938.g33f95d2a.el9.x86_64 9/165 2024-09-16T15:35:47.965 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libcephfs2-2:19.3.0-4938.g33f95d2a.el9.x86_64 9/165 2024-09-16T15:35:47.995 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-rados-2:19.3.0-4938.g33f95d2a.el9.x86_64 10/165 2024-09-16T15:35:48.025 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-16T15:35:48.195 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-16T15:35:48.246 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4938.g33f95d2a.el9.x86_64 110/165 2024-09-16T15:35:48.246 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /sys 2024-09-16T15:35:48.246 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /proc 2024-09-16T15:35:48.246 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /mnt 2024-09-16T15:35:48.246 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /var/tmp 2024-09-16T15:35:48.246 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /home 2024-09-16T15:35:48.246 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /root 2024-09-16T15:35:48.246 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /tmp 2024-09-16T15:35:48.246 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-16T15:35:48.251 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-16T15:35:48.279 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libcephsqlite-2:19.3.0-4938.g33f95d2a.el9.x86_64 14/165 2024-09-16T15:35:48.366 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4938.g33f95d2a.el9.x86_64 14/165 2024-09-16T15:35:48.405 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libradosstriper1-2:19.3.0-4938.g33f95d2a.el9.x86 15/165 2024-09-16T15:35:48.414 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-volume-2:19.3.0-4938.g33f95d2a.el9.noarch 111/165 2024-09-16T15:35:48.431 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-volume-2:19.3.0-4938.g33f95d2a.el9.noarch 111/165 2024-09-16T15:35:48.431 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T15:35:48.431 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-16T15:35:48.431 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-16T15:35:48.451 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4938.g33f95d2a.el9.x86 15/165 2024-09-16T15:35:48.473 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-16T15:35:48.496 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-16T15:35:48.683 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-16T15:35:48.854 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-16T15:35:48.972 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 18/165 2024-09-16T15:35:49.077 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-16T15:35:49.165 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-16T15:35:49.387 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-16T15:35:49.494 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-16T15:35:49.528 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-16T15:35:49.561 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-16T15:35:49.626 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-16T15:35:49.671 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-16T15:35:49.704 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-16T15:35:49.747 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-16T15:35:49.788 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-16T15:35:49.824 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-16T15:35:49.891 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-16T15:35:49.946 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-16T15:35:49.950 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-osd-2:19.3.0-4938.g33f95d2a.el9.x86_64 112/165 2024-09-16T15:35:49.978 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-16T15:35:49.978 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-osd-2:19.3.0-4938.g33f95d2a.el9.x86_64 112/165 2024-09-16T15:35:49.978 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T15:35:49.979 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-16T15:35:49.979 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-16T15:35:49.979 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-16T15:35:49.979 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-16T15:35:50.021 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-16T15:35:50.100 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-16T15:35:50.132 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-ceph-common-2:19.3.0-4938.g33f95d2a.el9. 34/165 2024-09-16T15:35:50.175 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-ceph-argparse-2:19.3.0-4938.g33f95d2a.el 35/165 2024-09-16T15:35:50.204 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cephfs-2:19.3.0-4938.g33f95d2a.el9.x86_6 36/165 2024-09-16T15:35:50.219 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mds-2:19.3.0-4938.g33f95d2a.el9.x86_64 113/165 2024-09-16T15:35:50.244 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mds-2:19.3.0-4938.g33f95d2a.el9.x86_64 113/165 2024-09-16T15:35:50.244 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T15:35:50.244 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-16T15:35:50.244 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-16T15:35:50.244 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-16T15:35:50.244 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-16T15:35:50.272 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-16T15:35:50.327 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-16T15:35:50.409 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-16T15:35:50.541 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-16T15:35:50.596 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-16T15:35:50.695 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mon-2:19.3.0-4938.g33f95d2a.el9.x86_64 114/165 2024-09-16T15:35:50.719 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mon-2:19.3.0-4938.g33f95d2a.el9.x86_64 114/165 2024-09-16T15:35:50.719 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T15:35:50.719 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-16T15:35:50.719 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-16T15:35:50.719 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-16T15:35:50.719 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-16T15:35:50.825 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-16T15:35:50.881 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-16T15:35:50.945 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-16T15:35:51.107 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-16T15:35:51.130 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-16T15:35:51.179 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-16T15:35:51.256 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-16T15:35:51.283 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-16T15:35:51.313 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-16T15:35:51.345 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-16T15:35:51.356 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-16T15:35:51.394 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : librados-devel-2:19.3.0-4938.g33f95d2a.el9.x86_6 46/165 2024-09-16T15:35:51.436 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-16T15:35:51.493 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-16T15:35:51.547 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-16T15:35:51.577 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-16T15:35:51.606 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-16T15:35:51.611 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-16T15:35:51.672 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-16T15:35:51.770 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-16T15:35:51.828 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-16T15:35:51.900 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-16T15:35:51.933 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-16T15:35:51.981 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-16T15:35:52.032 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-16T15:35:52.077 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-16T15:35:52.078 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: cephadm-2:19.3.0-4938.g33f95d2a.el9.noarch 126/165 2024-09-16T15:35:52.113 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : cephadm-2:19.3.0-4938.g33f95d2a.el9.noarch 126/165 2024-09-16T15:35:52.137 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-16T15:35:52.145 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4938.g33f95d2a.e 127/165 2024-09-16T15:35:52.187 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-16T15:35:52.210 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4938.g33f95d2a. 128/165 2024-09-16T15:35:52.236 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4938.g33f95d2a.el9.noa 129/165 2024-09-16T15:35:52.320 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-16T15:35:52.364 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-16T15:35:52.405 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-16T15:35:52.506 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-16T15:35:52.549 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-16T15:35:52.589 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-16T15:35:52.625 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-16T15:35:52.667 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-16T15:35:52.772 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-16T15:35:52.902 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-16T15:35:52.950 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-16T15:35:52.978 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-16T15:35:53.019 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-16T15:35:53.059 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-16T15:35:53.091 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-16T15:35:53.121 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-16T15:35:53.155 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-16T15:35:53.189 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-16T15:35:53.230 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-16T15:35:53.265 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-16T15:35:53.350 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-16T15:35:53.403 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-16T15:35:53.435 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-16T15:35:53.536 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-16T15:35:53.586 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-16T15:35:54.296 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-16T15:35:54.347 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-16T15:35:54.381 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-16T15:35:54.477 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-16T15:35:54.535 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-16T15:35:54.580 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-16T15:35:54.658 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-16T15:35:54.692 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-16T15:35:54.874 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-16T15:35:54.898 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-16T15:35:54.975 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-16T15:35:55.391 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4938.g33f95d2a.el9.noa 129/165 2024-09-16T15:35:55.450 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4938.g33f95d2a.el9.n 130/165 2024-09-16T15:35:55.623 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-16T15:35:55.738 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-16T15:35:56.408 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4938.g33f95d2a.el9.n 130/165 2024-09-16T15:35:56.442 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4938.g33f 131/165 2024-09-16T15:35:56.555 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4938.g33f 131/165 2024-09-16T15:35:56.711 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4938.g33f95d2a.el 132/165 2024-09-16T15:35:56.744 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-2:19.3.0-4938.g33f95d2a.el9.x86_64 133/165 2024-09-16T15:35:56.768 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4938.g33f95d2a.el9.x86_64 133/165 2024-09-16T15:35:56.769 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T15:35:56.769 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-16T15:35:56.769 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-16T15:35:56.769 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-16T15:35:56.769 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-16T15:35:56.819 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-rook-2:19.3.0-4938.g33f95d2a.el9.noarch 134/165 2024-09-16T15:35:56.832 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4938.g33f95d2a.el9.noarch 134/165 2024-09-16T15:35:56.929 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-2:19.3.0-4938.g33f95d2a.el9.x86_64 135/165 2024-09-16T15:35:56.973 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-16T15:35:56.991 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-fuse-2:19.3.0-4938.g33f95d2a.el9.x86_64 136/165 2024-09-16T15:35:57.061 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-16T15:35:57.089 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-16T15:35:57.122 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-16T15:35:57.441 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-16T15:35:57.485 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : librbd1-2:19.3.0-4938.g33f95d2a.el9.x86_64 102/165 2024-09-16T15:35:57.568 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librbd1-2:19.3.0-4938.g33f95d2a.el9.x86_64 102/165 2024-09-16T15:35:57.598 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-rbd-2:19.3.0-4938.g33f95d2a.el9.x86_64 103/165 2024-09-16T15:35:57.639 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-16T15:35:57.941 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-16T15:35:57.972 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-radosgw-2:19.3.0-4938.g33f95d2a.el9.x86_64 138/165 2024-09-16T15:35:57.997 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4938.g33f95d2a.el9.x86_64 138/165 2024-09-16T15:35:57.997 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T15:35:57.997 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-16T15:35:57.997 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-16T15:35:57.997 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-16T15:35:57.997 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-16T15:35:58.039 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4938.g33f95 139/165 2024-09-16T15:35:58.062 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4938.g33f95 139/165 2024-09-16T15:35:58.062 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T15:35:58.063 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-16T15:35:58.063 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-16T15:35:58.115 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : cephfs-mirror-2:19.3.0-4938.g33f95d2a.el9.x86_64 140/165 2024-09-16T15:35:58.122 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-16T15:35:58.138 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4938.g33f95d2a.el9.x86_64 140/165 2024-09-16T15:35:58.138 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T15:35:58.139 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-16T15:35:58.139 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-16T15:35:58.139 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-16T15:35:58.139 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-16T15:35:58.155 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : librgw2-2:19.3.0-4938.g33f95d2a.el9.x86_64 106/165 2024-09-16T15:35:58.226 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librgw2-2:19.3.0-4938.g33f95d2a.el9.x86_64 106/165 2024-09-16T15:35:58.256 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-rgw-2:19.3.0-4938.g33f95d2a.el9.x86_64 107/165 2024-09-16T15:35:58.457 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : rbd-mirror-2:19.3.0-4938.g33f95d2a.el9.x86_64 141/165 2024-09-16T15:35:58.481 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4938.g33f95d2a.el9.x86_64 141/165 2024-09-16T15:35:58.481 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T15:35:58.482 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-16T15:35:58.482 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-16T15:35:58.482 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-16T15:35:58.482 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-16T15:36:00.612 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-common-2:19.3.0-4938.g33f95d2a.el9.x86_64 108/165 2024-09-16T15:36:00.645 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-common-2:19.3.0-4938.g33f95d2a.el9.x86_64 108/165 2024-09-16T15:36:01.199 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-common-2:19.3.0-4938.g33f95d2a.el9.x86_64 108/165 2024-09-16T15:36:01.231 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-base-2:19.3.0-4938.g33f95d2a.el9.x86_64 109/165 2024-09-16T15:36:01.324 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-base-2:19.3.0-4938.g33f95d2a.el9.x86_64 109/165 2024-09-16T15:36:01.325 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-16T15:36:01.325 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-16T15:36:01.325 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:36:01.358 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-selinux-2:19.3.0-4938.g33f95d2a.el9.x86_64 110/165 2024-09-16T15:36:02.820 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-test-2:19.3.0-4938.g33f95d2a.el9.x86_64 142/165 2024-09-16T15:36:02.861 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : rbd-fuse-2:19.3.0-4938.g33f95d2a.el9.x86_64 143/165 2024-09-16T15:36:02.901 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : rbd-nbd-2:19.3.0-4938.g33f95d2a.el9.x86_64 144/165 2024-09-16T15:36:02.934 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-16T15:36:02.961 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-16T15:36:03.154 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : cephfs-shell-2:19.3.0-4938.g33f95d2a.el9.x86_64 147/165 2024-09-16T15:36:03.199 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-16T15:36:03.230 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libcephfs-devel-2:19.3.0-4938.g33f95d2a.el9.x86_ 149/165 2024-09-16T15:36:03.260 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 150/165 2024-09-16T15:36:03.305 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 151/165 2024-09-16T15:36:03.945 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-16T15:36:03.987 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-16T15:36:04.008 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-16T15:36:04.845 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : cephfs-top-2:19.3.0-4938.g33f95d2a.el9.noarch 153/165 2024-09-16T15:36:04.925 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-16T15:36:04.976 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-16T15:36:05.077 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-16T15:36:05.120 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-16T15:36:05.148 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-16T15:36:05.179 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-16T15:36:05.180 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-16T15:36:05.272 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-16T15:36:05.272 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-16T15:36:05.348 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-16T15:36:05.373 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-16T15:36:05.388 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-16T15:36:05.388 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-16T15:36:05.575 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-16T15:36:05.575 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-16T15:36:05.677 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-16T15:36:05.751 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-16T15:36:12.736 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-16T15:36:12.736 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-2:19.3.0-4938.g33f95d2a.el9.x86_64 1/165 2024-09-16T15:36:12.736 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-base-2:19.3.0-4938.g33f95d2a.el9.x86_64 2/165 2024-09-16T15:36:12.736 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-common-2:19.3.0-4938.g33f95d2a.el9.x86_64 3/165 2024-09-16T15:36:12.736 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-fuse-2:19.3.0-4938.g33f95d2a.el9.x86_64 4/165 2024-09-16T15:36:12.736 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4938.g33f95 5/165 2024-09-16T15:36:12.736 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mds-2:19.3.0-4938.g33f95d2a.el9.x86_64 6/165 2024-09-16T15:36:12.736 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-2:19.3.0-4938.g33f95d2a.el9.x86_64 7/165 2024-09-16T15:36:12.736 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mon-2:19.3.0-4938.g33f95d2a.el9.x86_64 8/165 2024-09-16T15:36:12.737 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-osd-2:19.3.0-4938.g33f95d2a.el9.x86_64 9/165 2024-09-16T15:36:12.737 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-radosgw-2:19.3.0-4938.g33f95d2a.el9.x86_64 10/165 2024-09-16T15:36:12.737 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-selinux-2:19.3.0-4938.g33f95d2a.el9.x86_64 11/165 2024-09-16T15:36:12.737 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-test-2:19.3.0-4938.g33f95d2a.el9.x86_64 12/165 2024-09-16T15:36:12.737 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : cephfs-mirror-2:19.3.0-4938.g33f95d2a.el9.x86_64 13/165 2024-09-16T15:36:12.737 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : cephfs-shell-2:19.3.0-4938.g33f95d2a.el9.x86_64 14/165 2024-09-16T15:36:12.737 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcephfs-devel-2:19.3.0-4938.g33f95d2a.el9.x86_ 15/165 2024-09-16T15:36:12.737 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcephfs2-2:19.3.0-4938.g33f95d2a.el9.x86_64 16/165 2024-09-16T15:36:12.737 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcephsqlite-2:19.3.0-4938.g33f95d2a.el9.x86_64 17/165 2024-09-16T15:36:12.737 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librados-devel-2:19.3.0-4938.g33f95d2a.el9.x86_6 18/165 2024-09-16T15:36:12.737 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libradosstriper1-2:19.3.0-4938.g33f95d2a.el9.x86 19/165 2024-09-16T15:36:12.738 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librgw2-2:19.3.0-4938.g33f95d2a.el9.x86_64 20/165 2024-09-16T15:36:12.738 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4938.g33f95d2a.el 21/165 2024-09-16T15:36:12.738 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-ceph-common-2:19.3.0-4938.g33f95d2a.el9. 22/165 2024-09-16T15:36:12.738 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cephfs-2:19.3.0-4938.g33f95d2a.el9.x86_6 23/165 2024-09-16T15:36:12.738 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rados-2:19.3.0-4938.g33f95d2a.el9.x86_64 24/165 2024-09-16T15:36:12.738 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rbd-2:19.3.0-4938.g33f95d2a.el9.x86_64 25/165 2024-09-16T15:36:12.738 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rgw-2:19.3.0-4938.g33f95d2a.el9.x86_64 26/165 2024-09-16T15:36:12.738 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : rbd-fuse-2:19.3.0-4938.g33f95d2a.el9.x86_64 27/165 2024-09-16T15:36:12.738 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : rbd-mirror-2:19.3.0-4938.g33f95d2a.el9.x86_64 28/165 2024-09-16T15:36:12.738 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : rbd-nbd-2:19.3.0-4938.g33f95d2a.el9.x86_64 29/165 2024-09-16T15:36:12.738 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4938.g33f95d2a. 30/165 2024-09-16T15:36:12.738 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4938.g33f95d2a.el9.noa 31/165 2024-09-16T15:36:12.738 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4938.g33f95d2a.el9.n 32/165 2024-09-16T15:36:12.738 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4938.g33f 33/165 2024-09-16T15:36:12.738 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4938.g33f95d2a.el 34/165 2024-09-16T15:36:12.739 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4938.g33f95d2a.el9.noarch 35/165 2024-09-16T15:36:12.739 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4938.g33f95d2a.e 36/165 2024-09-16T15:36:12.739 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-volume-2:19.3.0-4938.g33f95d2a.el9.noarch 37/165 2024-09-16T15:36:12.739 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : cephadm-2:19.3.0-4938.g33f95d2a.el9.noarch 38/165 2024-09-16T15:36:12.739 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : cephfs-top-2:19.3.0-4938.g33f95d2a.el9.noarch 39/165 2024-09-16T15:36:12.739 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-16T15:36:12.739 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-16T15:36:12.739 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-16T15:36:12.739 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-16T15:36:12.739 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-16T15:36:12.739 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-16T15:36:12.739 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-16T15:36:12.739 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-16T15:36:12.739 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-16T15:36:12.740 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-16T15:36:12.740 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-16T15:36:12.740 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-16T15:36:12.740 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-16T15:36:12.740 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-16T15:36:12.740 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-16T15:36:12.740 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-16T15:36:12.740 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-16T15:36:12.740 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-16T15:36:12.740 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-16T15:36:12.740 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-16T15:36:12.740 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-16T15:36:12.740 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-16T15:36:12.741 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-16T15:36:12.741 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-16T15:36:12.741 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-16T15:36:12.741 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-16T15:36:12.741 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-16T15:36:12.741 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-16T15:36:12.741 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-16T15:36:12.741 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-16T15:36:12.741 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-16T15:36:12.741 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-16T15:36:12.741 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-16T15:36:12.742 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-16T15:36:12.742 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-16T15:36:12.742 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-16T15:36:12.742 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-16T15:36:12.742 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-16T15:36:12.742 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-16T15:36:12.742 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-16T15:36:12.742 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-16T15:36:12.742 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-16T15:36:12.742 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-16T15:36:12.742 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-16T15:36:12.742 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-16T15:36:12.742 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-16T15:36:12.743 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-16T15:36:12.743 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-16T15:36:12.743 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-16T15:36:12.743 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-16T15:36:12.743 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-16T15:36:12.743 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-16T15:36:12.743 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-16T15:36:12.743 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-16T15:36:12.743 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-16T15:36:12.743 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-16T15:36:12.743 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-16T15:36:12.743 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-16T15:36:12.744 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-16T15:36:12.744 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-16T15:36:12.744 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-16T15:36:12.744 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-16T15:36:12.744 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-16T15:36:12.744 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-16T15:36:12.744 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-16T15:36:12.744 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-16T15:36:12.744 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-16T15:36:12.744 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-16T15:36:12.744 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-16T15:36:12.744 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-16T15:36:12.744 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-16T15:36:12.744 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-16T15:36:12.745 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-16T15:36:12.745 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-16T15:36:12.745 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-16T15:36:12.745 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-16T15:36:12.745 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-16T15:36:12.745 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-16T15:36:12.745 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-16T15:36:12.745 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-16T15:36:12.745 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-16T15:36:12.745 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-16T15:36:12.745 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-16T15:36:12.745 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-16T15:36:12.745 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-16T15:36:12.746 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-16T15:36:12.746 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-16T15:36:12.746 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-16T15:36:12.746 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-16T15:36:12.746 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-16T15:36:12.746 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-16T15:36:12.746 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-16T15:36:12.746 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-16T15:36:12.746 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-16T15:36:12.746 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-16T15:36:12.746 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-16T15:36:12.746 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-16T15:36:12.746 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-16T15:36:12.746 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-16T15:36:12.747 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-16T15:36:12.747 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-16T15:36:12.747 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-16T15:36:12.747 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-16T15:36:12.747 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-16T15:36:12.747 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-16T15:36:12.747 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-16T15:36:12.747 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-16T15:36:12.747 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-16T15:36:12.747 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-16T15:36:12.747 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-16T15:36:12.747 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librados2-2:19.3.0-4938.g33f95d2a.el9.x86_64 150/165 2024-09-16T15:36:12.747 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-16T15:36:12.748 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librbd1-2:19.3.0-4938.g33f95d2a.el9.x86_64 152/165 2024-09-16T15:36:12.748 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-16T15:36:12.748 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 154/165 2024-09-16T15:36:12.748 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-16T15:36:12.748 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 156/165 2024-09-16T15:36:12.748 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-16T15:36:12.748 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 158/165 2024-09-16T15:36:12.748 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-16T15:36:12.748 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 160/165 2024-09-16T15:36:12.748 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-16T15:36:12.748 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-16T15:36:12.748 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-16T15:36:12.748 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-16T15:36:13.327 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4938.g33f95d2a.el9.x86_64 110/165 2024-09-16T15:36:13.328 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /sys 2024-09-16T15:36:13.328 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /proc 2024-09-16T15:36:13.328 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /mnt 2024-09-16T15:36:13.328 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /var/tmp 2024-09-16T15:36:13.328 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /home 2024-09-16T15:36:13.328 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /root 2024-09-16T15:36:13.328 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /tmp 2024-09-16T15:36:13.328 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:36:13.505 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-volume-2:19.3.0-4938.g33f95d2a.el9.noarch 111/165 2024-09-16T15:36:13.521 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-volume-2:19.3.0-4938.g33f95d2a.el9.noarch 111/165 2024-09-16T15:36:13.521 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T15:36:13.521 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-16T15:36:13.521 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:36:15.034 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-osd-2:19.3.0-4938.g33f95d2a.el9.x86_64 112/165 2024-09-16T15:36:15.060 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-osd-2:19.3.0-4938.g33f95d2a.el9.x86_64 112/165 2024-09-16T15:36:15.060 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T15:36:15.060 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-16T15:36:15.060 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-16T15:36:15.060 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-16T15:36:15.060 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:36:15.292 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mds-2:19.3.0-4938.g33f95d2a.el9.x86_64 113/165 2024-09-16T15:36:15.316 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mds-2:19.3.0-4938.g33f95d2a.el9.x86_64 113/165 2024-09-16T15:36:15.316 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T15:36:15.316 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-16T15:36:15.316 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-16T15:36:15.316 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-16T15:36:15.316 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:36:15.387 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-16T15:36:15.387 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-16T15:36:15.387 INFO:teuthology.orchestra.run.smithi135.stdout:Upgraded: 2024-09-16T15:36:15.387 INFO:teuthology.orchestra.run.smithi135.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-16T15:36:15.387 INFO:teuthology.orchestra.run.smithi135.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-16T15:36:15.387 INFO:teuthology.orchestra.run.smithi135.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-16T15:36:15.387 INFO:teuthology.orchestra.run.smithi135.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-16T15:36:15.387 INFO:teuthology.orchestra.run.smithi135.stdout: librados2-2:19.3.0-4938.g33f95d2a.el9.x86_64 2024-09-16T15:36:15.387 INFO:teuthology.orchestra.run.smithi135.stdout: librbd1-2:19.3.0-4938.g33f95d2a.el9.x86_64 2024-09-16T15:36:15.388 INFO:teuthology.orchestra.run.smithi135.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-16T15:36:15.388 INFO:teuthology.orchestra.run.smithi135.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-16T15:36:15.388 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2024-09-16T15:36:15.388 INFO:teuthology.orchestra.run.smithi135.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-16T15:36:15.388 INFO:teuthology.orchestra.run.smithi135.stdout: automake-1.16.2-8.el9.noarch 2024-09-16T15:36:15.388 INFO:teuthology.orchestra.run.smithi135.stdout: bison-3.7.4-5.el9.x86_64 2024-09-16T15:36:15.388 INFO:teuthology.orchestra.run.smithi135.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-16T15:36:15.388 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-2:19.3.0-4938.g33f95d2a.el9.x86_64 2024-09-16T15:36:15.388 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-base-2:19.3.0-4938.g33f95d2a.el9.x86_64 2024-09-16T15:36:15.388 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-common-2:19.3.0-4938.g33f95d2a.el9.x86_64 2024-09-16T15:36:15.388 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-fuse-2:19.3.0-4938.g33f95d2a.el9.x86_64 2024-09-16T15:36:15.388 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-grafana-dashboards-2:19.3.0-4938.g33f95d2a.el9.noarch 2024-09-16T15:36:15.388 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-immutable-object-cache-2:19.3.0-4938.g33f95d2a.el9.x86_64 2024-09-16T15:36:15.388 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mds-2:19.3.0-4938.g33f95d2a.el9.x86_64 2024-09-16T15:36:15.389 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-2:19.3.0-4938.g33f95d2a.el9.x86_64 2024-09-16T15:36:15.389 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-cephadm-2:19.3.0-4938.g33f95d2a.el9.noarch 2024-09-16T15:36:15.389 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-dashboard-2:19.3.0-4938.g33f95d2a.el9.noarch 2024-09-16T15:36:15.389 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4938.g33f95d2a.el9.noarch 2024-09-16T15:36:15.389 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-modules-core-2:19.3.0-4938.g33f95d2a.el9.noarch 2024-09-16T15:36:15.389 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-rook-2:19.3.0-4938.g33f95d2a.el9.noarch 2024-09-16T15:36:15.389 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mon-2:19.3.0-4938.g33f95d2a.el9.x86_64 2024-09-16T15:36:15.389 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-osd-2:19.3.0-4938.g33f95d2a.el9.x86_64 2024-09-16T15:36:15.389 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-prometheus-alerts-2:19.3.0-4938.g33f95d2a.el9.noarch 2024-09-16T15:36:15.389 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-radosgw-2:19.3.0-4938.g33f95d2a.el9.x86_64 2024-09-16T15:36:15.389 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-selinux-2:19.3.0-4938.g33f95d2a.el9.x86_64 2024-09-16T15:36:15.389 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-test-2:19.3.0-4938.g33f95d2a.el9.x86_64 2024-09-16T15:36:15.390 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-volume-2:19.3.0-4938.g33f95d2a.el9.noarch 2024-09-16T15:36:15.390 INFO:teuthology.orchestra.run.smithi135.stdout: cephadm-2:19.3.0-4938.g33f95d2a.el9.noarch 2024-09-16T15:36:15.390 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-mirror-2:19.3.0-4938.g33f95d2a.el9.x86_64 2024-09-16T15:36:15.390 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-shell-2:19.3.0-4938.g33f95d2a.el9.x86_64 2024-09-16T15:36:15.390 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-top-2:19.3.0-4938.g33f95d2a.el9.noarch 2024-09-16T15:36:15.390 INFO:teuthology.orchestra.run.smithi135.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-16T15:36:15.390 INFO:teuthology.orchestra.run.smithi135.stdout: flex-2.6.4-9.el9.x86_64 2024-09-16T15:36:15.390 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-16T15:36:15.390 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-16T15:36:15.390 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-16T15:36:15.390 INFO:teuthology.orchestra.run.smithi135.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-16T15:36:15.390 INFO:teuthology.orchestra.run.smithi135.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-16T15:36:15.390 INFO:teuthology.orchestra.run.smithi135.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-16T15:36:15.390 INFO:teuthology.orchestra.run.smithi135.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-16T15:36:15.391 INFO:teuthology.orchestra.run.smithi135.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-16T15:36:15.391 INFO:teuthology.orchestra.run.smithi135.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-16T15:36:15.391 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs-devel-2:19.3.0-4938.g33f95d2a.el9.x86_64 2024-09-16T15:36:15.391 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs2-2:19.3.0-4938.g33f95d2a.el9.x86_64 2024-09-16T15:36:15.391 INFO:teuthology.orchestra.run.smithi135.stdout: libcephsqlite-2:19.3.0-4938.g33f95d2a.el9.x86_64 2024-09-16T15:36:15.391 INFO:teuthology.orchestra.run.smithi135.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-16T15:36:15.391 INFO:teuthology.orchestra.run.smithi135.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-16T15:36:15.391 INFO:teuthology.orchestra.run.smithi135.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-16T15:36:15.391 INFO:teuthology.orchestra.run.smithi135.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-16T15:36:15.391 INFO:teuthology.orchestra.run.smithi135.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-16T15:36:15.391 INFO:teuthology.orchestra.run.smithi135.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-16T15:36:15.391 INFO:teuthology.orchestra.run.smithi135.stdout: librados-devel-2:19.3.0-4938.g33f95d2a.el9.x86_64 2024-09-16T15:36:15.391 INFO:teuthology.orchestra.run.smithi135.stdout: libradosstriper1-2:19.3.0-4938.g33f95d2a.el9.x86_64 2024-09-16T15:36:15.391 INFO:teuthology.orchestra.run.smithi135.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-16T15:36:15.392 INFO:teuthology.orchestra.run.smithi135.stdout: librgw2-2:19.3.0-4938.g33f95d2a.el9.x86_64 2024-09-16T15:36:15.392 INFO:teuthology.orchestra.run.smithi135.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-16T15:36:15.392 INFO:teuthology.orchestra.run.smithi135.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-16T15:36:15.392 INFO:teuthology.orchestra.run.smithi135.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-16T15:36:15.392 INFO:teuthology.orchestra.run.smithi135.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-16T15:36:15.392 INFO:teuthology.orchestra.run.smithi135.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-16T15:36:15.392 INFO:teuthology.orchestra.run.smithi135.stdout: lua-5.4.4-4.el9.x86_64 2024-09-16T15:36:15.392 INFO:teuthology.orchestra.run.smithi135.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-16T15:36:15.392 INFO:teuthology.orchestra.run.smithi135.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-16T15:36:15.392 INFO:teuthology.orchestra.run.smithi135.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-16T15:36:15.392 INFO:teuthology.orchestra.run.smithi135.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-16T15:36:15.392 INFO:teuthology.orchestra.run.smithi135.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-16T15:36:15.392 INFO:teuthology.orchestra.run.smithi135.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-16T15:36:15.393 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-13.16-1.el9.x86_64 2024-09-16T15:36:15.393 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-16T15:36:15.393 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-16T15:36:15.393 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-16T15:36:15.393 INFO:teuthology.orchestra.run.smithi135.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-16T15:36:15.393 INFO:teuthology.orchestra.run.smithi135.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-16T15:36:15.393 INFO:teuthology.orchestra.run.smithi135.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-16T15:36:15.393 INFO:teuthology.orchestra.run.smithi135.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-16T15:36:15.393 INFO:teuthology.orchestra.run.smithi135.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-16T15:36:15.393 INFO:teuthology.orchestra.run.smithi135.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-16T15:36:15.393 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-16T15:36:15.393 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-argparse-2:19.3.0-4938.g33f95d2a.el9.x86_64 2024-09-16T15:36:15.393 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-common-2:19.3.0-4938.g33f95d2a.el9.x86_64 2024-09-16T15:36:15.394 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cephfs-2:19.3.0-4938.g33f95d2a.el9.x86_64 2024-09-16T15:36:15.394 INFO:teuthology.orchestra.run.smithi135.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-16T15:36:15.394 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-16T15:36:15.394 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-16T15:36:15.394 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-16T15:36:15.394 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-16T15:36:15.394 INFO:teuthology.orchestra.run.smithi135.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-16T15:36:15.394 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-16T15:36:15.394 INFO:teuthology.orchestra.run.smithi135.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-16T15:36:15.394 INFO:teuthology.orchestra.run.smithi135.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-16T15:36:15.394 INFO:teuthology.orchestra.run.smithi135.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-16T15:36:15.394 INFO:teuthology.orchestra.run.smithi135.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-16T15:36:15.394 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-16T15:36:15.394 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-16T15:36:15.395 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-16T15:36:15.395 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-16T15:36:15.395 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-16T15:36:15.395 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-16T15:36:15.395 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-16T15:36:15.395 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-16T15:36:15.395 INFO:teuthology.orchestra.run.smithi135.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-16T15:36:15.395 INFO:teuthology.orchestra.run.smithi135.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-16T15:36:15.395 INFO:teuthology.orchestra.run.smithi135.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-16T15:36:15.395 INFO:teuthology.orchestra.run.smithi135.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-16T15:36:15.395 INFO:teuthology.orchestra.run.smithi135.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-16T15:36:15.395 INFO:teuthology.orchestra.run.smithi135.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-16T15:36:15.395 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-16T15:36:15.395 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-16T15:36:15.396 INFO:teuthology.orchestra.run.smithi135.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-16T15:36:15.396 INFO:teuthology.orchestra.run.smithi135.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-16T15:36:15.396 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-16T15:36:15.396 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ply-3.11-14.el9.noarch 2024-09-16T15:36:15.396 INFO:teuthology.orchestra.run.smithi135.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-16T15:36:15.396 INFO:teuthology.orchestra.run.smithi135.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-16T15:36:15.396 INFO:teuthology.orchestra.run.smithi135.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-16T15:36:15.396 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-16T15:36:15.396 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-16T15:36:15.396 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-16T15:36:15.396 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-16T15:36:15.396 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-16T15:36:15.396 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-16T15:36:15.396 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rados-2:19.3.0-4938.g33f95d2a.el9.x86_64 2024-09-16T15:36:15.397 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rbd-2:19.3.0-4938.g33f95d2a.el9.x86_64 2024-09-16T15:36:15.397 INFO:teuthology.orchestra.run.smithi135.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-16T15:36:15.397 INFO:teuthology.orchestra.run.smithi135.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-16T15:36:15.397 INFO:teuthology.orchestra.run.smithi135.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-16T15:36:15.397 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rgw-2:19.3.0-4938.g33f95d2a.el9.x86_64 2024-09-16T15:36:15.397 INFO:teuthology.orchestra.run.smithi135.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-16T15:36:15.397 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-16T15:36:15.397 INFO:teuthology.orchestra.run.smithi135.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-16T15:36:15.397 INFO:teuthology.orchestra.run.smithi135.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-16T15:36:15.397 INFO:teuthology.orchestra.run.smithi135.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-16T15:36:15.397 INFO:teuthology.orchestra.run.smithi135.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-16T15:36:15.397 INFO:teuthology.orchestra.run.smithi135.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-16T15:36:15.397 INFO:teuthology.orchestra.run.smithi135.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-16T15:36:15.398 INFO:teuthology.orchestra.run.smithi135.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-16T15:36:15.398 INFO:teuthology.orchestra.run.smithi135.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-16T15:36:15.398 INFO:teuthology.orchestra.run.smithi135.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-16T15:36:15.398 INFO:teuthology.orchestra.run.smithi135.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-16T15:36:15.398 INFO:teuthology.orchestra.run.smithi135.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-16T15:36:15.398 INFO:teuthology.orchestra.run.smithi135.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-16T15:36:15.398 INFO:teuthology.orchestra.run.smithi135.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-16T15:36:15.398 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-fuse-2:19.3.0-4938.g33f95d2a.el9.x86_64 2024-09-16T15:36:15.398 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-mirror-2:19.3.0-4938.g33f95d2a.el9.x86_64 2024-09-16T15:36:15.398 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-nbd-2:19.3.0-4938.g33f95d2a.el9.x86_64 2024-09-16T15:36:15.398 INFO:teuthology.orchestra.run.smithi135.stdout: re2-1:20211101-20.el9.x86_64 2024-09-16T15:36:15.398 INFO:teuthology.orchestra.run.smithi135.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-16T15:36:15.398 INFO:teuthology.orchestra.run.smithi135.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-16T15:36:15.398 INFO:teuthology.orchestra.run.smithi135.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-16T15:36:15.399 INFO:teuthology.orchestra.run.smithi135.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-16T15:36:15.399 INFO:teuthology.orchestra.run.smithi135.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-16T15:36:15.399 INFO:teuthology.orchestra.run.smithi135.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-16T15:36:15.399 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-16T15:36:15.399 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-09-16T15:36:15.768 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mon-2:19.3.0-4938.g33f95d2a.el9.x86_64 114/165 2024-09-16T15:36:15.792 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mon-2:19.3.0-4938.g33f95d2a.el9.x86_64 114/165 2024-09-16T15:36:15.792 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T15:36:15.792 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-16T15:36:15.792 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-16T15:36:15.792 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-16T15:36:15.792 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:36:15.839 DEBUG:teuthology.parallel:result is None 2024-09-16T15:36:15.898 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-16T15:36:15.955 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-16T15:36:16.010 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-16T15:36:16.204 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-16T15:36:16.252 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-16T15:36:16.330 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-16T15:36:16.418 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-16T15:36:16.566 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-16T15:36:16.613 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-16T15:36:16.651 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-16T15:36:16.679 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-16T15:36:17.126 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: cephadm-2:19.3.0-4938.g33f95d2a.el9.noarch 126/165 2024-09-16T15:36:17.153 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : cephadm-2:19.3.0-4938.g33f95d2a.el9.noarch 126/165 2024-09-16T15:36:17.185 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4938.g33f95d2a.e 127/165 2024-09-16T15:36:17.250 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4938.g33f95d2a. 128/165 2024-09-16T15:36:17.276 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4938.g33f95d2a.el9.noa 129/165 2024-09-16T15:36:20.424 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4938.g33f95d2a.el9.noa 129/165 2024-09-16T15:36:20.483 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4938.g33f95d2a.el9.n 130/165 2024-09-16T15:36:21.437 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4938.g33f95d2a.el9.n 130/165 2024-09-16T15:36:21.458 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4938.g33f 131/165 2024-09-16T15:36:21.571 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4938.g33f 131/165 2024-09-16T15:36:21.737 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4938.g33f95d2a.el 132/165 2024-09-16T15:36:21.769 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-2:19.3.0-4938.g33f95d2a.el9.x86_64 133/165 2024-09-16T15:36:21.793 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4938.g33f95d2a.el9.x86_64 133/165 2024-09-16T15:36:21.793 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T15:36:21.793 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-16T15:36:21.793 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-16T15:36:21.793 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-16T15:36:21.793 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:36:21.844 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-rook-2:19.3.0-4938.g33f95d2a.el9.noarch 134/165 2024-09-16T15:36:21.856 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4938.g33f95d2a.el9.noarch 134/165 2024-09-16T15:36:21.954 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-2:19.3.0-4938.g33f95d2a.el9.x86_64 135/165 2024-09-16T15:36:22.005 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-fuse-2:19.3.0-4938.g33f95d2a.el9.x86_64 136/165 2024-09-16T15:36:22.944 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-16T15:36:22.972 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-radosgw-2:19.3.0-4938.g33f95d2a.el9.x86_64 138/165 2024-09-16T15:36:22.995 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4938.g33f95d2a.el9.x86_64 138/165 2024-09-16T15:36:22.995 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T15:36:22.995 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-16T15:36:22.995 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-16T15:36:22.995 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-16T15:36:22.995 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:36:23.039 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4938.g33f95 139/165 2024-09-16T15:36:23.062 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4938.g33f95 139/165 2024-09-16T15:36:23.062 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T15:36:23.062 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-16T15:36:23.062 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:36:23.106 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : cephfs-mirror-2:19.3.0-4938.g33f95d2a.el9.x86_64 140/165 2024-09-16T15:36:23.130 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4938.g33f95d2a.el9.x86_64 140/165 2024-09-16T15:36:23.130 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T15:36:23.130 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-16T15:36:23.130 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-16T15:36:23.130 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-16T15:36:23.130 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:36:23.441 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : rbd-mirror-2:19.3.0-4938.g33f95d2a.el9.x86_64 141/165 2024-09-16T15:36:23.464 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4938.g33f95d2a.el9.x86_64 141/165 2024-09-16T15:36:23.464 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T15:36:23.464 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-16T15:36:23.464 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-16T15:36:23.464 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-16T15:36:23.464 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:36:27.820 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-test-2:19.3.0-4938.g33f95d2a.el9.x86_64 142/165 2024-09-16T15:36:27.861 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : rbd-fuse-2:19.3.0-4938.g33f95d2a.el9.x86_64 143/165 2024-09-16T15:36:27.902 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : rbd-nbd-2:19.3.0-4938.g33f95d2a.el9.x86_64 144/165 2024-09-16T15:36:27.934 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-16T15:36:27.961 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-16T15:36:28.143 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : cephfs-shell-2:19.3.0-4938.g33f95d2a.el9.x86_64 147/165 2024-09-16T15:36:28.192 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-16T15:36:28.214 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libcephfs-devel-2:19.3.0-4938.g33f95d2a.el9.x86_ 149/165 2024-09-16T15:36:28.243 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 150/165 2024-09-16T15:36:28.290 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 151/165 2024-09-16T15:36:28.918 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-16T15:36:28.963 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-16T15:36:28.983 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-16T15:36:29.807 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : cephfs-top-2:19.3.0-4938.g33f95d2a.el9.noarch 153/165 2024-09-16T15:36:29.885 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-16T15:36:29.936 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-16T15:36:30.023 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-16T15:36:30.063 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-16T15:36:30.089 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-16T15:36:30.114 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-16T15:36:30.114 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-16T15:36:30.199 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-16T15:36:30.199 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-16T15:36:30.283 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-16T15:36:30.308 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-16T15:36:30.313 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-16T15:36:30.313 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-16T15:36:30.493 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-16T15:36:30.493 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-16T15:36:30.577 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-16T15:36:30.641 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-16T15:36:37.697 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-16T15:36:37.698 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-2:19.3.0-4938.g33f95d2a.el9.x86_64 1/165 2024-09-16T15:36:37.698 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-base-2:19.3.0-4938.g33f95d2a.el9.x86_64 2/165 2024-09-16T15:36:37.698 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-common-2:19.3.0-4938.g33f95d2a.el9.x86_64 3/165 2024-09-16T15:36:37.698 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-fuse-2:19.3.0-4938.g33f95d2a.el9.x86_64 4/165 2024-09-16T15:36:37.698 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4938.g33f95 5/165 2024-09-16T15:36:37.698 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mds-2:19.3.0-4938.g33f95d2a.el9.x86_64 6/165 2024-09-16T15:36:37.698 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-2:19.3.0-4938.g33f95d2a.el9.x86_64 7/165 2024-09-16T15:36:37.698 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mon-2:19.3.0-4938.g33f95d2a.el9.x86_64 8/165 2024-09-16T15:36:37.698 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-osd-2:19.3.0-4938.g33f95d2a.el9.x86_64 9/165 2024-09-16T15:36:37.698 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-radosgw-2:19.3.0-4938.g33f95d2a.el9.x86_64 10/165 2024-09-16T15:36:37.699 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-selinux-2:19.3.0-4938.g33f95d2a.el9.x86_64 11/165 2024-09-16T15:36:37.699 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-test-2:19.3.0-4938.g33f95d2a.el9.x86_64 12/165 2024-09-16T15:36:37.699 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : cephfs-mirror-2:19.3.0-4938.g33f95d2a.el9.x86_64 13/165 2024-09-16T15:36:37.699 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : cephfs-shell-2:19.3.0-4938.g33f95d2a.el9.x86_64 14/165 2024-09-16T15:36:37.699 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libcephfs-devel-2:19.3.0-4938.g33f95d2a.el9.x86_ 15/165 2024-09-16T15:36:37.699 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libcephfs2-2:19.3.0-4938.g33f95d2a.el9.x86_64 16/165 2024-09-16T15:36:37.699 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libcephsqlite-2:19.3.0-4938.g33f95d2a.el9.x86_64 17/165 2024-09-16T15:36:37.699 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librados-devel-2:19.3.0-4938.g33f95d2a.el9.x86_6 18/165 2024-09-16T15:36:37.699 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libradosstriper1-2:19.3.0-4938.g33f95d2a.el9.x86 19/165 2024-09-16T15:36:37.699 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librgw2-2:19.3.0-4938.g33f95d2a.el9.x86_64 20/165 2024-09-16T15:36:37.699 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4938.g33f95d2a.el 21/165 2024-09-16T15:36:37.699 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-ceph-common-2:19.3.0-4938.g33f95d2a.el9. 22/165 2024-09-16T15:36:37.700 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cephfs-2:19.3.0-4938.g33f95d2a.el9.x86_6 23/165 2024-09-16T15:36:37.700 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-rados-2:19.3.0-4938.g33f95d2a.el9.x86_64 24/165 2024-09-16T15:36:37.700 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-rbd-2:19.3.0-4938.g33f95d2a.el9.x86_64 25/165 2024-09-16T15:36:37.700 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-rgw-2:19.3.0-4938.g33f95d2a.el9.x86_64 26/165 2024-09-16T15:36:37.700 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : rbd-fuse-2:19.3.0-4938.g33f95d2a.el9.x86_64 27/165 2024-09-16T15:36:37.700 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : rbd-mirror-2:19.3.0-4938.g33f95d2a.el9.x86_64 28/165 2024-09-16T15:36:37.700 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : rbd-nbd-2:19.3.0-4938.g33f95d2a.el9.x86_64 29/165 2024-09-16T15:36:37.700 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4938.g33f95d2a. 30/165 2024-09-16T15:36:37.711 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4938.g33f95d2a.el9.noa 31/165 2024-09-16T15:36:37.711 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4938.g33f95d2a.el9.n 32/165 2024-09-16T15:36:37.711 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4938.g33f 33/165 2024-09-16T15:36:37.711 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4938.g33f95d2a.el 34/165 2024-09-16T15:36:37.712 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4938.g33f95d2a.el9.noarch 35/165 2024-09-16T15:36:37.712 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4938.g33f95d2a.e 36/165 2024-09-16T15:36:37.712 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-volume-2:19.3.0-4938.g33f95d2a.el9.noarch 37/165 2024-09-16T15:36:37.712 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : cephadm-2:19.3.0-4938.g33f95d2a.el9.noarch 38/165 2024-09-16T15:36:37.712 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : cephfs-top-2:19.3.0-4938.g33f95d2a.el9.noarch 39/165 2024-09-16T15:36:37.712 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-16T15:36:37.712 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-16T15:36:37.712 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-16T15:36:37.712 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-16T15:36:37.712 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-16T15:36:37.712 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-16T15:36:37.712 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-16T15:36:37.712 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-16T15:36:37.713 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-16T15:36:37.713 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-16T15:36:37.713 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-16T15:36:37.713 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-16T15:36:37.713 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-16T15:36:37.713 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-16T15:36:37.713 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-16T15:36:37.713 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-16T15:36:37.713 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-16T15:36:37.713 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-16T15:36:37.713 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-16T15:36:37.713 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-16T15:36:37.713 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-16T15:36:37.713 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-16T15:36:37.714 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-16T15:36:37.714 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-16T15:36:37.714 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-16T15:36:37.714 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-16T15:36:37.714 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-16T15:36:37.714 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-16T15:36:37.714 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-16T15:36:37.714 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-16T15:36:37.714 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-16T15:36:37.714 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-16T15:36:37.714 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-16T15:36:37.714 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-16T15:36:37.714 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-16T15:36:37.714 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-16T15:36:37.714 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-16T15:36:37.715 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-16T15:36:37.715 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-16T15:36:37.715 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-16T15:36:37.715 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-16T15:36:37.715 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-16T15:36:37.715 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-16T15:36:37.715 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-16T15:36:37.715 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-16T15:36:37.715 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-16T15:36:37.715 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-16T15:36:37.715 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-16T15:36:37.715 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-16T15:36:37.715 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-16T15:36:37.715 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-16T15:36:37.716 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-16T15:36:37.716 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-16T15:36:37.716 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-16T15:36:37.716 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-16T15:36:37.716 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-16T15:36:37.716 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-16T15:36:37.716 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-16T15:36:37.716 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-16T15:36:37.716 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-16T15:36:37.716 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-16T15:36:37.716 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-16T15:36:37.716 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-16T15:36:37.716 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-16T15:36:37.716 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-16T15:36:37.716 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-16T15:36:37.717 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-16T15:36:37.717 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-16T15:36:37.717 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-16T15:36:37.717 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-16T15:36:37.717 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-16T15:36:37.717 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-16T15:36:37.717 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-16T15:36:37.717 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-16T15:36:37.717 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-16T15:36:37.717 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-16T15:36:37.717 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-16T15:36:37.717 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-16T15:36:37.717 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-16T15:36:37.718 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-16T15:36:37.718 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-16T15:36:37.718 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-16T15:36:37.718 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-16T15:36:37.718 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-16T15:36:37.718 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-16T15:36:37.718 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-16T15:36:37.718 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-16T15:36:37.718 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-16T15:36:37.718 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-16T15:36:37.718 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-16T15:36:37.718 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-16T15:36:37.718 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-16T15:36:37.719 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-16T15:36:37.719 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-16T15:36:37.719 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-16T15:36:37.719 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-16T15:36:37.719 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-16T15:36:37.719 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-16T15:36:37.719 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-16T15:36:37.719 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-16T15:36:37.719 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-16T15:36:37.719 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-16T15:36:37.719 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-16T15:36:37.719 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-16T15:36:37.719 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-16T15:36:37.719 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-16T15:36:37.719 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-16T15:36:37.720 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-16T15:36:37.720 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-16T15:36:37.720 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-16T15:36:37.720 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librados2-2:19.3.0-4938.g33f95d2a.el9.x86_64 150/165 2024-09-16T15:36:37.720 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-16T15:36:37.720 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librbd1-2:19.3.0-4938.g33f95d2a.el9.x86_64 152/165 2024-09-16T15:36:37.720 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-16T15:36:37.720 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 154/165 2024-09-16T15:36:37.720 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-16T15:36:37.720 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 156/165 2024-09-16T15:36:37.720 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-16T15:36:37.720 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 158/165 2024-09-16T15:36:37.720 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-16T15:36:37.721 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 160/165 2024-09-16T15:36:37.721 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-16T15:36:37.721 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-16T15:36:37.721 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-16T15:36:37.721 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-16T15:36:40.414 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-16T15:36:40.414 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:36:40.415 INFO:teuthology.orchestra.run.smithi098.stdout:Upgraded: 2024-09-16T15:36:40.415 INFO:teuthology.orchestra.run.smithi098.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-16T15:36:40.415 INFO:teuthology.orchestra.run.smithi098.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-16T15:36:40.415 INFO:teuthology.orchestra.run.smithi098.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-16T15:36:40.415 INFO:teuthology.orchestra.run.smithi098.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-16T15:36:40.415 INFO:teuthology.orchestra.run.smithi098.stdout: librados2-2:19.3.0-4938.g33f95d2a.el9.x86_64 2024-09-16T15:36:40.415 INFO:teuthology.orchestra.run.smithi098.stdout: librbd1-2:19.3.0-4938.g33f95d2a.el9.x86_64 2024-09-16T15:36:40.415 INFO:teuthology.orchestra.run.smithi098.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-16T15:36:40.415 INFO:teuthology.orchestra.run.smithi098.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-16T15:36:40.415 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-16T15:36:40.415 INFO:teuthology.orchestra.run.smithi098.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-16T15:36:40.416 INFO:teuthology.orchestra.run.smithi098.stdout: automake-1.16.2-8.el9.noarch 2024-09-16T15:36:40.416 INFO:teuthology.orchestra.run.smithi098.stdout: bison-3.7.4-5.el9.x86_64 2024-09-16T15:36:40.416 INFO:teuthology.orchestra.run.smithi098.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-16T15:36:40.416 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-2:19.3.0-4938.g33f95d2a.el9.x86_64 2024-09-16T15:36:40.416 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-base-2:19.3.0-4938.g33f95d2a.el9.x86_64 2024-09-16T15:36:40.416 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-common-2:19.3.0-4938.g33f95d2a.el9.x86_64 2024-09-16T15:36:40.416 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-fuse-2:19.3.0-4938.g33f95d2a.el9.x86_64 2024-09-16T15:36:40.416 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-grafana-dashboards-2:19.3.0-4938.g33f95d2a.el9.noarch 2024-09-16T15:36:40.416 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-immutable-object-cache-2:19.3.0-4938.g33f95d2a.el9.x86_64 2024-09-16T15:36:40.416 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mds-2:19.3.0-4938.g33f95d2a.el9.x86_64 2024-09-16T15:36:40.416 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-2:19.3.0-4938.g33f95d2a.el9.x86_64 2024-09-16T15:36:40.416 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-cephadm-2:19.3.0-4938.g33f95d2a.el9.noarch 2024-09-16T15:36:40.417 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-dashboard-2:19.3.0-4938.g33f95d2a.el9.noarch 2024-09-16T15:36:40.417 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4938.g33f95d2a.el9.noarch 2024-09-16T15:36:40.417 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-modules-core-2:19.3.0-4938.g33f95d2a.el9.noarch 2024-09-16T15:36:40.417 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-rook-2:19.3.0-4938.g33f95d2a.el9.noarch 2024-09-16T15:36:40.417 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mon-2:19.3.0-4938.g33f95d2a.el9.x86_64 2024-09-16T15:36:40.417 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-osd-2:19.3.0-4938.g33f95d2a.el9.x86_64 2024-09-16T15:36:40.417 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-prometheus-alerts-2:19.3.0-4938.g33f95d2a.el9.noarch 2024-09-16T15:36:40.417 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-radosgw-2:19.3.0-4938.g33f95d2a.el9.x86_64 2024-09-16T15:36:40.417 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-selinux-2:19.3.0-4938.g33f95d2a.el9.x86_64 2024-09-16T15:36:40.417 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-test-2:19.3.0-4938.g33f95d2a.el9.x86_64 2024-09-16T15:36:40.417 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-volume-2:19.3.0-4938.g33f95d2a.el9.noarch 2024-09-16T15:36:40.418 INFO:teuthology.orchestra.run.smithi098.stdout: cephadm-2:19.3.0-4938.g33f95d2a.el9.noarch 2024-09-16T15:36:40.418 INFO:teuthology.orchestra.run.smithi098.stdout: cephfs-mirror-2:19.3.0-4938.g33f95d2a.el9.x86_64 2024-09-16T15:36:40.418 INFO:teuthology.orchestra.run.smithi098.stdout: cephfs-shell-2:19.3.0-4938.g33f95d2a.el9.x86_64 2024-09-16T15:36:40.418 INFO:teuthology.orchestra.run.smithi098.stdout: cephfs-top-2:19.3.0-4938.g33f95d2a.el9.noarch 2024-09-16T15:36:40.418 INFO:teuthology.orchestra.run.smithi098.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-16T15:36:40.418 INFO:teuthology.orchestra.run.smithi098.stdout: flex-2.6.4-9.el9.x86_64 2024-09-16T15:36:40.418 INFO:teuthology.orchestra.run.smithi098.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-16T15:36:40.418 INFO:teuthology.orchestra.run.smithi098.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-16T15:36:40.418 INFO:teuthology.orchestra.run.smithi098.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-16T15:36:40.418 INFO:teuthology.orchestra.run.smithi098.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-16T15:36:40.419 INFO:teuthology.orchestra.run.smithi098.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-16T15:36:40.419 INFO:teuthology.orchestra.run.smithi098.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-16T15:36:40.419 INFO:teuthology.orchestra.run.smithi098.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-16T15:36:40.419 INFO:teuthology.orchestra.run.smithi098.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-16T15:36:40.419 INFO:teuthology.orchestra.run.smithi098.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-16T15:36:40.419 INFO:teuthology.orchestra.run.smithi098.stdout: libcephfs-devel-2:19.3.0-4938.g33f95d2a.el9.x86_64 2024-09-16T15:36:40.419 INFO:teuthology.orchestra.run.smithi098.stdout: libcephfs2-2:19.3.0-4938.g33f95d2a.el9.x86_64 2024-09-16T15:36:40.419 INFO:teuthology.orchestra.run.smithi098.stdout: libcephsqlite-2:19.3.0-4938.g33f95d2a.el9.x86_64 2024-09-16T15:36:40.419 INFO:teuthology.orchestra.run.smithi098.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-16T15:36:40.420 INFO:teuthology.orchestra.run.smithi098.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-16T15:36:40.420 INFO:teuthology.orchestra.run.smithi098.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-16T15:36:40.420 INFO:teuthology.orchestra.run.smithi098.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-16T15:36:40.420 INFO:teuthology.orchestra.run.smithi098.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-16T15:36:40.420 INFO:teuthology.orchestra.run.smithi098.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-16T15:36:40.420 INFO:teuthology.orchestra.run.smithi098.stdout: librados-devel-2:19.3.0-4938.g33f95d2a.el9.x86_64 2024-09-16T15:36:40.420 INFO:teuthology.orchestra.run.smithi098.stdout: libradosstriper1-2:19.3.0-4938.g33f95d2a.el9.x86_64 2024-09-16T15:36:40.420 INFO:teuthology.orchestra.run.smithi098.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-16T15:36:40.420 INFO:teuthology.orchestra.run.smithi098.stdout: librgw2-2:19.3.0-4938.g33f95d2a.el9.x86_64 2024-09-16T15:36:40.420 INFO:teuthology.orchestra.run.smithi098.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-16T15:36:40.420 INFO:teuthology.orchestra.run.smithi098.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-16T15:36:40.421 INFO:teuthology.orchestra.run.smithi098.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-16T15:36:40.421 INFO:teuthology.orchestra.run.smithi098.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-16T15:36:40.421 INFO:teuthology.orchestra.run.smithi098.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-16T15:36:40.421 INFO:teuthology.orchestra.run.smithi098.stdout: lua-5.4.4-4.el9.x86_64 2024-09-16T15:36:40.421 INFO:teuthology.orchestra.run.smithi098.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-16T15:36:40.421 INFO:teuthology.orchestra.run.smithi098.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-16T15:36:40.421 INFO:teuthology.orchestra.run.smithi098.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-16T15:36:40.421 INFO:teuthology.orchestra.run.smithi098.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-16T15:36:40.421 INFO:teuthology.orchestra.run.smithi098.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-16T15:36:40.421 INFO:teuthology.orchestra.run.smithi098.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-16T15:36:40.421 INFO:teuthology.orchestra.run.smithi098.stdout: postgresql-13.16-1.el9.x86_64 2024-09-16T15:36:40.422 INFO:teuthology.orchestra.run.smithi098.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-16T15:36:40.422 INFO:teuthology.orchestra.run.smithi098.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-16T15:36:40.422 INFO:teuthology.orchestra.run.smithi098.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-16T15:36:40.422 INFO:teuthology.orchestra.run.smithi098.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-16T15:36:40.422 INFO:teuthology.orchestra.run.smithi098.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-16T15:36:40.422 INFO:teuthology.orchestra.run.smithi098.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-16T15:36:40.422 INFO:teuthology.orchestra.run.smithi098.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-16T15:36:40.422 INFO:teuthology.orchestra.run.smithi098.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-16T15:36:40.422 INFO:teuthology.orchestra.run.smithi098.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-16T15:36:40.422 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-16T15:36:40.422 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ceph-argparse-2:19.3.0-4938.g33f95d2a.el9.x86_64 2024-09-16T15:36:40.423 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ceph-common-2:19.3.0-4938.g33f95d2a.el9.x86_64 2024-09-16T15:36:40.423 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cephfs-2:19.3.0-4938.g33f95d2a.el9.x86_64 2024-09-16T15:36:40.423 INFO:teuthology.orchestra.run.smithi098.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-16T15:36:40.423 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-16T15:36:40.423 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-16T15:36:40.423 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-16T15:36:40.423 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-16T15:36:40.423 INFO:teuthology.orchestra.run.smithi098.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-16T15:36:40.423 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-16T15:36:40.423 INFO:teuthology.orchestra.run.smithi098.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-16T15:36:40.423 INFO:teuthology.orchestra.run.smithi098.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-16T15:36:40.423 INFO:teuthology.orchestra.run.smithi098.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-16T15:36:40.424 INFO:teuthology.orchestra.run.smithi098.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-16T15:36:40.424 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-16T15:36:40.424 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-16T15:36:40.424 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-16T15:36:40.424 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-16T15:36:40.424 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-16T15:36:40.424 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-16T15:36:40.424 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-16T15:36:40.424 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-16T15:36:40.424 INFO:teuthology.orchestra.run.smithi098.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-16T15:36:40.424 INFO:teuthology.orchestra.run.smithi098.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-16T15:36:40.424 INFO:teuthology.orchestra.run.smithi098.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-16T15:36:40.425 INFO:teuthology.orchestra.run.smithi098.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-16T15:36:40.425 INFO:teuthology.orchestra.run.smithi098.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-16T15:36:40.425 INFO:teuthology.orchestra.run.smithi098.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-16T15:36:40.425 INFO:teuthology.orchestra.run.smithi098.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-16T15:36:40.425 INFO:teuthology.orchestra.run.smithi098.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-16T15:36:40.425 INFO:teuthology.orchestra.run.smithi098.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-16T15:36:40.425 INFO:teuthology.orchestra.run.smithi098.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-16T15:36:40.425 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-16T15:36:40.425 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ply-3.11-14.el9.noarch 2024-09-16T15:36:40.425 INFO:teuthology.orchestra.run.smithi098.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-16T15:36:40.425 INFO:teuthology.orchestra.run.smithi098.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-16T15:36:40.426 INFO:teuthology.orchestra.run.smithi098.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-16T15:36:40.426 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-16T15:36:40.426 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-16T15:36:40.426 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-16T15:36:40.426 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-16T15:36:40.426 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-16T15:36:40.426 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-16T15:36:40.426 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rados-2:19.3.0-4938.g33f95d2a.el9.x86_64 2024-09-16T15:36:40.426 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rbd-2:19.3.0-4938.g33f95d2a.el9.x86_64 2024-09-16T15:36:40.426 INFO:teuthology.orchestra.run.smithi098.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-16T15:36:40.426 INFO:teuthology.orchestra.run.smithi098.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-16T15:36:40.427 INFO:teuthology.orchestra.run.smithi098.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-16T15:36:40.427 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rgw-2:19.3.0-4938.g33f95d2a.el9.x86_64 2024-09-16T15:36:40.427 INFO:teuthology.orchestra.run.smithi098.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-16T15:36:40.427 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-16T15:36:40.427 INFO:teuthology.orchestra.run.smithi098.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-16T15:36:40.427 INFO:teuthology.orchestra.run.smithi098.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-16T15:36:40.427 INFO:teuthology.orchestra.run.smithi098.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-16T15:36:40.427 INFO:teuthology.orchestra.run.smithi098.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-16T15:36:40.427 INFO:teuthology.orchestra.run.smithi098.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-16T15:36:40.427 INFO:teuthology.orchestra.run.smithi098.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-16T15:36:40.427 INFO:teuthology.orchestra.run.smithi098.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-16T15:36:40.428 INFO:teuthology.orchestra.run.smithi098.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-16T15:36:40.428 INFO:teuthology.orchestra.run.smithi098.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-16T15:36:40.428 INFO:teuthology.orchestra.run.smithi098.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-16T15:36:40.428 INFO:teuthology.orchestra.run.smithi098.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-16T15:36:40.428 INFO:teuthology.orchestra.run.smithi098.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-16T15:36:40.428 INFO:teuthology.orchestra.run.smithi098.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-16T15:36:40.428 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-fuse-2:19.3.0-4938.g33f95d2a.el9.x86_64 2024-09-16T15:36:40.428 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-mirror-2:19.3.0-4938.g33f95d2a.el9.x86_64 2024-09-16T15:36:40.428 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-nbd-2:19.3.0-4938.g33f95d2a.el9.x86_64 2024-09-16T15:36:40.428 INFO:teuthology.orchestra.run.smithi098.stdout: re2-1:20211101-20.el9.x86_64 2024-09-16T15:36:40.428 INFO:teuthology.orchestra.run.smithi098.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-16T15:36:40.429 INFO:teuthology.orchestra.run.smithi098.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-16T15:36:40.429 INFO:teuthology.orchestra.run.smithi098.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-16T15:36:40.429 INFO:teuthology.orchestra.run.smithi098.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-16T15:36:40.429 INFO:teuthology.orchestra.run.smithi098.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-16T15:36:40.429 INFO:teuthology.orchestra.run.smithi098.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-16T15:36:40.429 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:36:40.429 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-16T15:36:40.874 DEBUG:teuthology.parallel:result is None 2024-09-16T15:36:40.875 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=33f95d2ae1bcbe7eb04404303f179eeeaa6982df 2024-09-16T15:36:41.025 DEBUG:teuthology.orchestra.run.smithi098:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-16T15:36:41.047 INFO:teuthology.orchestra.run.smithi098.stdout:19.3.0-4938.g33f95d2a.el9 2024-09-16T15:36:41.047 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4938.g33f95d2a.el9 2024-09-16T15:36:41.047 INFO:teuthology.task.install:The correct ceph version 19.3.0-4938.g33f95d2a is installed. 2024-09-16T15:36:41.049 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=33f95d2ae1bcbe7eb04404303f179eeeaa6982df 2024-09-16T15:36:41.187 DEBUG:teuthology.orchestra.run.smithi135:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-16T15:36:41.213 INFO:teuthology.orchestra.run.smithi135.stdout:19.3.0-4938.g33f95d2a.el9 2024-09-16T15:36:41.213 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4938.g33f95d2a.el9 2024-09-16T15:36:41.213 INFO:teuthology.task.install:The correct ceph version 19.3.0-4938.g33f95d2a is installed. 2024-09-16T15:36:41.215 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-16T15:36:41.215 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-16T15:36:41.215 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-16T15:36:41.243 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-16T15:36:41.243 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-16T15:36:41.286 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-16T15:36:41.287 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-16T15:36:41.287 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/usr/bin/daemon-helper 2024-09-16T15:36:41.311 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-16T15:36:41.376 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-16T15:36:41.376 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/usr/bin/daemon-helper 2024-09-16T15:36:41.405 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-16T15:36:41.474 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-16T15:36:41.475 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-16T15:36:41.475 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-16T15:36:41.499 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-16T15:36:41.564 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-16T15:36:41.564 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-16T15:36:41.591 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-16T15:36:41.656 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-16T15:36:41.656 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-16T15:36:41.656 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/usr/bin/stdin-killer 2024-09-16T15:36:41.681 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-16T15:36:41.745 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-16T15:36:41.745 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/usr/bin/stdin-killer 2024-09-16T15:36:41.770 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-16T15:36:41.836 INFO:teuthology.run_tasks:Running task ceph... 2024-09-16T15:36:41.914 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-16T15:36:41.914 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 777 /var/log/ceph 2024-09-16T15:36:41.917 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 777 /var/log/ceph 2024-09-16T15:36:41.943 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-16T15:36:41.943 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-16T15:36:41.982 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-16T15:36:42.008 INFO:tasks.ceph:Creating extra log directories... 2024-09-16T15:36:42.008 DEBUG:teuthology.orchestra.run.smithi098:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-16T15:36:42.047 DEBUG:teuthology.orchestra.run.smithi135:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-16T15:36:42.078 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-16T15:36:42.078 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-16T15:36:42.078 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-16T15:36:42.079 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-16T15:36:42.079 DEBUG:teuthology.orchestra.run.smithi098:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-16T15:36:42.125 DEBUG:teuthology.orchestra.run.smithi098:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-16T15:36:42.234 DEBUG:teuthology.orchestra.run.smithi098:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-16T15:36:42.258 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-16T15:36:42.258 DEBUG:teuthology.orchestra.run.smithi135:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-16T15:36:42.273 DEBUG:teuthology.orchestra.run.smithi135:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-16T15:36:42.385 DEBUG:teuthology.orchestra.run.smithi135:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-16T15:36:42.413 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-16T15:36:42.414 INFO:tasks.ceph:config {'conf': {'client': {'pid file': ''}, 'global': {'ms die on skipped message': False}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-16T15:36:42.414 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/avan-2024-09-16_15:21:40-fs:volumes-wip-athakkar-testing-2024-09-16-1454-distro-default-smithi/7907356', 'branch': 'wip-athakkar-testing-2024-09-16-1454', 'description': 'fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/finisher_per_module}}', 'email': 'athakkar@redhat.com', 'first_in_suite': False, 'job_id': '7907356', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'avan-2024-09-16_15:21:40-fs:volumes-wip-athakkar-testing-2024-09-16-1454-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-athakkar-testing-2024-09-16-1454'}, 'ceph': {'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'global': {'ms die on skipped message': False}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '33f95d2ae1bcbe7eb04404303f179eeeaa6982df'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '33f95d2ae1bcbe7eb04404303f179eeeaa6982df'}}, 'kclient': {'syntax': 'v1'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-athakkar-testing-2024-09-16-1454', 'sha1': '33f95d2ae1bcbe7eb04404303f179eeeaa6982df'}}, 'owner': 'scheduled_avan@teuthology', 'priority': 80, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 3077, 'sha1': '33f95d2ae1bcbe7eb04404303f179eeeaa6982df', 'sleep_before_teardown': 0, 'subset': '1/20', 'suite': 'fs:volumes', 'suite_branch': 'wip-athakkar-testing-2024-09-16-1454', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_33f95d2ae1bcbe7eb04404303f179eeeaa6982df/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '33f95d2ae1bcbe7eb04404303f179eeeaa6982df', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi098.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIFO86mnTKEVQsFzMGaQ43qmexpW5DcqGVmmCb8eNp7NNUCLR2aMwPIFf/IEySVcthQgKQYmyoGZVhsifOspRTY=', 'smithi135.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGi7xFYHMfQJ1cwmPOewx9N9/zxHfMPlsLTIy77jt6r3KADoYSo06RPrwOcc52fFU7yA+UpiQxRVqHyfPp6WGSw='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '33f95d2ae1bcbe7eb04404303f179eeeaa6982df'}}, {'ceph': {'create_rbd_pool': False, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'global': {'ms die on skipped message': False}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '33f95d2ae1bcbe7eb04404303f179eeeaa6982df', 'cluster': 'ceph'}}, {'kclient': None}, {'check-counter': {'counters': {'mgr': [{'min': 4, 'name': 'finisher-volumes.complete_latency.avgcount'}, {'expected_val': 0, 'name': 'finisher-volumes.queue_len'}]}}}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_volumes.TestPerModuleFinsherThread']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-16_15:21:40', 'tube': 'smithi', 'user': 'avan', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-16T15:36:42.414 DEBUG:teuthology.orchestra.run.smithi098:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-16T15:36:42.417 DEBUG:teuthology.orchestra.run.smithi135:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-16T15:36:42.464 DEBUG:teuthology.orchestra.run.smithi098:> sudo install -d -m0777 -- /var/run/ceph 2024-09-16T15:36:42.472 DEBUG:teuthology.orchestra.run.smithi135:> sudo install -d -m0777 -- /var/run/ceph 2024-09-16T15:36:42.528 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-16T15:36:42.528 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/scratch_devs of=/dev/stdout 2024-09-16T15:36:42.549 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-16T15:36:42.550 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_1 2024-09-16T15:36:42.605 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-16T15:36:42.605 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T15:36:42.605 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-16T15:36:42.605 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T15:36:42.605 INFO:teuthology.orchestra.run.smithi098.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T15:36:42.605 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2024-09-16 15:36:31.044627403 +0000 2024-09-16T15:36:42.605 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2024-09-16 15:34:14.922694437 +0000 2024-09-16T15:36:42.605 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2024-09-16 15:34:14.922694437 +0000 2024-09-16T15:36:42.605 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: 2024-09-16 15:34:14.922694437 +0000 2024-09-16T15:36:42.606 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-16T15:36:42.667 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2024-09-16T15:36:42.667 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2024-09-16T15:36:42.668 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.000189468 s, 2.7 MB/s 2024-09-16T15:36:42.669 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-16T15:36:42.725 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_2 2024-09-16T15:36:42.780 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-16T15:36:42.780 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T15:36:42.780 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-16T15:36:42.780 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T15:36:42.780 INFO:teuthology.orchestra.run.smithi098.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T15:36:42.780 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2024-09-16 15:36:31.044627403 +0000 2024-09-16T15:36:42.780 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2024-09-16 15:34:15.270689981 +0000 2024-09-16T15:36:42.780 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2024-09-16 15:34:15.270689981 +0000 2024-09-16T15:36:42.780 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: 2024-09-16 15:34:15.270689981 +0000 2024-09-16T15:36:42.781 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-16T15:36:42.842 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2024-09-16T15:36:42.842 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2024-09-16T15:36:42.843 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.000168035 s, 3.0 MB/s 2024-09-16T15:36:42.844 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-16T15:36:42.899 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_3 2024-09-16T15:36:42.954 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-16T15:36:42.954 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T15:36:42.955 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-16T15:36:42.955 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T15:36:42.955 INFO:teuthology.orchestra.run.smithi098.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T15:36:42.955 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2024-09-16 15:36:31.045627391 +0000 2024-09-16T15:36:42.955 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2024-09-16 15:34:15.592685858 +0000 2024-09-16T15:36:42.955 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2024-09-16 15:34:15.592685858 +0000 2024-09-16T15:36:42.955 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: 2024-09-16 15:34:15.592685858 +0000 2024-09-16T15:36:42.955 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-16T15:36:43.017 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2024-09-16T15:36:43.017 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2024-09-16T15:36:43.017 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.00019723 s, 2.6 MB/s 2024-09-16T15:36:43.019 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-16T15:36:43.075 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_4 2024-09-16T15:36:43.129 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-16T15:36:43.129 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T15:36:43.130 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-16T15:36:43.130 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T15:36:43.130 INFO:teuthology.orchestra.run.smithi098.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T15:36:43.130 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2024-09-16 15:36:31.045627391 +0000 2024-09-16T15:36:43.130 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2024-09-16 15:34:15.912681760 +0000 2024-09-16T15:36:43.130 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2024-09-16 15:34:15.912681760 +0000 2024-09-16T15:36:43.130 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: 2024-09-16 15:34:15.912681760 +0000 2024-09-16T15:36:43.130 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-16T15:36:43.193 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2024-09-16T15:36:43.193 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2024-09-16T15:36:43.193 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.000233149 s, 2.2 MB/s 2024-09-16T15:36:43.194 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-16T15:36:43.251 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-16T15:36:43.252 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-16T15:36:43.252 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/scratch_devs of=/dev/stdout 2024-09-16T15:36:43.269 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-16T15:36:43.269 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_1 2024-09-16T15:36:43.324 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-16T15:36:43.324 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T15:36:43.324 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-16T15:36:43.325 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T15:36:43.325 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T15:36:43.325 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2024-09-16 15:36:06.146560466 +0000 2024-09-16T15:36:43.325 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2024-09-16 15:34:14.928623529 +0000 2024-09-16T15:36:43.325 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2024-09-16 15:34:14.928623529 +0000 2024-09-16T15:36:43.325 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: 2024-09-16 15:34:14.928623529 +0000 2024-09-16T15:36:43.325 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-16T15:36:43.388 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2024-09-16T15:36:43.389 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2024-09-16T15:36:43.389 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000210146 s, 2.4 MB/s 2024-09-16T15:36:43.390 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-16T15:36:43.446 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_2 2024-09-16T15:36:43.501 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-16T15:36:43.501 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T15:36:43.501 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-16T15:36:43.501 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T15:36:43.501 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T15:36:43.501 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2024-09-16 15:36:06.146560466 +0000 2024-09-16T15:36:43.501 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2024-09-16 15:34:15.253616938 +0000 2024-09-16T15:36:43.502 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2024-09-16 15:34:15.253616938 +0000 2024-09-16T15:36:43.502 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: 2024-09-16 15:34:15.253616938 +0000 2024-09-16T15:36:43.502 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-16T15:36:43.564 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2024-09-16T15:36:43.564 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2024-09-16T15:36:43.564 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000262567 s, 1.9 MB/s 2024-09-16T15:36:43.565 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-16T15:36:43.622 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_3 2024-09-16T15:36:43.677 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-16T15:36:43.677 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T15:36:43.677 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-16T15:36:43.678 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T15:36:43.678 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T15:36:43.678 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2024-09-16 15:36:06.147560445 +0000 2024-09-16T15:36:43.678 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2024-09-16 15:34:15.575610407 +0000 2024-09-16T15:36:43.678 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2024-09-16 15:34:15.575610407 +0000 2024-09-16T15:36:43.678 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: 2024-09-16 15:34:15.575610407 +0000 2024-09-16T15:36:43.678 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-16T15:36:43.740 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2024-09-16T15:36:43.740 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2024-09-16T15:36:43.740 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000178741 s, 2.9 MB/s 2024-09-16T15:36:43.741 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-16T15:36:43.797 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_4 2024-09-16T15:36:43.852 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-16T15:36:43.852 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T15:36:43.852 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-16T15:36:43.852 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T15:36:43.852 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T15:36:43.852 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2024-09-16 15:36:06.147560445 +0000 2024-09-16T15:36:43.852 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2024-09-16 15:34:15.899603836 +0000 2024-09-16T15:36:43.852 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2024-09-16 15:34:15.899603836 +0000 2024-09-16T15:36:43.852 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: 2024-09-16 15:34:15.899603836 +0000 2024-09-16T15:36:43.852 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-16T15:36:43.915 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2024-09-16T15:36:43.915 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2024-09-16T15:36:43.915 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.00016641 s, 3.1 MB/s 2024-09-16T15:36:43.916 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-16T15:36:43.972 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-16T15:36:43.972 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi098.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi135.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-16T15:36:43.972 INFO:tasks.ceph:Generating config... 2024-09-16T15:36:43.973 INFO:tasks.ceph:[client] pid file = 2024-09-16T15:36:43.973 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-09-16T15:36:43.973 INFO:tasks.ceph:[mgr] client mount timeout = 30 2024-09-16T15:36:43.973 INFO:tasks.ceph:[mgr] debug client = 20 2024-09-16T15:36:43.974 INFO:tasks.ceph:[mgr] debug finisher = 20 2024-09-16T15:36:43.974 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-16T15:36:43.974 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-16T15:36:43.974 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-16T15:36:43.974 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-16T15:36:43.974 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-16T15:36:43.974 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-09-16T15:36:43.974 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-16T15:36:43.974 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-16T15:36:43.974 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-16T15:36:43.974 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-16T15:36:43.974 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-16T15:36:43.974 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-16T15:36:43.974 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-16T15:36:43.974 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-16T15:36:43.975 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-16T15:36:43.975 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-16T15:36:43.975 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-16T15:36:43.975 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-16T15:36:43.975 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-16T15:36:43.975 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-16T15:36:43.975 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-16T15:36:43.975 INFO:tasks.ceph:Setting up mon.a... 2024-09-16T15:36:43.975 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-16T15:36:44.028 INFO:teuthology.orchestra.run.smithi098.stdout:creating /etc/ceph/ceph.keyring 2024-09-16T15:36:44.030 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-16T15:36:44.072 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-16T15:36:44.136 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.98'), ('mon.b', '172.21.15.135'), ('mon.c', '[v2:172.21.15.135:3301,v1:172.21.15.135:6790]')] 2024-09-16T15:36:44.137 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.98,172.21.15.135,[v2:172.21.15.135:3301,v1:172.21.15.135:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'client mount timeout': 30, 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'pid file': ''}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}} 2024-09-16T15:36:44.138 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-16T15:36:44.138 DEBUG:teuthology.orchestra.run.smithi098:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-16T15:36:44.192 DEBUG:teuthology.orchestra.run.smithi098:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.98 --add b 172.21.15.135 --addv c '[v2:172.21.15.135:3301,v1:172.21.15.135:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-16T15:36:44.279 INFO:teuthology.orchestra.run.smithi098.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-16T15:36:44.279 INFO:teuthology.orchestra.run.smithi098.stdout:monmaptool: generated fsid 52a38a45-21d2-4cb0-bb3a-4fb8be3a08df 2024-09-16T15:36:44.279 INFO:teuthology.orchestra.run.smithi098.stdout:setting min_mon_release = quincy 2024-09-16T15:36:44.279 INFO:teuthology.orchestra.run.smithi098.stdout:epoch 0 2024-09-16T15:36:44.279 INFO:teuthology.orchestra.run.smithi098.stdout:fsid 52a38a45-21d2-4cb0-bb3a-4fb8be3a08df 2024-09-16T15:36:44.279 INFO:teuthology.orchestra.run.smithi098.stdout:last_changed 2024-09-16T15:36:44.278869+0000 2024-09-16T15:36:44.279 INFO:teuthology.orchestra.run.smithi098.stdout:created 2024-09-16T15:36:44.278869+0000 2024-09-16T15:36:44.279 INFO:teuthology.orchestra.run.smithi098.stdout:min_mon_release 17 (quincy) 2024-09-16T15:36:44.279 INFO:teuthology.orchestra.run.smithi098.stdout:election_strategy: 1 2024-09-16T15:36:44.279 INFO:teuthology.orchestra.run.smithi098.stdout:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-16T15:36:44.280 INFO:teuthology.orchestra.run.smithi098.stdout:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-16T15:36:44.280 INFO:teuthology.orchestra.run.smithi098.stdout:2: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.c 2024-09-16T15:36:44.280 INFO:teuthology.orchestra.run.smithi098.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-16T15:36:44.281 DEBUG:teuthology.orchestra.run.smithi098:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-16T15:36:44.295 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 52a38a45-21d2-4cb0-bb3a-4fb8be3a08df... 2024-09-16T15:36:44.296 DEBUG:teuthology.orchestra.run.smithi098:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-16T15:36:44.338 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-16T15:36:44.379 INFO:teuthology.orchestra.run.smithi098.stdout:[global] 2024-09-16T15:36:44.379 INFO:teuthology.orchestra.run.smithi098.stdout: chdir = "" 2024-09-16T15:36:44.379 INFO:teuthology.orchestra.run.smithi098.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-16T15:36:44.379 INFO:teuthology.orchestra.run.smithi098.stdout: auth supported = cephx 2024-09-16T15:36:44.379 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:36:44.379 INFO:teuthology.orchestra.run.smithi098.stdout: filestore xattr use omap = true 2024-09-16T15:36:44.379 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:36:44.379 INFO:teuthology.orchestra.run.smithi098.stdout: mon clock drift allowed = 1.000 2024-09-16T15:36:44.379 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:36:44.380 INFO:teuthology.orchestra.run.smithi098.stdout: osd crush chooseleaf type = 0 2024-09-16T15:36:44.380 INFO:teuthology.orchestra.run.smithi098.stdout: auth debug = true 2024-09-16T15:36:44.380 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:36:44.380 INFO:teuthology.orchestra.run.smithi098.stdout: ms die on old message = true 2024-09-16T15:36:44.380 INFO:teuthology.orchestra.run.smithi098.stdout: ms die on bug = true 2024-09-16T15:36:44.380 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:36:44.380 INFO:teuthology.orchestra.run.smithi098.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-16T15:36:44.380 INFO:teuthology.orchestra.run.smithi098.stdout: mon pg warn max object skew = 0 2024-09-16T15:36:44.380 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:36:44.380 INFO:teuthology.orchestra.run.smithi098.stdout: # disable pg_autoscaler by default for new pools 2024-09-16T15:36:44.380 INFO:teuthology.orchestra.run.smithi098.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-16T15:36:44.380 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:36:44.380 INFO:teuthology.orchestra.run.smithi098.stdout: osd pool default size = 2 2024-09-16T15:36:44.380 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:36:44.381 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd allow primary affinity = true 2024-09-16T15:36:44.381 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd allow pg remap = true 2024-09-16T15:36:44.381 INFO:teuthology.orchestra.run.smithi098.stdout: mon warn on legacy crush tunables = false 2024-09-16T15:36:44.381 INFO:teuthology.orchestra.run.smithi098.stdout: mon warn on crush straw calc version zero = false 2024-09-16T15:36:44.381 INFO:teuthology.orchestra.run.smithi098.stdout: mon warn on no sortbitwise = false 2024-09-16T15:36:44.381 INFO:teuthology.orchestra.run.smithi098.stdout: mon warn on osd down out interval zero = false 2024-09-16T15:36:44.381 INFO:teuthology.orchestra.run.smithi098.stdout: mon warn on too few osds = false 2024-09-16T15:36:44.381 INFO:teuthology.orchestra.run.smithi098.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-16T15:36:44.381 INFO:teuthology.orchestra.run.smithi098.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-16T15:36:44.381 INFO:teuthology.orchestra.run.smithi098.stdout: mon_allow_pool_size_one = true 2024-09-16T15:36:44.381 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:36:44.381 INFO:teuthology.orchestra.run.smithi098.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-16T15:36:44.382 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:36:44.382 INFO:teuthology.orchestra.run.smithi098.stdout: osd default data pool replay window = 5 2024-09-16T15:36:44.382 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:36:44.382 INFO:teuthology.orchestra.run.smithi098.stdout: mon allow pool delete = true 2024-09-16T15:36:44.382 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:36:44.382 INFO:teuthology.orchestra.run.smithi098.stdout: mon cluster log file level = debug 2024-09-16T15:36:44.382 INFO:teuthology.orchestra.run.smithi098.stdout: debug asserts on shutdown = true 2024-09-16T15:36:44.382 INFO:teuthology.orchestra.run.smithi098.stdout: mon health detail to clog = false 2024-09-16T15:36:44.382 INFO:teuthology.orchestra.run.smithi098.stdout: mon host = "172.21.15.98,172.21.15.135,[v2:172.21.15.135:3301,v1:172.21.15.135:6790]" 2024-09-16T15:36:44.382 INFO:teuthology.orchestra.run.smithi098.stdout: ms die on skipped message = False 2024-09-16T15:36:44.382 INFO:teuthology.orchestra.run.smithi098.stdout: fsid = 52a38a45-21d2-4cb0-bb3a-4fb8be3a08df 2024-09-16T15:36:44.383 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:36:44.383 INFO:teuthology.orchestra.run.smithi098.stdout:[osd] 2024-09-16T15:36:44.383 INFO:teuthology.orchestra.run.smithi098.stdout: osd journal size = 100 2024-09-16T15:36:44.383 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:36:44.383 INFO:teuthology.orchestra.run.smithi098.stdout: osd scrub load threshold = 5.0 2024-09-16T15:36:44.383 INFO:teuthology.orchestra.run.smithi098.stdout: osd scrub max interval = 600 2024-09-16T15:36:44.383 INFO:teuthology.orchestra.run.smithi098.stdout: osd mclock profile = high_recovery_ops 2024-09-16T15:36:44.383 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:36:44.383 INFO:teuthology.orchestra.run.smithi098.stdout: osd recover clone overlap = true 2024-09-16T15:36:44.383 INFO:teuthology.orchestra.run.smithi098.stdout: osd recovery max chunk = 1048576 2024-09-16T15:36:44.383 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:36:44.383 INFO:teuthology.orchestra.run.smithi098.stdout: osd debug shutdown = true 2024-09-16T15:36:44.383 INFO:teuthology.orchestra.run.smithi098.stdout: osd debug op order = true 2024-09-16T15:36:44.384 INFO:teuthology.orchestra.run.smithi098.stdout: osd debug verify stray on activate = true 2024-09-16T15:36:44.384 INFO:teuthology.orchestra.run.smithi098.stdout: osd debug trim objects = true 2024-09-16T15:36:44.384 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:36:44.384 INFO:teuthology.orchestra.run.smithi098.stdout: osd open classes on start = true 2024-09-16T15:36:44.384 INFO:teuthology.orchestra.run.smithi098.stdout: osd debug pg log writeout = true 2024-09-16T15:36:44.384 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:36:44.384 INFO:teuthology.orchestra.run.smithi098.stdout: osd deep scrub update digest min age = 30 2024-09-16T15:36:44.384 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:36:44.384 INFO:teuthology.orchestra.run.smithi098.stdout: osd map max advance = 10 2024-09-16T15:36:44.384 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:36:44.384 INFO:teuthology.orchestra.run.smithi098.stdout: journal zero on create = true 2024-09-16T15:36:44.384 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:36:44.384 INFO:teuthology.orchestra.run.smithi098.stdout: filestore ondisk finisher threads = 3 2024-09-16T15:36:44.385 INFO:teuthology.orchestra.run.smithi098.stdout: filestore apply finisher threads = 3 2024-09-16T15:36:44.385 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:36:44.385 INFO:teuthology.orchestra.run.smithi098.stdout: bdev debug aio = true 2024-09-16T15:36:44.385 INFO:teuthology.orchestra.run.smithi098.stdout: osd debug misdirected ops = true 2024-09-16T15:36:44.385 INFO:teuthology.orchestra.run.smithi098.stdout: bdev async discard = True 2024-09-16T15:36:44.385 INFO:teuthology.orchestra.run.smithi098.stdout: bdev enable discard = True 2024-09-16T15:36:44.385 INFO:teuthology.orchestra.run.smithi098.stdout: bluestore allocator = bitmap 2024-09-16T15:36:44.385 INFO:teuthology.orchestra.run.smithi098.stdout: bluestore block size = 96636764160 2024-09-16T15:36:44.385 INFO:teuthology.orchestra.run.smithi098.stdout: bluestore fsck on mount = True 2024-09-16T15:36:44.385 INFO:teuthology.orchestra.run.smithi098.stdout: debug bluefs = 1/20 2024-09-16T15:36:44.385 INFO:teuthology.orchestra.run.smithi098.stdout: debug bluestore = 1/20 2024-09-16T15:36:44.385 INFO:teuthology.orchestra.run.smithi098.stdout: debug ms = 1 2024-09-16T15:36:44.385 INFO:teuthology.orchestra.run.smithi098.stdout: debug osd = 20 2024-09-16T15:36:44.386 INFO:teuthology.orchestra.run.smithi098.stdout: debug rocksdb = 4/10 2024-09-16T15:36:44.386 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd backfillfull_ratio = 0.85 2024-09-16T15:36:44.386 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd full ratio = 0.9 2024-09-16T15:36:44.386 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd nearfull ratio = 0.8 2024-09-16T15:36:44.386 INFO:teuthology.orchestra.run.smithi098.stdout: osd failsafe full ratio = 0.95 2024-09-16T15:36:44.386 INFO:teuthology.orchestra.run.smithi098.stdout: osd objectstore = bluestore 2024-09-16T15:36:44.386 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:36:44.386 INFO:teuthology.orchestra.run.smithi098.stdout:[mgr] 2024-09-16T15:36:44.386 INFO:teuthology.orchestra.run.smithi098.stdout: debug ms = 1 2024-09-16T15:36:44.386 INFO:teuthology.orchestra.run.smithi098.stdout: debug mgr = 20 2024-09-16T15:36:44.386 INFO:teuthology.orchestra.run.smithi098.stdout: debug mon = 20 2024-09-16T15:36:44.386 INFO:teuthology.orchestra.run.smithi098.stdout: debug auth = 20 2024-09-16T15:36:44.386 INFO:teuthology.orchestra.run.smithi098.stdout: mon reweight min pgs per osd = 4 2024-09-16T15:36:44.386 INFO:teuthology.orchestra.run.smithi098.stdout: mon reweight min bytes per osd = 10 2024-09-16T15:36:44.387 INFO:teuthology.orchestra.run.smithi098.stdout: mgr/telemetry/nag = false 2024-09-16T15:36:44.387 INFO:teuthology.orchestra.run.smithi098.stdout: client mount timeout = 30 2024-09-16T15:36:44.387 INFO:teuthology.orchestra.run.smithi098.stdout: debug client = 20 2024-09-16T15:36:44.387 INFO:teuthology.orchestra.run.smithi098.stdout: debug finisher = 20 2024-09-16T15:36:44.387 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:36:44.387 INFO:teuthology.orchestra.run.smithi098.stdout:[mon] 2024-09-16T15:36:44.387 INFO:teuthology.orchestra.run.smithi098.stdout: debug ms = 1 2024-09-16T15:36:44.387 INFO:teuthology.orchestra.run.smithi098.stdout: debug mon = 20 2024-09-16T15:36:44.387 INFO:teuthology.orchestra.run.smithi098.stdout: debug paxos = 20 2024-09-16T15:36:44.387 INFO:teuthology.orchestra.run.smithi098.stdout: debug auth = 20 2024-09-16T15:36:44.387 INFO:teuthology.orchestra.run.smithi098.stdout: mon data avail warn = 5 2024-09-16T15:36:44.387 INFO:teuthology.orchestra.run.smithi098.stdout: mon mgr mkfs grace = 240 2024-09-16T15:36:44.387 INFO:teuthology.orchestra.run.smithi098.stdout: mon reweight min pgs per osd = 4 2024-09-16T15:36:44.387 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd reporter subtree level = osd 2024-09-16T15:36:44.388 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd prime pg temp = true 2024-09-16T15:36:44.388 INFO:teuthology.orchestra.run.smithi098.stdout: mon reweight min bytes per osd = 10 2024-09-16T15:36:44.388 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:36:44.388 INFO:teuthology.orchestra.run.smithi098.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-16T15:36:44.388 INFO:teuthology.orchestra.run.smithi098.stdout: auth mon ticket ttl = 660 # 11m 2024-09-16T15:36:44.388 INFO:teuthology.orchestra.run.smithi098.stdout: auth service ticket ttl = 240 # 4m 2024-09-16T15:36:44.388 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:36:44.388 INFO:teuthology.orchestra.run.smithi098.stdout: # don't complain about insecure global_id in the test suite 2024-09-16T15:36:44.388 INFO:teuthology.orchestra.run.smithi098.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-16T15:36:44.388 INFO:teuthology.orchestra.run.smithi098.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-16T15:36:44.388 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:36:44.388 INFO:teuthology.orchestra.run.smithi098.stdout: # 1m isn't quite enough 2024-09-16T15:36:44.388 INFO:teuthology.orchestra.run.smithi098.stdout: mon_down_mkfs_grace = 2m 2024-09-16T15:36:44.389 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:36:44.389 INFO:teuthology.orchestra.run.smithi098.stdout: mon_warn_on_filestore_osds = false 2024-09-16T15:36:44.389 INFO:teuthology.orchestra.run.smithi098.stdout: mon down mkfs grace = 300 2024-09-16T15:36:44.389 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:36:44.389 INFO:teuthology.orchestra.run.smithi098.stdout:[client] 2024-09-16T15:36:44.389 INFO:teuthology.orchestra.run.smithi098.stdout: rgw cache enabled = true 2024-09-16T15:36:44.389 INFO:teuthology.orchestra.run.smithi098.stdout: rgw enable ops log = true 2024-09-16T15:36:44.389 INFO:teuthology.orchestra.run.smithi098.stdout: rgw enable usage log = true 2024-09-16T15:36:44.389 INFO:teuthology.orchestra.run.smithi098.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-16T15:36:44.389 INFO:teuthology.orchestra.run.smithi098.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-16T15:36:44.389 INFO:teuthology.orchestra.run.smithi098.stdout: pid file = "" 2024-09-16T15:36:44.389 INFO:teuthology.orchestra.run.smithi098.stdout:[mon.a] 2024-09-16T15:36:44.389 INFO:teuthology.orchestra.run.smithi098.stdout:[mon.b] 2024-09-16T15:36:44.390 INFO:teuthology.orchestra.run.smithi098.stdout:[mon.c] 2024-09-16T15:36:44.390 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.a] 2024-09-16T15:36:44.390 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.c] 2024-09-16T15:36:44.390 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.b] 2024-09-16T15:36:44.390 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.d] 2024-09-16T15:36:44.390 INFO:teuthology.orchestra.run.smithi135.stdout:[global] 2024-09-16T15:36:44.390 INFO:teuthology.orchestra.run.smithi135.stdout: chdir = "" 2024-09-16T15:36:44.391 INFO:teuthology.orchestra.run.smithi135.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-16T15:36:44.391 INFO:teuthology.orchestra.run.smithi135.stdout: auth supported = cephx 2024-09-16T15:36:44.391 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-16T15:36:44.391 INFO:teuthology.orchestra.run.smithi135.stdout: filestore xattr use omap = true 2024-09-16T15:36:44.391 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-16T15:36:44.391 INFO:teuthology.orchestra.run.smithi135.stdout: mon clock drift allowed = 1.000 2024-09-16T15:36:44.391 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-16T15:36:44.391 INFO:teuthology.orchestra.run.smithi135.stdout: osd crush chooseleaf type = 0 2024-09-16T15:36:44.391 INFO:teuthology.orchestra.run.smithi135.stdout: auth debug = true 2024-09-16T15:36:44.391 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-16T15:36:44.391 INFO:teuthology.orchestra.run.smithi135.stdout: ms die on old message = true 2024-09-16T15:36:44.391 INFO:teuthology.orchestra.run.smithi135.stdout: ms die on bug = true 2024-09-16T15:36:44.391 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-16T15:36:44.392 INFO:teuthology.orchestra.run.smithi135.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-16T15:36:44.392 INFO:teuthology.orchestra.run.smithi135.stdout: mon pg warn max object skew = 0 2024-09-16T15:36:44.392 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-16T15:36:44.392 INFO:teuthology.orchestra.run.smithi135.stdout: # disable pg_autoscaler by default for new pools 2024-09-16T15:36:44.392 INFO:teuthology.orchestra.run.smithi135.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-16T15:36:44.392 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-16T15:36:44.392 INFO:teuthology.orchestra.run.smithi135.stdout: osd pool default size = 2 2024-09-16T15:36:44.392 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-16T15:36:44.392 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd allow primary affinity = true 2024-09-16T15:36:44.392 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd allow pg remap = true 2024-09-16T15:36:44.392 INFO:teuthology.orchestra.run.smithi135.stdout: mon warn on legacy crush tunables = false 2024-09-16T15:36:44.392 INFO:teuthology.orchestra.run.smithi135.stdout: mon warn on crush straw calc version zero = false 2024-09-16T15:36:44.393 INFO:teuthology.orchestra.run.smithi135.stdout: mon warn on no sortbitwise = false 2024-09-16T15:36:44.393 INFO:teuthology.orchestra.run.smithi135.stdout: mon warn on osd down out interval zero = false 2024-09-16T15:36:44.393 INFO:teuthology.orchestra.run.smithi135.stdout: mon warn on too few osds = false 2024-09-16T15:36:44.393 INFO:teuthology.orchestra.run.smithi135.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-16T15:36:44.393 INFO:teuthology.orchestra.run.smithi135.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-16T15:36:44.393 INFO:teuthology.orchestra.run.smithi135.stdout: mon_allow_pool_size_one = true 2024-09-16T15:36:44.393 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-16T15:36:44.393 INFO:teuthology.orchestra.run.smithi135.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-16T15:36:44.393 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-16T15:36:44.393 INFO:teuthology.orchestra.run.smithi135.stdout: osd default data pool replay window = 5 2024-09-16T15:36:44.393 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-16T15:36:44.393 INFO:teuthology.orchestra.run.smithi135.stdout: mon allow pool delete = true 2024-09-16T15:36:44.393 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-16T15:36:44.393 INFO:teuthology.orchestra.run.smithi135.stdout: mon cluster log file level = debug 2024-09-16T15:36:44.394 INFO:teuthology.orchestra.run.smithi135.stdout: debug asserts on shutdown = true 2024-09-16T15:36:44.394 INFO:teuthology.orchestra.run.smithi135.stdout: mon health detail to clog = false 2024-09-16T15:36:44.394 INFO:teuthology.orchestra.run.smithi135.stdout: mon host = "172.21.15.98,172.21.15.135,[v2:172.21.15.135:3301,v1:172.21.15.135:6790]" 2024-09-16T15:36:44.394 INFO:teuthology.orchestra.run.smithi135.stdout: ms die on skipped message = False 2024-09-16T15:36:44.394 INFO:teuthology.orchestra.run.smithi135.stdout: fsid = 52a38a45-21d2-4cb0-bb3a-4fb8be3a08df 2024-09-16T15:36:44.394 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-16T15:36:44.394 INFO:teuthology.orchestra.run.smithi135.stdout:[osd] 2024-09-16T15:36:44.394 INFO:teuthology.orchestra.run.smithi135.stdout: osd journal size = 100 2024-09-16T15:36:44.394 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-16T15:36:44.394 INFO:teuthology.orchestra.run.smithi135.stdout: osd scrub load threshold = 5.0 2024-09-16T15:36:44.394 INFO:teuthology.orchestra.run.smithi135.stdout: osd scrub max interval = 600 2024-09-16T15:36:44.394 INFO:teuthology.orchestra.run.smithi135.stdout: osd mclock profile = high_recovery_ops 2024-09-16T15:36:44.394 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-16T15:36:44.394 INFO:teuthology.orchestra.run.smithi135.stdout: osd recover clone overlap = true 2024-09-16T15:36:44.395 INFO:teuthology.orchestra.run.smithi135.stdout: osd recovery max chunk = 1048576 2024-09-16T15:36:44.395 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-16T15:36:44.395 INFO:teuthology.orchestra.run.smithi135.stdout: osd debug shutdown = true 2024-09-16T15:36:44.395 INFO:teuthology.orchestra.run.smithi135.stdout: osd debug op order = true 2024-09-16T15:36:44.395 INFO:teuthology.orchestra.run.smithi135.stdout: osd debug verify stray on activate = true 2024-09-16T15:36:44.395 INFO:teuthology.orchestra.run.smithi135.stdout: osd debug trim objects = true 2024-09-16T15:36:44.395 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-16T15:36:44.395 INFO:teuthology.orchestra.run.smithi135.stdout: osd open classes on start = true 2024-09-16T15:36:44.395 INFO:teuthology.orchestra.run.smithi135.stdout: osd debug pg log writeout = true 2024-09-16T15:36:44.395 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-16T15:36:44.395 INFO:teuthology.orchestra.run.smithi135.stdout: osd deep scrub update digest min age = 30 2024-09-16T15:36:44.395 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-16T15:36:44.395 INFO:teuthology.orchestra.run.smithi135.stdout: osd map max advance = 10 2024-09-16T15:36:44.396 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-16T15:36:44.396 INFO:teuthology.orchestra.run.smithi135.stdout: journal zero on create = true 2024-09-16T15:36:44.396 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-16T15:36:44.396 INFO:teuthology.orchestra.run.smithi135.stdout: filestore ondisk finisher threads = 3 2024-09-16T15:36:44.396 INFO:teuthology.orchestra.run.smithi135.stdout: filestore apply finisher threads = 3 2024-09-16T15:36:44.396 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-16T15:36:44.396 INFO:teuthology.orchestra.run.smithi135.stdout: bdev debug aio = true 2024-09-16T15:36:44.396 INFO:teuthology.orchestra.run.smithi135.stdout: osd debug misdirected ops = true 2024-09-16T15:36:44.396 INFO:teuthology.orchestra.run.smithi135.stdout: bdev async discard = True 2024-09-16T15:36:44.396 INFO:teuthology.orchestra.run.smithi135.stdout: bdev enable discard = True 2024-09-16T15:36:44.396 INFO:teuthology.orchestra.run.smithi135.stdout: bluestore allocator = bitmap 2024-09-16T15:36:44.396 INFO:teuthology.orchestra.run.smithi135.stdout: bluestore block size = 96636764160 2024-09-16T15:36:44.397 INFO:teuthology.orchestra.run.smithi135.stdout: bluestore fsck on mount = True 2024-09-16T15:36:44.397 INFO:teuthology.orchestra.run.smithi135.stdout: debug bluefs = 1/20 2024-09-16T15:36:44.397 INFO:teuthology.orchestra.run.smithi135.stdout: debug bluestore = 1/20 2024-09-16T15:36:44.397 INFO:teuthology.orchestra.run.smithi135.stdout: debug ms = 1 2024-09-16T15:36:44.397 INFO:teuthology.orchestra.run.smithi135.stdout: debug osd = 20 2024-09-16T15:36:44.397 INFO:teuthology.orchestra.run.smithi135.stdout: debug rocksdb = 4/10 2024-09-16T15:36:44.397 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd backfillfull_ratio = 0.85 2024-09-16T15:36:44.397 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd full ratio = 0.9 2024-09-16T15:36:44.397 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd nearfull ratio = 0.8 2024-09-16T15:36:44.397 INFO:teuthology.orchestra.run.smithi135.stdout: osd failsafe full ratio = 0.95 2024-09-16T15:36:44.397 INFO:teuthology.orchestra.run.smithi135.stdout: osd objectstore = bluestore 2024-09-16T15:36:44.397 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-16T15:36:44.397 INFO:teuthology.orchestra.run.smithi135.stdout:[mgr] 2024-09-16T15:36:44.398 INFO:teuthology.orchestra.run.smithi135.stdout: debug ms = 1 2024-09-16T15:36:44.398 INFO:teuthology.orchestra.run.smithi135.stdout: debug mgr = 20 2024-09-16T15:36:44.398 INFO:teuthology.orchestra.run.smithi135.stdout: debug mon = 20 2024-09-16T15:36:44.398 INFO:teuthology.orchestra.run.smithi135.stdout: debug auth = 20 2024-09-16T15:36:44.398 INFO:teuthology.orchestra.run.smithi135.stdout: mon reweight min pgs per osd = 4 2024-09-16T15:36:44.398 INFO:teuthology.orchestra.run.smithi135.stdout: mon reweight min bytes per osd = 10 2024-09-16T15:36:44.398 INFO:teuthology.orchestra.run.smithi135.stdout: mgr/telemetry/nag = false 2024-09-16T15:36:44.398 INFO:teuthology.orchestra.run.smithi135.stdout: client mount timeout = 30 2024-09-16T15:36:44.398 INFO:teuthology.orchestra.run.smithi135.stdout: debug client = 20 2024-09-16T15:36:44.398 INFO:teuthology.orchestra.run.smithi135.stdout: debug finisher = 20 2024-09-16T15:36:44.398 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-16T15:36:44.398 INFO:teuthology.orchestra.run.smithi135.stdout:[mon] 2024-09-16T15:36:44.398 INFO:teuthology.orchestra.run.smithi135.stdout: debug ms = 1 2024-09-16T15:36:44.398 INFO:teuthology.orchestra.run.smithi135.stdout: debug mon = 20 2024-09-16T15:36:44.399 INFO:teuthology.orchestra.run.smithi135.stdout: debug paxos = 20 2024-09-16T15:36:44.399 INFO:teuthology.orchestra.run.smithi135.stdout: debug auth = 20 2024-09-16T15:36:44.399 INFO:teuthology.orchestra.run.smithi135.stdout: mon data avail warn = 5 2024-09-16T15:36:44.399 INFO:teuthology.orchestra.run.smithi135.stdout: mon mgr mkfs grace = 240 2024-09-16T15:36:44.399 INFO:teuthology.orchestra.run.smithi135.stdout: mon reweight min pgs per osd = 4 2024-09-16T15:36:44.399 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd reporter subtree level = osd 2024-09-16T15:36:44.399 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd prime pg temp = true 2024-09-16T15:36:44.399 INFO:teuthology.orchestra.run.smithi135.stdout: mon reweight min bytes per osd = 10 2024-09-16T15:36:44.399 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-16T15:36:44.399 INFO:teuthology.orchestra.run.smithi135.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-16T15:36:44.399 INFO:teuthology.orchestra.run.smithi135.stdout: auth mon ticket ttl = 660 # 11m 2024-09-16T15:36:44.399 INFO:teuthology.orchestra.run.smithi135.stdout: auth service ticket ttl = 240 # 4m 2024-09-16T15:36:44.399 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-16T15:36:44.400 INFO:teuthology.orchestra.run.smithi135.stdout: # don't complain about insecure global_id in the test suite 2024-09-16T15:36:44.400 INFO:teuthology.orchestra.run.smithi135.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-16T15:36:44.400 INFO:teuthology.orchestra.run.smithi135.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-16T15:36:44.400 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-16T15:36:44.400 INFO:teuthology.orchestra.run.smithi135.stdout: # 1m isn't quite enough 2024-09-16T15:36:44.400 INFO:teuthology.orchestra.run.smithi135.stdout: mon_down_mkfs_grace = 2m 2024-09-16T15:36:44.400 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-16T15:36:44.400 INFO:teuthology.orchestra.run.smithi135.stdout: mon_warn_on_filestore_osds = false 2024-09-16T15:36:44.400 INFO:teuthology.orchestra.run.smithi135.stdout: mon down mkfs grace = 300 2024-09-16T15:36:44.400 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-16T15:36:44.400 INFO:teuthology.orchestra.run.smithi135.stdout:[client] 2024-09-16T15:36:44.400 INFO:teuthology.orchestra.run.smithi135.stdout: rgw cache enabled = true 2024-09-16T15:36:44.400 INFO:teuthology.orchestra.run.smithi135.stdout: rgw enable ops log = true 2024-09-16T15:36:44.401 INFO:teuthology.orchestra.run.smithi135.stdout: rgw enable usage log = true 2024-09-16T15:36:44.401 INFO:teuthology.orchestra.run.smithi135.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-16T15:36:44.401 INFO:teuthology.orchestra.run.smithi135.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-16T15:36:44.401 INFO:teuthology.orchestra.run.smithi135.stdout: pid file = "" 2024-09-16T15:36:44.401 INFO:teuthology.orchestra.run.smithi135.stdout:[mon.a] 2024-09-16T15:36:44.401 INFO:teuthology.orchestra.run.smithi135.stdout:[mon.b] 2024-09-16T15:36:44.401 INFO:teuthology.orchestra.run.smithi135.stdout:[mon.c] 2024-09-16T15:36:44.401 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.a] 2024-09-16T15:36:44.401 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.c] 2024-09-16T15:36:44.401 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.b] 2024-09-16T15:36:44.401 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.d] 2024-09-16T15:36:44.403 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-16T15:36:44.403 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-16T15:36:44.498 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-16T15:36:44.498 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-16T15:36:44.498 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-16T15:36:44.513 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-16T15:36:44.513 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-16T15:36:44.569 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi098.front.sepia.ceph.com 2024-09-16T15:36:44.569 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-16T15:36:44.569 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-16T15:36:44.569 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-16T15:36:44.642 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-16T15:36:44.642 DEBUG:teuthology.orchestra.run.smithi098:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-16T15:36:44.698 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi135.front.sepia.ceph.com 2024-09-16T15:36:44.698 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-16T15:36:44.698 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-16T15:36:44.698 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-16T15:36:44.733 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-16T15:36:44.733 DEBUG:teuthology.orchestra.run.smithi135:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-16T15:36:44.789 INFO:tasks.ceph:Setting up mon nodes... 2024-09-16T15:36:44.789 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-16T15:36:44.789 DEBUG:teuthology.orchestra.run.smithi098:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-16T15:36:44.840 INFO:teuthology.orchestra.run.smithi098.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-16T15:36:44.842 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-16T15:36:44.903 INFO:teuthology.orchestra.run.smithi135.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-16T15:36:44.906 INFO:tasks.ceph:Setting up mds nodes... 2024-09-16T15:36:44.906 DEBUG:teuthology.orchestra.run.smithi098:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-16T15:36:44.957 INFO:teuthology.orchestra.run.smithi098.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-16T15:36:44.959 DEBUG:teuthology.orchestra.run.smithi098:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-16T15:36:44.983 DEBUG:teuthology.orchestra.run.smithi098:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-16T15:36:45.074 INFO:teuthology.orchestra.run.smithi098.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-16T15:36:45.076 DEBUG:teuthology.orchestra.run.smithi098:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-16T15:36:45.101 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-16T15:36:45.152 INFO:teuthology.orchestra.run.smithi135.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-16T15:36:45.154 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-16T15:36:45.179 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-16T15:36:45.270 INFO:teuthology.orchestra.run.smithi135.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-16T15:36:45.273 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-16T15:36:45.297 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-16T15:36:45.297 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-16T15:36:45.338 INFO:teuthology.orchestra.run.smithi098.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-16T15:36:45.351 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-09-16T15:36:45.431 INFO:teuthology.orchestra.run.smithi098.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-09-16T15:36:45.443 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-16T15:36:45.484 INFO:teuthology.orchestra.run.smithi135.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-16T15:36:45.497 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-09-16T15:36:45.578 INFO:teuthology.orchestra.run.smithi135.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-09-16T15:36:45.590 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-16T15:36:45.590 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi098.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi135.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-16T15:36:45.590 DEBUG:teuthology.orchestra.run.smithi098:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-16T15:36:45.615 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-16T15:36:45.615 INFO:tasks.ceph:role: osd.0 2024-09-16T15:36:45.615 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi098.front.sepia.ceph.com 2024-09-16T15:36:45.616 DEBUG:teuthology.orchestra.run.smithi098:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-16T15:36:45.687 INFO:teuthology.orchestra.run.smithi098.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T15:36:45.687 INFO:teuthology.orchestra.run.smithi098.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T15:36:45.687 INFO:teuthology.orchestra.run.smithi098.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T15:36:45.687 INFO:teuthology.orchestra.run.smithi098.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-16T15:36:45.687 INFO:teuthology.orchestra.run.smithi098.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T15:36:45.687 INFO:teuthology.orchestra.run.smithi098.stdout: = sunit=0 swidth=0 blks 2024-09-16T15:36:45.687 INFO:teuthology.orchestra.run.smithi098.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T15:36:45.688 INFO:teuthology.orchestra.run.smithi098.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-16T15:36:45.688 INFO:teuthology.orchestra.run.smithi098.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T15:36:45.688 INFO:teuthology.orchestra.run.smithi098.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T15:36:46.178 INFO:teuthology.orchestra.run.smithi098.stdout:Discarding blocks...Done. 2024-09-16T15:36:46.180 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi098.front.sepia.ceph.com -o noatime 2024-09-16T15:36:46.180 DEBUG:teuthology.orchestra.run.smithi098:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-16T15:36:46.290 DEBUG:teuthology.orchestra.run.smithi098:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-16T15:36:46.323 DEBUG:teuthology.orchestra.run.smithi098:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-16T15:36:46.388 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-16T15:36:46.388 INFO:tasks.ceph:role: osd.1 2024-09-16T15:36:46.388 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi098.front.sepia.ceph.com 2024-09-16T15:36:46.389 DEBUG:teuthology.orchestra.run.smithi098:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-16T15:36:46.461 INFO:teuthology.orchestra.run.smithi098.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T15:36:46.461 INFO:teuthology.orchestra.run.smithi098.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T15:36:46.461 INFO:teuthology.orchestra.run.smithi098.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T15:36:46.461 INFO:teuthology.orchestra.run.smithi098.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-16T15:36:46.461 INFO:teuthology.orchestra.run.smithi098.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T15:36:46.461 INFO:teuthology.orchestra.run.smithi098.stdout: = sunit=0 swidth=0 blks 2024-09-16T15:36:46.461 INFO:teuthology.orchestra.run.smithi098.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T15:36:46.461 INFO:teuthology.orchestra.run.smithi098.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-16T15:36:46.461 INFO:teuthology.orchestra.run.smithi098.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T15:36:46.461 INFO:teuthology.orchestra.run.smithi098.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T15:36:46.931 INFO:teuthology.orchestra.run.smithi098.stdout:Discarding blocks...Done. 2024-09-16T15:36:46.933 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi098.front.sepia.ceph.com -o noatime 2024-09-16T15:36:46.933 DEBUG:teuthology.orchestra.run.smithi098:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-16T15:36:47.007 DEBUG:teuthology.orchestra.run.smithi098:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-16T15:36:47.078 DEBUG:teuthology.orchestra.run.smithi098:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-16T15:36:47.144 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-16T15:36:47.144 INFO:tasks.ceph:role: osd.2 2024-09-16T15:36:47.144 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi098.front.sepia.ceph.com 2024-09-16T15:36:47.144 DEBUG:teuthology.orchestra.run.smithi098:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-16T15:36:47.216 INFO:teuthology.orchestra.run.smithi098.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T15:36:47.216 INFO:teuthology.orchestra.run.smithi098.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T15:36:47.217 INFO:teuthology.orchestra.run.smithi098.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T15:36:47.217 INFO:teuthology.orchestra.run.smithi098.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-16T15:36:47.217 INFO:teuthology.orchestra.run.smithi098.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T15:36:47.217 INFO:teuthology.orchestra.run.smithi098.stdout: = sunit=0 swidth=0 blks 2024-09-16T15:36:47.217 INFO:teuthology.orchestra.run.smithi098.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T15:36:47.217 INFO:teuthology.orchestra.run.smithi098.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-16T15:36:47.217 INFO:teuthology.orchestra.run.smithi098.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T15:36:47.217 INFO:teuthology.orchestra.run.smithi098.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T15:36:47.692 INFO:teuthology.orchestra.run.smithi098.stdout:Discarding blocks...Done. 2024-09-16T15:36:47.694 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi098.front.sepia.ceph.com -o noatime 2024-09-16T15:36:47.695 DEBUG:teuthology.orchestra.run.smithi098:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-16T15:36:47.786 DEBUG:teuthology.orchestra.run.smithi098:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-16T15:36:47.817 DEBUG:teuthology.orchestra.run.smithi098:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-16T15:36:47.882 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-16T15:36:47.882 INFO:tasks.ceph:role: osd.3 2024-09-16T15:36:47.882 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi098.front.sepia.ceph.com 2024-09-16T15:36:47.882 DEBUG:teuthology.orchestra.run.smithi098:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-16T15:36:47.955 INFO:teuthology.orchestra.run.smithi098.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T15:36:47.955 INFO:teuthology.orchestra.run.smithi098.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T15:36:47.955 INFO:teuthology.orchestra.run.smithi098.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T15:36:47.955 INFO:teuthology.orchestra.run.smithi098.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-16T15:36:47.955 INFO:teuthology.orchestra.run.smithi098.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T15:36:47.956 INFO:teuthology.orchestra.run.smithi098.stdout: = sunit=0 swidth=0 blks 2024-09-16T15:36:47.956 INFO:teuthology.orchestra.run.smithi098.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T15:36:47.956 INFO:teuthology.orchestra.run.smithi098.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-16T15:36:47.956 INFO:teuthology.orchestra.run.smithi098.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T15:36:47.956 INFO:teuthology.orchestra.run.smithi098.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T15:36:48.458 INFO:teuthology.orchestra.run.smithi098.stdout:Discarding blocks...Done. 2024-09-16T15:36:48.460 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi098.front.sepia.ceph.com -o noatime 2024-09-16T15:36:48.460 DEBUG:teuthology.orchestra.run.smithi098:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-16T15:36:48.601 DEBUG:teuthology.orchestra.run.smithi098:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-16T15:36:48.633 DEBUG:teuthology.orchestra.run.smithi098:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T15:36:48.747 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:36:48.747+0000 7f6e10a13640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-16T15:36:48.749 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:36:48.748+0000 7f6e10a13640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-16T15:36:48.749 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:36:48.748+0000 7f6e10a13640 -1 bdev(0x55bc6f487800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-16T15:36:48.749 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:36:48.748+0000 7f6e10a13640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-16T15:36:51.657 DEBUG:teuthology.orchestra.run.smithi098:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-16T15:36:51.687 DEBUG:teuthology.orchestra.run.smithi098:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T15:36:51.777 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:36:51.776+0000 7f119129c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-16T15:36:51.778 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:36:51.776+0000 7f119129c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-16T15:36:51.778 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:36:51.777+0000 7f119129c640 -1 bdev(0x55bcc1177800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-16T15:36:51.778 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:36:51.777+0000 7f119129c640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-16T15:36:54.693 DEBUG:teuthology.orchestra.run.smithi098:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-16T15:36:54.718 DEBUG:teuthology.orchestra.run.smithi098:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T15:36:54.804 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:36:54.803+0000 7fb278732640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-16T15:36:54.804 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:36:54.803+0000 7fb278732640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-16T15:36:54.804 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:36:54.803+0000 7fb278732640 -1 bdev(0x55af218d7800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-16T15:36:54.804 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:36:54.803+0000 7fb278732640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-16T15:36:57.968 DEBUG:teuthology.orchestra.run.smithi098:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-16T15:36:57.996 DEBUG:teuthology.orchestra.run.smithi098:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T15:36:58.088 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:36:58.087+0000 7fdd13218640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-16T15:36:58.088 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:36:58.088+0000 7fdd13218640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-16T15:36:58.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:36:58.088+0000 7fdd13218640 -1 bdev(0x55c707c29800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-16T15:36:58.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:36:58.088+0000 7fdd13218640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-16T15:37:00.998 DEBUG:teuthology.orchestra.run.smithi098:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-16T15:37:01.028 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-16T15:37:01.058 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-16T15:37:01.058 INFO:tasks.ceph:role: osd.4 2024-09-16T15:37:01.058 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi135.front.sepia.ceph.com 2024-09-16T15:37:01.058 DEBUG:teuthology.orchestra.run.smithi135:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-16T15:37:01.135 INFO:teuthology.orchestra.run.smithi135.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T15:37:01.135 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T15:37:01.135 INFO:teuthology.orchestra.run.smithi135.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T15:37:01.135 INFO:teuthology.orchestra.run.smithi135.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-16T15:37:01.135 INFO:teuthology.orchestra.run.smithi135.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T15:37:01.135 INFO:teuthology.orchestra.run.smithi135.stdout: = sunit=0 swidth=0 blks 2024-09-16T15:37:01.135 INFO:teuthology.orchestra.run.smithi135.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T15:37:01.135 INFO:teuthology.orchestra.run.smithi135.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-16T15:37:01.136 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T15:37:01.136 INFO:teuthology.orchestra.run.smithi135.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T15:37:01.639 INFO:teuthology.orchestra.run.smithi135.stdout:Discarding blocks...Done. 2024-09-16T15:37:01.641 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi135.front.sepia.ceph.com -o noatime 2024-09-16T15:37:01.641 DEBUG:teuthology.orchestra.run.smithi135:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-16T15:37:01.754 DEBUG:teuthology.orchestra.run.smithi135:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-16T15:37:01.789 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-16T15:37:01.855 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-16T15:37:01.855 INFO:tasks.ceph:role: osd.5 2024-09-16T15:37:01.855 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi135.front.sepia.ceph.com 2024-09-16T15:37:01.855 DEBUG:teuthology.orchestra.run.smithi135:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-16T15:37:01.928 INFO:teuthology.orchestra.run.smithi135.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T15:37:01.928 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T15:37:01.928 INFO:teuthology.orchestra.run.smithi135.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T15:37:01.928 INFO:teuthology.orchestra.run.smithi135.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-16T15:37:01.928 INFO:teuthology.orchestra.run.smithi135.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T15:37:01.928 INFO:teuthology.orchestra.run.smithi135.stdout: = sunit=0 swidth=0 blks 2024-09-16T15:37:01.929 INFO:teuthology.orchestra.run.smithi135.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T15:37:01.929 INFO:teuthology.orchestra.run.smithi135.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-16T15:37:01.929 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T15:37:01.929 INFO:teuthology.orchestra.run.smithi135.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T15:37:02.387 INFO:teuthology.orchestra.run.smithi135.stdout:Discarding blocks...Done. 2024-09-16T15:37:02.389 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi135.front.sepia.ceph.com -o noatime 2024-09-16T15:37:02.390 DEBUG:teuthology.orchestra.run.smithi135:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-16T15:37:02.474 DEBUG:teuthology.orchestra.run.smithi135:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-16T15:37:02.543 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-16T15:37:02.608 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-16T15:37:02.608 INFO:tasks.ceph:role: osd.6 2024-09-16T15:37:02.608 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi135.front.sepia.ceph.com 2024-09-16T15:37:02.609 DEBUG:teuthology.orchestra.run.smithi135:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-16T15:37:02.680 INFO:teuthology.orchestra.run.smithi135.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T15:37:02.680 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T15:37:02.680 INFO:teuthology.orchestra.run.smithi135.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T15:37:02.680 INFO:teuthology.orchestra.run.smithi135.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-16T15:37:02.680 INFO:teuthology.orchestra.run.smithi135.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T15:37:02.680 INFO:teuthology.orchestra.run.smithi135.stdout: = sunit=0 swidth=0 blks 2024-09-16T15:37:02.680 INFO:teuthology.orchestra.run.smithi135.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T15:37:02.680 INFO:teuthology.orchestra.run.smithi135.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-16T15:37:02.680 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T15:37:02.681 INFO:teuthology.orchestra.run.smithi135.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T15:37:03.208 INFO:teuthology.orchestra.run.smithi135.stdout:Discarding blocks...Done. 2024-09-16T15:37:03.210 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi135.front.sepia.ceph.com -o noatime 2024-09-16T15:37:03.210 DEBUG:teuthology.orchestra.run.smithi135:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-16T15:37:03.328 DEBUG:teuthology.orchestra.run.smithi135:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-16T15:37:03.358 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-16T15:37:03.423 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-16T15:37:03.423 INFO:tasks.ceph:role: osd.7 2024-09-16T15:37:03.423 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi135.front.sepia.ceph.com 2024-09-16T15:37:03.423 DEBUG:teuthology.orchestra.run.smithi135:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-16T15:37:03.495 INFO:teuthology.orchestra.run.smithi135.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T15:37:03.495 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T15:37:03.496 INFO:teuthology.orchestra.run.smithi135.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T15:37:03.496 INFO:teuthology.orchestra.run.smithi135.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-16T15:37:03.496 INFO:teuthology.orchestra.run.smithi135.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T15:37:03.496 INFO:teuthology.orchestra.run.smithi135.stdout: = sunit=0 swidth=0 blks 2024-09-16T15:37:03.496 INFO:teuthology.orchestra.run.smithi135.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T15:37:03.496 INFO:teuthology.orchestra.run.smithi135.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-16T15:37:03.496 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T15:37:03.496 INFO:teuthology.orchestra.run.smithi135.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T15:37:03.986 INFO:teuthology.orchestra.run.smithi135.stdout:Discarding blocks...Done. 2024-09-16T15:37:03.988 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi135.front.sepia.ceph.com -o noatime 2024-09-16T15:37:03.989 DEBUG:teuthology.orchestra.run.smithi135:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-16T15:37:04.110 DEBUG:teuthology.orchestra.run.smithi135:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-16T15:37:04.144 DEBUG:teuthology.orchestra.run.smithi135:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T15:37:04.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:04.237+0000 7ffa716f1640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-16T15:37:04.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:04.237+0000 7ffa716f1640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-16T15:37:04.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:04.237+0000 7ffa716f1640 -1 bdev(0x557b414fb800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-16T15:37:04.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:04.238+0000 7ffa716f1640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-16T15:37:07.387 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-16T15:37:07.415 DEBUG:teuthology.orchestra.run.smithi135:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T15:37:07.506 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:07.504+0000 7f78bb618640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-16T15:37:07.506 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:07.504+0000 7f78bb618640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-16T15:37:07.506 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:07.504+0000 7f78bb618640 -1 bdev(0x5613f8df5800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-16T15:37:07.506 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:07.505+0000 7f78bb618640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-16T15:37:10.901 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-16T15:37:10.928 DEBUG:teuthology.orchestra.run.smithi135:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T15:37:11.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:11.014+0000 7fd8c8a0d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-16T15:37:11.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:11.015+0000 7fd8c8a0d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-16T15:37:11.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:11.015+0000 7fd8c8a0d640 -1 bdev(0x5578c38cb800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-16T15:37:11.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:11.015+0000 7fd8c8a0d640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-16T15:37:12.415 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T15:37:12.419 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T15:37:13.921 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-16T15:37:13.948 DEBUG:teuthology.orchestra.run.smithi135:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T15:37:14.035 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:14.033+0000 7f97a6eeb640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-16T15:37:14.035 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:14.034+0000 7f97a6eeb640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-16T15:37:14.035 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:14.034+0000 7f97a6eeb640 -1 bdev(0x55935f27f800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-16T15:37:14.035 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:14.034+0000 7f97a6eeb640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-16T15:37:17.442 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-16T15:37:17.470 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-16T15:37:17.471 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-16T15:37:17.471 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-16T15:37:17.500 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-16T15:37:17.500 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-16T15:37:17.568 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-16T15:37:17.569 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-16T15:37:17.636 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-16T15:37:17.636 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-16T15:37:17.703 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-16T15:37:17.703 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-16T15:37:17.769 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-16T15:37:17.769 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-16T15:37:17.835 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-16T15:37:17.835 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-16T15:37:17.899 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-16T15:37:17.899 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-16T15:37:17.929 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-16T15:37:17.929 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-16T15:37:17.997 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-16T15:37:17.997 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-16T15:37:18.065 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-16T15:37:18.065 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-16T15:37:18.131 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-16T15:37:18.131 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-16T15:37:18.198 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-16T15:37:18.198 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-16T15:37:18.263 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-16T15:37:18.263 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-16T15:37:18.329 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-16T15:37:18.329 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-16T15:37:18.345 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-16T15:37:18.345 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-09-16T15:37:18.400 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-16T15:37:18.400 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-16T15:37:18.415 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-16T15:37:18.415 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-09-16T15:37:18.471 INFO:tasks.ceph:Adding keys to all mons... 2024-09-16T15:37:18.471 DEBUG:teuthology.orchestra.run.smithi098:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-16T15:37:18.473 DEBUG:teuthology.orchestra.run.smithi135:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-16T15:37:18.514 INFO:teuthology.orchestra.run.smithi098.stdout:[mgr.y] 2024-09-16T15:37:18.514 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQCMUOhmulMTMhAAFw74sprswWnX8sJCf58Opw== 2024-09-16T15:37:18.514 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.a] 2024-09-16T15:37:18.514 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQCMUOhmkTQKORAAZi8qcnJ6e57exdaFWPN1QA== 2024-09-16T15:37:18.514 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.c] 2024-09-16T15:37:18.514 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQCNUOhmOJ1rBBAASEumP033msjxcNvGJG5Siw== 2024-09-16T15:37:18.514 INFO:teuthology.orchestra.run.smithi098.stdout:[osd.0] 2024-09-16T15:37:18.515 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQCQUOhmHu2QLBAAPVPtMpG5B3zZxnuq4DpMVQ== 2024-09-16T15:37:18.515 INFO:teuthology.orchestra.run.smithi098.stdout:[osd.1] 2024-09-16T15:37:18.515 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQCTUOhmU+pSLhAALgsA/Y5p4gmq770Zbu+uDw== 2024-09-16T15:37:18.515 INFO:teuthology.orchestra.run.smithi098.stdout:[osd.2] 2024-09-16T15:37:18.515 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQCWUOhm/+bmLxAAc8wUBWIaqb+p6peuujpQlQ== 2024-09-16T15:37:18.515 INFO:teuthology.orchestra.run.smithi098.stdout:[osd.3] 2024-09-16T15:37:18.515 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQCaUOhmKBdDBRAAKSNaZgD5EWOtiDrxCxHJTA== 2024-09-16T15:37:18.515 INFO:teuthology.orchestra.run.smithi098.stdout:[mgr.x] 2024-09-16T15:37:18.515 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQCMUOhmUZHdNRAAZBWh9sMBY5e3h+JKzChbUA== 2024-09-16T15:37:18.515 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.b] 2024-09-16T15:37:18.515 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQCNUOhminwOCRAAmz2Mt2RS2IKnruB12U9mVA== 2024-09-16T15:37:18.515 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.d] 2024-09-16T15:37:18.515 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQCNUOhmLKkZEBAA4TrNTOyyoA8q5O4LgwCmxg== 2024-09-16T15:37:18.515 INFO:teuthology.orchestra.run.smithi098.stdout:[osd.4] 2024-09-16T15:37:18.516 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQCgUOhm4/U2DhAAaxH/dR03udDCOLBwhxLnaw== 2024-09-16T15:37:18.516 INFO:teuthology.orchestra.run.smithi098.stdout:[osd.5] 2024-09-16T15:37:18.516 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQCjUOhmpf8fHhAAuQR+fMwdlXbNDU6GH/90ZA== 2024-09-16T15:37:18.516 INFO:teuthology.orchestra.run.smithi098.stdout:[osd.6] 2024-09-16T15:37:18.516 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQCnUOhm6v7uABAAyY9B6iGGQDseicwWMkOfeA== 2024-09-16T15:37:18.516 INFO:teuthology.orchestra.run.smithi098.stdout:[osd.7] 2024-09-16T15:37:18.516 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQCqUOhmfo0QAhAAuhwkDXjYo5BJMNxPrWx0yQ== 2024-09-16T15:37:18.516 INFO:teuthology.orchestra.run.smithi098.stdout:[client.0] 2024-09-16T15:37:18.516 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQCNUOhm6+4tFBAAxdHfj+ZVPqgZXxWTlCBNMg== 2024-09-16T15:37:18.516 INFO:teuthology.orchestra.run.smithi098.stdout:[client.2] 2024-09-16T15:37:18.516 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQCNUOhm5VW0GRAA9qmRFVE7nn29uPoYWC0oHA== 2024-09-16T15:37:18.516 INFO:teuthology.orchestra.run.smithi098.stdout:[client.1] 2024-09-16T15:37:18.516 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQCNUOhmXULiHBAAL5UT/XVWMjFfaIffgDBlGQ== 2024-09-16T15:37:18.516 INFO:teuthology.orchestra.run.smithi098.stdout:[client.3] 2024-09-16T15:37:18.517 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQCNUOhmHd5vIhAAak22Jp8LOK2eYiZiTbZVTg== 2024-09-16T15:37:18.533 INFO:teuthology.orchestra.run.smithi135.stdout:[mgr.y] 2024-09-16T15:37:18.533 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQCMUOhmulMTMhAAFw74sprswWnX8sJCf58Opw== 2024-09-16T15:37:18.533 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.a] 2024-09-16T15:37:18.534 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQCMUOhmkTQKORAAZi8qcnJ6e57exdaFWPN1QA== 2024-09-16T15:37:18.534 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.c] 2024-09-16T15:37:18.534 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQCNUOhmOJ1rBBAASEumP033msjxcNvGJG5Siw== 2024-09-16T15:37:18.534 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.0] 2024-09-16T15:37:18.534 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQCQUOhmHu2QLBAAPVPtMpG5B3zZxnuq4DpMVQ== 2024-09-16T15:37:18.534 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.1] 2024-09-16T15:37:18.534 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQCTUOhmU+pSLhAALgsA/Y5p4gmq770Zbu+uDw== 2024-09-16T15:37:18.534 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.2] 2024-09-16T15:37:18.534 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQCWUOhm/+bmLxAAc8wUBWIaqb+p6peuujpQlQ== 2024-09-16T15:37:18.534 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.3] 2024-09-16T15:37:18.534 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQCaUOhmKBdDBRAAKSNaZgD5EWOtiDrxCxHJTA== 2024-09-16T15:37:18.534 INFO:teuthology.orchestra.run.smithi135.stdout:[mgr.x] 2024-09-16T15:37:18.535 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQCMUOhmUZHdNRAAZBWh9sMBY5e3h+JKzChbUA== 2024-09-16T15:37:18.535 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.b] 2024-09-16T15:37:18.535 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQCNUOhminwOCRAAmz2Mt2RS2IKnruB12U9mVA== 2024-09-16T15:37:18.535 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.d] 2024-09-16T15:37:18.535 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQCNUOhmLKkZEBAA4TrNTOyyoA8q5O4LgwCmxg== 2024-09-16T15:37:18.535 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.4] 2024-09-16T15:37:18.535 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQCgUOhm4/U2DhAAaxH/dR03udDCOLBwhxLnaw== 2024-09-16T15:37:18.535 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.5] 2024-09-16T15:37:18.535 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQCjUOhmpf8fHhAAuQR+fMwdlXbNDU6GH/90ZA== 2024-09-16T15:37:18.535 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.6] 2024-09-16T15:37:18.535 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQCnUOhm6v7uABAAyY9B6iGGQDseicwWMkOfeA== 2024-09-16T15:37:18.535 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.7] 2024-09-16T15:37:18.535 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQCqUOhmfo0QAhAAuhwkDXjYo5BJMNxPrWx0yQ== 2024-09-16T15:37:18.535 INFO:teuthology.orchestra.run.smithi135.stdout:[client.0] 2024-09-16T15:37:18.535 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQCNUOhm6+4tFBAAxdHfj+ZVPqgZXxWTlCBNMg== 2024-09-16T15:37:18.535 INFO:teuthology.orchestra.run.smithi135.stdout:[client.2] 2024-09-16T15:37:18.536 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQCNUOhm5VW0GRAA9qmRFVE7nn29uPoYWC0oHA== 2024-09-16T15:37:18.536 INFO:teuthology.orchestra.run.smithi135.stdout:[client.1] 2024-09-16T15:37:18.536 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQCNUOhmXULiHBAAL5UT/XVWMjFfaIffgDBlGQ== 2024-09-16T15:37:18.536 INFO:teuthology.orchestra.run.smithi135.stdout:[client.3] 2024-09-16T15:37:18.536 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQCNUOhmHd5vIhAAak22Jp8LOK2eYiZiTbZVTg== 2024-09-16T15:37:18.537 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-16T15:37:18.560 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-16T15:37:18.628 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-16T15:37:18.630 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-16T15:37:18.684 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-16T15:37:18.687 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-16T15:37:18.740 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T15:37:18.743 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T15:37:18.794 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T15:37:18.797 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T15:37:18.849 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T15:37:18.851 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T15:37:18.902 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T15:37:18.904 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T15:37:18.955 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-16T15:37:18.957 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-16T15:37:19.007 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-16T15:37:19.010 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-16T15:37:19.064 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-16T15:37:19.066 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-16T15:37:19.120 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T15:37:19.122 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T15:37:19.173 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T15:37:19.176 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T15:37:19.226 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T15:37:19.229 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T15:37:19.280 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T15:37:19.282 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T15:37:19.333 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-16T15:37:19.335 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-16T15:37:19.390 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-16T15:37:19.392 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-16T15:37:19.446 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-16T15:37:19.449 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-16T15:37:19.503 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-16T15:37:19.505 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-16T15:37:19.559 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-16T15:37:19.559 DEBUG:teuthology.orchestra.run.smithi098:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-16T15:37:19.583 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-16T15:37:19.679 DEBUG:teuthology.orchestra.run.smithi098:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-16T15:37:19.704 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-16T15:37:19.729 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-16T15:37:19.825 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-16T15:37:19.849 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-16T15:37:19.915 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-16T15:37:20.011 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-16T15:37:20.036 DEBUG:teuthology.orchestra.run.smithi098:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-16T15:37:20.039 DEBUG:teuthology.orchestra.run.smithi135:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-16T15:37:20.091 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-16T15:37:20.091 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-16T15:37:20.091 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-16T15:37:20.094 INFO:tasks.ceph.mon.a:Started 2024-09-16T15:37:20.094 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-16T15:37:20.094 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-16T15:37:20.133 INFO:tasks.ceph.mon.b:Started 2024-09-16T15:37:20.133 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-16T15:37:20.133 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-16T15:37:20.135 INFO:tasks.ceph.mon.c:Started 2024-09-16T15:37:20.135 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-16T15:37:20.136 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-16T15:37:20.136 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-16T15:37:20.138 INFO:tasks.ceph.mgr.y:Started 2024-09-16T15:37:20.138 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-16T15:37:20.138 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-16T15:37:20.140 INFO:tasks.ceph.mgr.x:Started 2024-09-16T15:37:20.140 INFO:tasks.ceph:setting config [client] client_mount_timeout = 600 2024-09-16T15:37:20.141 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --cluster ceph config set client client_mount_timeout 600 2024-09-16T15:37:20.143 INFO:tasks.ceph:setting config [client] debug_client = 20 2024-09-16T15:37:20.143 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --cluster ceph config set client debug_client 20 2024-09-16T15:37:20.185 INFO:tasks.ceph:setting config [client] debug_ms = 1 2024-09-16T15:37:20.185 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --cluster ceph config set client debug_ms 1 2024-09-16T15:37:20.229 INFO:tasks.ceph:setting config [client] rados_mon_op_timeout = 900 2024-09-16T15:37:20.229 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --cluster ceph config set client rados_mon_op_timeout 900 2024-09-16T15:37:20.272 INFO:tasks.ceph:setting config [client] rados_osd_op_timeout = 900 2024-09-16T15:37:20.273 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --cluster ceph config set client rados_osd_op_timeout 900 2024-09-16T15:37:20.315 INFO:tasks.ceph:setting config [mds] debug_mds = 20 2024-09-16T15:37:20.315 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --cluster ceph config set mds debug_mds 20 2024-09-16T15:37:20.359 INFO:tasks.ceph:setting config [mds] debug_mds_balancer = 20 2024-09-16T15:37:20.360 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --cluster ceph config set mds debug_mds_balancer 20 2024-09-16T15:37:20.403 INFO:tasks.ceph:setting config [mds] debug_ms = 2 2024-09-16T15:37:20.403 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --cluster ceph config set mds debug_ms 2 2024-09-16T15:37:20.450 INFO:tasks.ceph:setting config [mds] mds_debug_frag = True 2024-09-16T15:37:20.450 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --cluster ceph config set mds mds_debug_frag True 2024-09-16T15:37:20.497 INFO:tasks.ceph:setting config [mds] mds_debug_scatterstat = True 2024-09-16T15:37:20.497 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --cluster ceph config set mds mds_debug_scatterstat True 2024-09-16T15:37:20.544 INFO:tasks.ceph:setting config [mds] mds_op_complaint_time = 180 2024-09-16T15:37:20.544 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --cluster ceph config set mds mds_op_complaint_time 180 2024-09-16T15:37:20.567 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.566+0000 7f82897fa640 1 -- 172.21.15.98:0/1506422055 <== mon.2 v2:172.21.15.135:3301/0 9 ==== config(3 keys) ==== 79+0+0 (secure 0 0 0) 0x7f828002fcd0 con 0x7f827c003c30 2024-09-16T15:37:20.567 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.565+0000 7f3e91ffb640 1 -- 172.21.15.98:0/2787631500 <== mon.1 v2:172.21.15.135:3300/0 9 ==== config(3 keys) ==== 79+0+0 (secure 0 0 0) 0x7f3e98011d40 con 0x7f3e9c06d280 2024-09-16T15:37:20.568 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.567+0000 7f82897fa640 1 -- 172.21.15.98:0/1506422055 <== mon.2 v2:172.21.15.135:3301/0 10 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v4)=0 v4) ==== 114+0+0 (secure 0 0 0) 0x7f8280045430 con 0x7f827c003c30 2024-09-16T15:37:20.568 INFO:tasks.ceph:setting config [mds] mds_verify_scatter = True 2024-09-16T15:37:20.568 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --cluster ceph config set mds mds_verify_scatter True 2024-09-16T15:37:20.569 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.567+0000 7f655dffb640 1 -- 172.21.15.98:0/687773787 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f65780ca660 msgr2=0x7f65780cab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:20.569 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.567+0000 7f655dffb640 1 --2- 172.21.15.98:0/687773787 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f65780ca660 0x7f65780cab10 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f65780cca30 tx=0x7f65700067a0 comp rx=0 tx=0).stop 2024-09-16T15:37:20.570 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.567+0000 7f53dd7fa640 1 -- 172.21.15.98:0/2193646213 <== mon.0 v2:172.21.15.98:3300/0 9 ==== config(3 keys) ==== 79+0+0 (secure 0 0 0) 0x7f53d8007810 con 0x7f53c8003a50 2024-09-16T15:37:20.570 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.568+0000 7f655dffb640 1 -- 172.21.15.98:0/687773787 shutdown_connections 2024-09-16T15:37:20.570 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.568+0000 7f655dffb640 1 --2- 172.21.15.98:0/687773787 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f65780ca660 0x7f65780cab10 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:20.570 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.568+0000 7f655dffb640 1 --2- 172.21.15.98:0/687773787 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f657815b590 0x7f65780c0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:20.571 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.568+0000 7f655dffb640 1 --2- 172.21.15.98:0/687773787 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6560003c80 0x7f6578153290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:20.571 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.568+0000 7f655dffb640 1 -- 172.21.15.98:0/687773787 >> 172.21.15.98:0/687773787 conn(0x7f65780d0d40 msgr2=0x7f65780d03f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:20.571 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.568+0000 7f8292b45640 1 -- 172.21.15.98:0/1506422055 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f827c003c30 msgr2=0x7f828c0c58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:20.571 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.568+0000 7f8292b45640 1 --2- 172.21.15.98:0/1506422055 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f827c003c30 0x7f828c0c58d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f828002aff0 tx=0x7f8280000fe0 comp rx=0 tx=0).stop 2024-09-16T15:37:20.571 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.568+0000 7f655dffb640 1 -- 172.21.15.98:0/687773787 shutdown_connections 2024-09-16T15:37:20.571 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.568+0000 7f655dffb640 1 -- 172.21.15.98:0/687773787 wait complete. 2024-09-16T15:37:20.572 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.569+0000 7f8292b45640 1 -- 172.21.15.98:0/1506422055 shutdown_connections 2024-09-16T15:37:20.572 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.569+0000 7f8292b45640 1 --2- 172.21.15.98:0/1506422055 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f828c0b3870 0x7f828c0c9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:20.572 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.569+0000 7f8292b45640 1 --2- 172.21.15.98:0/1506422055 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f828c159200 0x7f828c0b3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:20.573 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.569+0000 7f8292b45640 1 --2- 172.21.15.98:0/1506422055 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f827c003c30 0x7f828c0c58d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:20.573 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.569+0000 7f8292b45640 1 -- 172.21.15.98:0/1506422055 >> 172.21.15.98:0/1506422055 conn(0x7f828c0d0500 msgr2=0x7f828c0cd190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:20.573 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.569+0000 7f8292b45640 1 -- 172.21.15.98:0/1506422055 shutdown_connections 2024-09-16T15:37:20.573 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.569+0000 7f8292b45640 1 -- 172.21.15.98:0/1506422055 wait complete. 2024-09-16T15:37:20.574 INFO:tasks.ceph:setting config [mds] osd_op_complaint_time = 180 2024-09-16T15:37:20.574 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --cluster ceph config set mds osd_op_complaint_time 180 2024-09-16T15:37:20.575 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.572+0000 7f3ea39fb640 1 -- 172.21.15.98:0/2787631500 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f3e78005100 con 0x7f3e9c06d280 2024-09-16T15:37:20.581 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.580+0000 7f76db29b640 1 -- 172.21.15.98:0/2746317652 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76d409a790 con 0x7f76d40d0900 2024-09-16T15:37:20.582 INFO:tasks.ceph:setting config [mds] rados_mon_op_timeout = 900 2024-09-16T15:37:20.583 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --cluster ceph config set mds rados_mon_op_timeout 900 2024-09-16T15:37:20.593 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.589+0000 7f3e91ffb640 1 -- 172.21.15.98:0/2787631500 <== mon.1 v2:172.21.15.135:3300/0 10 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f3e98025430 con 0x7f3e9c06d280 2024-09-16T15:37:20.593 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.589+0000 7f3e91ffb640 1 -- 172.21.15.98:0/2787631500 <== mon.1 v2:172.21.15.135:3300/0 11 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v5)=0 v5) ==== 123+0+0 (secure 0 0 0) 0x7f3e980256d0 con 0x7f3e9c06d280 2024-09-16T15:37:20.593 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.591+0000 7f76c9ffb640 1 -- 172.21.15.98:0/2746317652 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f76d409a790 con 0x7f76d40d0900 2024-09-16T15:37:20.594 INFO:tasks.ceph:setting config [mds] rados_osd_op_timeout = 900 2024-09-16T15:37:20.594 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --cluster ceph config set mds rados_osd_op_timeout 900 2024-09-16T15:37:20.595 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.593+0000 7f3ea39fb640 1 -- 172.21.15.98:0/2787631500 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e9c06d280 msgr2=0x7f3e9c1f0b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:20.595 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.593+0000 7f3ea39fb640 1 --2- 172.21.15.98:0/2787631500 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e9c06d280 0x7f3e9c1f0b90 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3e98006f50 tx=0x7f3e98003a80 comp rx=0 tx=0).stop 2024-09-16T15:37:20.595 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.592+0000 7f53dd7fa640 1 -- 172.21.15.98:0/2193646213 <== mon.0 v2:172.21.15.98:3300/0 10 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f53d8041420 con 0x7f53c8003a50 2024-09-16T15:37:20.596 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.593+0000 7f3ea39fb640 1 -- 172.21.15.98:0/2787631500 shutdown_connections 2024-09-16T15:37:20.596 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.593+0000 7f3ea39fb640 1 --2- 172.21.15.98:0/2787631500 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3e9c14b2f0 0x7f3e9c0ca7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:20.596 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.593+0000 7f3ea39fb640 1 --2- 172.21.15.98:0/2787631500 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3e9c14ae70 0x7f3e9c1f4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:20.596 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.593+0000 7f3ea39fb640 1 --2- 172.21.15.98:0/2787631500 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e9c06d280 0x7f3e9c1f0b90 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:20.596 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.593+0000 7f3ea39fb640 1 -- 172.21.15.98:0/2787631500 >> 172.21.15.98:0/2787631500 conn(0x7f3e9c0d0d40 msgr2=0x7f3e9c0b3d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:20.596 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.594+0000 7f3ea39fb640 1 -- 172.21.15.98:0/2787631500 shutdown_connections 2024-09-16T15:37:20.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.594+0000 7f3ea39fb640 1 -- 172.21.15.98:0/2787631500 wait complete. 2024-09-16T15:37:20.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.595+0000 7f76c9ffb640 1 -- 172.21.15.98:0/2746317652 <== mon.0 v2:172.21.15.98:3300/0 7 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f76d0017400 con 0x7f76d40d0900 2024-09-16T15:37:20.622 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.619+0000 7f3009bc8640 1 -- 172.21.15.98:0/3001797098 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f30040cf5a0 msgr2=0x7f300406f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:20.622 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.619+0000 7f3009bc8640 1 --2- 172.21.15.98:0/3001797098 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f30040cf5a0 0x7f300406f840 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f30040d0ac0 tx=0x7f2ff402ea20 comp rx=0 tx=0).stop 2024-09-16T15:37:20.622 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.619+0000 7f3009bc8640 1 -- 172.21.15.98:0/3001797098 shutdown_connections 2024-09-16T15:37:20.622 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.619+0000 7f3009bc8640 1 --2- 172.21.15.98:0/3001797098 >> v2:172.21.15.135:3300/0 conn(0x7f30040ca960 0x7f30040739c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:20.622 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.619+0000 7f3009bc8640 1 --2- 172.21.15.98:0/3001797098 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f30040cf5a0 0x7f300406f840 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:20.622 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.619+0000 7f3009bc8640 1 -- 172.21.15.98:0/3001797098 >> 172.21.15.98:0/3001797098 conn(0x7f30040cf9f0 msgr2=0x7f30040cfe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:20.623 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.619+0000 7f3009bc8640 1 -- 172.21.15.98:0/3001797098 shutdown_connections 2024-09-16T15:37:20.623 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.619+0000 7f3009bc8640 1 -- 172.21.15.98:0/3001797098 wait complete. 2024-09-16T15:37:20.626 INFO:tasks.ceph:setting config [mon] mon_op_complaint_time = 120 2024-09-16T15:37:20.626 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --cluster ceph config set mon mon_op_complaint_time 120 2024-09-16T15:37:20.627 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.621+0000 7f3009bc8640 1 Processor -- start 2024-09-16T15:37:20.627 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.622+0000 7f3009bc8640 1 -- start start 2024-09-16T15:37:20.627 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.623+0000 7f3009bc8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f30040ca960 0x7f30040c37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:20.627 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.623+0000 7f3009bc8640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f30040cd5c0 0x7f30041f9200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:20.627 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.623+0000 7f3009bc8640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f30040cf5a0 0x7f30041f83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:20.627 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.623+0000 7f3009bc8640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f300406e5a0 con 0x7f30040cf5a0 2024-09-16T15:37:20.627 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.623+0000 7f3009bc8640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f30040aed40 con 0x7f30040ca960 2024-09-16T15:37:20.627 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.623+0000 7f3009bc8640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f300406e720 con 0x7f30040cd5c0 2024-09-16T15:37:20.627 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.624+0000 7f3003fff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f30040cd5c0 0x7f30041f9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:20.627 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.624+0000 7f3003fff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f30040cd5c0 0x7f30041f9200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.98:57770/0 (socket says 172.21.15.98:57770) 2024-09-16T15:37:20.628 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.624+0000 7f3003fff640 1 -- 172.21.15.98:0/1808938245 learned_addr learned my addr 172.21.15.98:0/1808938245 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:37:20.628 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.624+0000 7f30093c7640 1 --2- 172.21.15.98:0/1808938245 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f30040cf5a0 0x7f30041f83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:20.628 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.624+0000 7f3008bc6640 1 --2- 172.21.15.98:0/1808938245 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f30040ca960 0x7f30040c37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:20.628 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.624+0000 7f3003fff640 1 -- 172.21.15.98:0/1808938245 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f30040ca960 msgr2=0x7f30040c37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:20.628 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.624+0000 7f3003fff640 1 --2- 172.21.15.98:0/1808938245 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f30040ca960 0x7f30040c37d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:20.628 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.624+0000 7f3003fff640 1 -- 172.21.15.98:0/1808938245 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f30040cf5a0 msgr2=0x7f30041f83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:20.628 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.624+0000 7f3003fff640 1 --2- 172.21.15.98:0/1808938245 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f30040cf5a0 0x7f30041f83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:20.628 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.624+0000 7f3003fff640 1 -- 172.21.15.98:0/1808938245 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30040c55e0 con 0x7f30040cd5c0 2024-09-16T15:37:20.628 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.625+0000 7f30093c7640 1 --2- 172.21.15.98:0/1808938245 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f30040cf5a0 0x7f30041f83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T15:37:20.628 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.625+0000 7f3003fff640 1 --2- 172.21.15.98:0/1808938245 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f30040cd5c0 0x7f30041f9200 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc002230 tx=0x7f2ffc00a4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:20.630 INFO:tasks.ceph:setting config [mon] mon_warn_on_pool_no_app = False 2024-09-16T15:37:20.630 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --cluster ceph config set mon mon_warn_on_pool_no_app False 2024-09-16T15:37:20.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.630+0000 7f30017fa640 1 -- 172.21.15.98:0/1808938245 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ffc016020 con 0x7f30040cd5c0 2024-09-16T15:37:20.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.631+0000 7f3009bc8640 1 -- 172.21.15.98:0/1808938245 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30040c58c0 con 0x7f30040cd5c0 2024-09-16T15:37:20.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.631+0000 7f3009bc8640 1 -- 172.21.15.98:0/1808938245 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f30040c5e80 con 0x7f30040cd5c0 2024-09-16T15:37:20.633 INFO:tasks.ceph:setting config [osd] osd_op_complaint_time = 180 2024-09-16T15:37:20.633 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --cluster ceph config set osd osd_op_complaint_time 180 2024-09-16T15:37:20.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.634+0000 7f30017fa640 1 -- 172.21.15.98:0/1808938245 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f2ffc012620 con 0x7f30040cd5c0 2024-09-16T15:37:20.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.635+0000 7f30017fa640 1 -- 172.21.15.98:0/1808938245 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ffc012a10 con 0x7f30040cd5c0 2024-09-16T15:37:20.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.635+0000 7f30017fa640 1 -- 172.21.15.98:0/1808938245 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2ffc019020 con 0x7f30040cd5c0 2024-09-16T15:37:20.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.635+0000 7f30017fa640 1 -- 172.21.15.98:0/1808938245 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f2ffc0045f0 con 0x7f30040cd5c0 2024-09-16T15:37:20.640 DEBUG:tasks.ceph:set 18 configs 2024-09-16T15:37:20.640 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi098') 2024-09-16T15:37:20.640 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi098') 2024-09-16T15:37:20.641 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi098') 2024-09-16T15:37:20.641 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi098') 2024-09-16T15:37:20.641 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi098') 2024-09-16T15:37:20.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.638+0000 7f3009bc8640 1 -- 172.21.15.98:0/1808938245 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fe4005290 con 0x7f30040cd5c0 2024-09-16T15:37:20.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.645+0000 7f30017fa640 1 -- 172.21.15.98:0/1808938245 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f2ffc020030 con 0x7f30040cd5c0 2024-09-16T15:37:20.650 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.647+0000 7fe46ffff640 1 -- 172.21.15.98:0/4287096870 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe468035860 msgr2=0x7fe468103d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:20.650 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.647+0000 7fe46ffff640 1 --2- 172.21.15.98:0/4287096870 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe468035860 0x7fe468103d50 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe47006bb30 tx=0x7fe470094d60 comp rx=0 tx=0).stop 2024-09-16T15:37:20.650 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.647+0000 7fe46ffff640 1 -- 172.21.15.98:0/4287096870 shutdown_connections 2024-09-16T15:37:20.650 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.647+0000 7fe46ffff640 1 --2- 172.21.15.98:0/4287096870 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe468035860 0x7fe468103d50 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:20.650 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.647+0000 7fe46ffff640 1 -- 172.21.15.98:0/4287096870 >> 172.21.15.98:0/4287096870 conn(0x7fe46801d950 msgr2=0x7fe468054740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:20.650 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.647+0000 7fe46ffff640 1 -- 172.21.15.98:0/4287096870 shutdown_connections 2024-09-16T15:37:20.653 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.647+0000 7fe46ffff640 1 -- 172.21.15.98:0/4287096870 wait complete. 2024-09-16T15:37:20.654 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.649+0000 7fe46ffff640 1 Processor -- start 2024-09-16T15:37:20.654 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.649+0000 7fe46ffff640 1 -- start start 2024-09-16T15:37:20.654 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.651+0000 7fe46ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4680062f0 0x7fe4680f4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:20.654 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.651+0000 7fe46ffff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe468034070 0x7fe4680f65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:20.654 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.651+0000 7fe46ffff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe468035860 0x7fe4680f6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:20.654 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.651+0000 7fe46ffff640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe468052ba0 con 0x7fe468035860 2024-09-16T15:37:20.654 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.651+0000 7fe46ffff640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe468052a20 con 0x7fe4680062f0 2024-09-16T15:37:20.654 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.651+0000 7fe46ffff640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fe468052d20 con 0x7fe468034070 2024-09-16T15:37:20.654 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.651+0000 7fe475352640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe468035860 0x7fe4680f6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:20.654 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.651+0000 7fe475352640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe468035860 0x7fe4680f6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60764/0 (socket says 172.21.15.98:60764) 2024-09-16T15:37:20.654 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.651+0000 7fe475352640 1 -- 172.21.15.98:0/3014183676 learned_addr learned my addr 172.21.15.98:0/3014183676 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:37:20.654 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.652+0000 7fe475352640 1 -- 172.21.15.98:0/3014183676 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe468034070 msgr2=0x7fe4680f65c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-16T15:37:20.654 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.652+0000 7fe475352640 1 --2- 172.21.15.98:0/3014183676 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe468034070 0x7fe4680f65c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:20.655 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.652+0000 7fe475352640 1 -- 172.21.15.98:0/3014183676 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4680062f0 msgr2=0x7fe4680f4810 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-16T15:37:20.655 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.652+0000 7fe475352640 1 --2- 172.21.15.98:0/3014183676 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4680062f0 0x7fe4680f4810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:20.655 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.652+0000 7fe475352640 1 -- 172.21.15.98:0/3014183676 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe46810d870 con 0x7fe468035860 2024-09-16T15:37:20.655 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.652+0000 7fe475352640 1 --2- 172.21.15.98:0/3014183676 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe468035860 0x7fe4680f6b00 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe47006b4b0 tx=0x7fe47009efa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:20.655 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.653+0000 7fe4577fe640 1 -- 172.21.15.98:0/3014183676 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4700ad020 con 0x7fe468035860 2024-09-16T15:37:20.656 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.653+0000 7fe46ffff640 1 -- 172.21.15.98:0/3014183676 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe46810db50 con 0x7fe468035860 2024-09-16T15:37:20.656 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.653+0000 7fe46ffff640 1 -- 172.21.15.98:0/3014183676 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe46810e110 con 0x7fe468035860 2024-09-16T15:37:20.656 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.655+0000 7fe4577fe640 1 -- 172.21.15.98:0/3014183676 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7fe4700a8800 con 0x7fe468035860 2024-09-16T15:37:20.656 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.655+0000 7fe4577fe640 1 -- 172.21.15.98:0/3014183676 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4700a2040 con 0x7fe468035860 2024-09-16T15:37:20.656 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.655+0000 7fe4577fe640 1 -- 172.21.15.98:0/3014183676 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe4700b0020 con 0x7fe468035860 2024-09-16T15:37:20.656 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.655+0000 7fe4577fe640 1 -- 172.21.15.98:0/3014183676 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fe4700a9770 con 0x7fe468035860 2024-09-16T15:37:20.657 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.656+0000 7fe4557fa640 1 -- 172.21.15.98:0/3014183676 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe450005290 con 0x7fe468035860 2024-09-16T15:37:20.657 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.656+0000 7f53e5e5b640 1 -- 172.21.15.98:0/2193646213 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f53b8005310 con 0x7f53c8003a50 2024-09-16T15:37:20.661 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.661+0000 7fe4577fe640 1 -- 172.21.15.98:0/3014183676 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fe4700b7030 con 0x7fe468035860 2024-09-16T15:37:20.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.667+0000 7f53dd7fa640 1 -- 172.21.15.98:0/2193646213 <== mon.0 v2:172.21.15.98:3300/0 11 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v6)=0 v6) ==== 123+0+0 (secure 0 0 0) 0x7f53d8041720 con 0x7f53c8003a50 2024-09-16T15:37:20.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.667+0000 7f53dd7fa640 1 -- 172.21.15.98:0/2193646213 <== mon.0 v2:172.21.15.98:3300/0 12 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f53d80419c0 con 0x7f53c8003a50 2024-09-16T15:37:20.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.667+0000 7f30017fa640 1 -- 172.21.15.98:0/1808938245 <== mon.2 v2:172.21.15.135:3301/0 7 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2ffc004020 con 0x7f30040cd5c0 2024-09-16T15:37:20.670 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.668+0000 7f76c9ffb640 1 -- 172.21.15.98:0/2746317652 <== mon.0 v2:172.21.15.98:3300/0 8 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f76d000ea10 con 0x7f76d40d0900 2024-09-16T15:37:20.678 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.675+0000 7fe4577fe640 1 -- 172.21.15.98:0/3014183676 <== mon.0 v2:172.21.15.98:3300/0 7 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe470095cd0 con 0x7fe468035860 2024-09-16T15:37:20.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.683+0000 7f53e5e5b640 1 -- 172.21.15.98:0/2193646213 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f53c8003a50 msgr2=0x7f53e02012f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:20.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.683+0000 7f53e5e5b640 1 --2- 172.21.15.98:0/2193646213 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f53c8003a50 0x7f53e02012f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f53d802b9f0 tx=0x7f53d8001c10 comp rx=0 tx=0).stop 2024-09-16T15:37:20.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.683+0000 7f53e5e5b640 1 -- 172.21.15.98:0/2193646213 shutdown_connections 2024-09-16T15:37:20.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.683+0000 7f53e5e5b640 1 --2- 172.21.15.98:0/2193646213 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53e00b5570 0x7f53e00b35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:20.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.683+0000 7f53e5e5b640 1 --2- 172.21.15.98:0/2193646213 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f53e00c7510 0x7f53e00b5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:20.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.683+0000 7f53e5e5b640 1 --2- 172.21.15.98:0/2193646213 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f53c8003a50 0x7f53e02012f0 secure :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f53d802b9f0 tx=0x7f53d8001c10 comp rx=0 tx=0).stop 2024-09-16T15:37:20.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.683+0000 7f53e5e5b640 1 -- 172.21.15.98:0/2193646213 >> 172.21.15.98:0/2193646213 conn(0x7f53e00ccec0 msgr2=0x7f53e00b1890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:20.687 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.687+0000 7f53e5e5b640 1 -- 172.21.15.98:0/2193646213 shutdown_connections 2024-09-16T15:37:20.687 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.687+0000 7f53e5e5b640 1 -- 172.21.15.98:0/2193646213 wait complete. 2024-09-16T15:37:20.705 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi098') 2024-09-16T15:37:20.764 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.762+0000 7f1bc4e18640 1 -- 172.21.15.98:0/3624698671 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1bc00b2b40 msgr2=0x7f1bc00cdeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:20.764 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.762+0000 7f1bc4e18640 1 --2- 172.21.15.98:0/3624698671 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1bc00b2b40 0x7f1bc00cdeb0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1bb8005fd0 tx=0x7f1bb802a9a0 comp rx=0 tx=0).stop 2024-09-16T15:37:20.764 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.763+0000 7f1bc4e18640 1 -- 172.21.15.98:0/3624698671 shutdown_connections 2024-09-16T15:37:20.764 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.763+0000 7f1bc4e18640 1 --2- 172.21.15.98:0/3624698671 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1bc00b2b40 0x7f1bc00cdeb0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:20.764 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.763+0000 7f1bc4e18640 1 --2- 172.21.15.98:0/3624698671 >> v2:172.21.15.98:3300/0 conn(0x7f1bc00af170 0x7f1bc01622c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:20.764 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.763+0000 7f1bc4e18640 1 -- 172.21.15.98:0/3624698671 >> 172.21.15.98:0/3624698671 conn(0x7f1bc00b1840 msgr2=0x7f1bc00b1c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:20.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.767+0000 7f1bc4e18640 1 -- 172.21.15.98:0/3624698671 shutdown_connections 2024-09-16T15:37:20.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.771+0000 7f1bc4e18640 1 -- 172.21.15.98:0/3624698671 wait complete. 2024-09-16T15:37:20.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.773+0000 7f1bc4e18640 1 Processor -- start 2024-09-16T15:37:20.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.773+0000 7f1bc4e18640 1 -- start start 2024-09-16T15:37:20.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.774+0000 7f1bc4e18640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1bc006fba0 0x7f1bc01601b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:20.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.774+0000 7f1bc4e18640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1bc00af170 0x7f1bc0155470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:20.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.774+0000 7f1bc4e18640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1bc015e950 0x7f1bc01559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:20.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.774+0000 7f1bc4e18640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc01629c0 con 0x7f1bc006fba0 2024-09-16T15:37:20.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.774+0000 7f1bc4e18640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc0070190 con 0x7f1bc00af170 2024-09-16T15:37:20.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.774+0000 7f1bc4e18640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f1bc00ce3f0 con 0x7f1bc015e950 2024-09-16T15:37:20.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.775+0000 7f1bbe59c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1bc006fba0 0x7f1bc01601b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:20.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.775+0000 7f1bbe59c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1bc006fba0 0x7f1bc01601b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60768/0 (socket says 172.21.15.98:60768) 2024-09-16T15:37:20.777 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.775+0000 7f1bbe59c640 1 -- 172.21.15.98:0/4067436639 learned_addr learned my addr 172.21.15.98:0/4067436639 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:37:20.777 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.776+0000 7f1bbe59c640 1 -- 172.21.15.98:0/4067436639 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1bc015e950 msgr2=0x7f1bc01559b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-16T15:37:20.778 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.776+0000 7f1bbe59c640 1 --2- 172.21.15.98:0/4067436639 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1bc015e950 0x7f1bc01559b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:20.778 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.776+0000 7f1bbe59c640 1 -- 172.21.15.98:0/4067436639 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1bc00af170 msgr2=0x7f1bc0155470 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-16T15:37:20.778 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.776+0000 7f1bbe59c640 1 --2- 172.21.15.98:0/4067436639 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1bc00af170 0x7f1bc0155470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:20.778 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.776+0000 7f1bbe59c640 1 -- 172.21.15.98:0/4067436639 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bc0204ae0 con 0x7f1bc006fba0 2024-09-16T15:37:20.778 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.776+0000 7f1bbe59c640 1 --2- 172.21.15.98:0/4067436639 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1bc006fba0 0x7f1bc01601b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1bb400b450 tx=0x7f1bb400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:20.778 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.777+0000 7f1baeffd640 1 -- 172.21.15.98:0/4067436639 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb4015020 con 0x7f1bc006fba0 2024-09-16T15:37:20.779 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.777+0000 7f1bc4e18640 1 -- 172.21.15.98:0/4067436639 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bc0204dc0 con 0x7f1bc006fba0 2024-09-16T15:37:20.779 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.777+0000 7f1bc4e18640 1 -- 172.21.15.98:0/4067436639 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bc0205380 con 0x7f1bc006fba0 2024-09-16T15:37:20.779 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.777+0000 7f1baeffd640 1 -- 172.21.15.98:0/4067436639 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1bb4011940 con 0x7f1bc006fba0 2024-09-16T15:37:20.779 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.777+0000 7f1baeffd640 1 -- 172.21.15.98:0/4067436639 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb4011d90 con 0x7f1bc006fba0 2024-09-16T15:37:20.785 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.784+0000 7f1bc4e18640 1 -- 172.21.15.98:0/4067436639 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ba4005290 con 0x7f1bc006fba0 2024-09-16T15:37:20.785 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.785+0000 7f1baeffd640 1 -- 172.21.15.98:0/4067436639 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1bb4018020 con 0x7f1bc006fba0 2024-09-16T15:37:20.785 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.785+0000 7f1baeffd640 1 -- 172.21.15.98:0/4067436639 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f1bb40199d0 con 0x7f1bc006fba0 2024-09-16T15:37:20.790 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.789+0000 7f1baeffd640 1 -- 172.21.15.98:0/4067436639 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f1bb401f020 con 0x7f1bc006fba0 2024-09-16T15:37:20.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.799+0000 7f5d97952640 1 -- 172.21.15.98:0/2978160918 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d7c003a50 msgr2=0x7f5d7c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:20.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.799+0000 7f5d97952640 1 --2- 172.21.15.98:0/2978160918 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d7c003a50 0x7f5d7c003e70 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c006f40 tx=0x7f5d7c005830 comp rx=0 tx=0).stop 2024-09-16T15:37:20.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.800+0000 7f5d95eef640 1 -- 172.21.15.98:0/2978160918 reap_dead start 2024-09-16T15:37:20.814 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.814+0000 7f5d97952640 1 -- 172.21.15.98:0/2978160918 shutdown_connections 2024-09-16T15:37:20.814 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.814+0000 7f5d97952640 1 -- 172.21.15.98:0/2978160918 >> 172.21.15.98:0/2978160918 conn(0x7f5d90074220 msgr2=0x7f5d90074600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:20.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.823+0000 7f5d97952640 1 -- 172.21.15.98:0/2978160918 shutdown_connections 2024-09-16T15:37:20.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.823+0000 7f5d97952640 1 -- 172.21.15.98:0/2978160918 wait complete. 2024-09-16T15:37:20.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.825+0000 7f5d97952640 1 Processor -- start 2024-09-16T15:37:20.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.825+0000 7f5d97952640 1 -- start start 2024-09-16T15:37:20.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.827+0000 7f5d97952640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d7c003a50 0x7f5d900998c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:20.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.827+0000 7f5d97952640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5d901e5920 0x7f5d901e5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:20.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.827+0000 7f5d97952640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d90155cb0 0x7f5d90156110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:20.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.828+0000 7f5d95eef640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d90155cb0 0x7f5d90156110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:20.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.828+0000 7f5d95eef640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d90155cb0 0x7f5d90156110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60786/0 (socket says 172.21.15.98:60786) 2024-09-16T15:37:20.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.828+0000 7f5d95eef640 1 -- 172.21.15.98:0/4276306138 learned_addr learned my addr 172.21.15.98:0/4276306138 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:37:20.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.828+0000 7f5d97952640 1 -- 172.21.15.98:0/4276306138 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5d900d07d0 con 0x7f5d90155cb0 2024-09-16T15:37:20.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.828+0000 7f5d97952640 1 -- 172.21.15.98:0/4276306138 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5d900d0650 con 0x7f5d7c003a50 2024-09-16T15:37:20.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.828+0000 7f5d97952640 1 -- 172.21.15.98:0/4276306138 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f5d900d0950 con 0x7f5d901e5920 2024-09-16T15:37:20.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.829+0000 7f5d95eef640 1 -- 172.21.15.98:0/4276306138 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5d901e5920 msgr2=0x7f5d901e5da0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-16T15:37:20.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.829+0000 7f5d956ee640 1 --2- 172.21.15.98:0/4276306138 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d7c003a50 0x7f5d900998c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:20.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.829+0000 7f5d94eed640 1 --2- 172.21.15.98:0/4276306138 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5d901e5920 0x7f5d901e5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:20.846 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.845+0000 7f5d95eef640 1 --2- 172.21.15.98:0/4276306138 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5d901e5920 0x7f5d901e5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:20.846 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.845+0000 7f5d95eef640 1 -- 172.21.15.98:0/4276306138 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d7c003a50 msgr2=0x7f5d900998c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:20.846 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.845+0000 7f5d95eef640 1 --2- 172.21.15.98:0/4276306138 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d7c003a50 0x7f5d900998c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:20.846 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.845+0000 7f5d95eef640 1 -- 172.21.15.98:0/4276306138 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d901f42c0 con 0x7f5d90155cb0 2024-09-16T15:37:20.846 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.845+0000 7f5d956ee640 1 --2- 172.21.15.98:0/4276306138 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d7c003a50 0x7f5d900998c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T15:37:20.846 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.845+0000 7f5d94eed640 1 --2- 172.21.15.98:0/4276306138 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5d901e5920 0x7f5d901e5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T15:37:20.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.846+0000 7f085574b640 1 -- 172.21.15.98:0/1464664829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08480e6d90 msgr2=0x7f0848036820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:20.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.846+0000 7f085574b640 1 --2- 172.21.15.98:0/1464664829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08480e6d90 0x7f0848036820 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f085006b110 tx=0x7f08500b6d50 comp rx=0 tx=0).stop 2024-09-16T15:37:20.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.845+0000 7f5d95eef640 1 --2- 172.21.15.98:0/4276306138 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d90155cb0 0x7f5d90156110 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5d88005fd0 tx=0x7f5d8800ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:20.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.849+0000 7f5d85ffb640 1 -- 172.21.15.98:0/4276306138 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d8800ca60 con 0x7f5d90155cb0 2024-09-16T15:37:20.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.849+0000 7f5d97952640 1 -- 172.21.15.98:0/4276306138 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d901f45a0 con 0x7f5d90155cb0 2024-09-16T15:37:20.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.849+0000 7f5d85ffb640 1 -- 172.21.15.98:0/4276306138 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5d88019070 con 0x7f5d90155cb0 2024-09-16T15:37:20.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.849+0000 7f5d85ffb640 1 -- 172.21.15.98:0/4276306138 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d88011470 con 0x7f5d90155cb0 2024-09-16T15:37:20.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.849+0000 7f5d97952640 1 -- 172.21.15.98:0/4276306138 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d901f4b60 con 0x7f5d90155cb0 2024-09-16T15:37:20.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.850+0000 7f5d85ffb640 1 -- 172.21.15.98:0/4276306138 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5d88011610 con 0x7f5d90155cb0 2024-09-16T15:37:20.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.850+0000 7f5d85ffb640 1 -- 172.21.15.98:0/4276306138 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f5d8801ead0 con 0x7f5d90155cb0 2024-09-16T15:37:20.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.850+0000 7f085574b640 1 -- 172.21.15.98:0/1464664829 shutdown_connections 2024-09-16T15:37:20.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.850+0000 7f085574b640 1 --2- 172.21.15.98:0/1464664829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08480e6d90 0x7f0848036820 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:20.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.850+0000 7f085574b640 1 --2- 172.21.15.98:0/1464664829 >> v2:172.21.15.98:3300/0 conn(0x7f08480e69b0 0x7f0848006e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:20.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.850+0000 7f085574b640 1 -- 172.21.15.98:0/1464664829 >> 172.21.15.98:0/1464664829 conn(0x7f084801d770 msgr2=0x7f0848054560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:20.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.850+0000 7f085574b640 1 -- 172.21.15.98:0/1464664829 shutdown_connections 2024-09-16T15:37:20.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.850+0000 7f085574b640 1 -- 172.21.15.98:0/1464664829 wait complete. 2024-09-16T15:37:20.854 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.852+0000 7f5d97952640 1 -- 172.21.15.98:0/4276306138 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d900cd6d0 con 0x7f5d90155cb0 2024-09-16T15:37:20.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.852+0000 7f085574b640 1 Processor -- start 2024-09-16T15:37:20.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.852+0000 7f085574b640 1 -- start start 2024-09-16T15:37:20.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.853+0000 7f085574b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f084804eb20 0x7f08480dee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:20.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.853+0000 7f085574b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f08480e69b0 0x7f08480df380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:20.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.853+0000 7f085574b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08480e6d90 0x7f08480df8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:20.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.853+0000 7f085574b640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0848055290 con 0x7f08480e69b0 2024-09-16T15:37:20.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.853+0000 7f085574b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0848036f50 con 0x7f084804eb20 2024-09-16T15:37:20.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.853+0000 7f085574b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f084804b5a0 con 0x7f08480e6d90 2024-09-16T15:37:20.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.854+0000 7f084f7fe640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08480e6d90 0x7f08480df8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:20.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.854+0000 7f084f7fe640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08480e6d90 0x7f08480df8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.98:57866/0 (socket says 172.21.15.98:57866) 2024-09-16T15:37:20.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.854+0000 7f084f7fe640 1 -- 172.21.15.98:0/3774121512 learned_addr learned my addr 172.21.15.98:0/3774121512 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:37:20.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.854+0000 7f084effd640 1 --2- 172.21.15.98:0/3774121512 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f084804eb20 0x7f08480dee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:20.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.854+0000 7f084f7fe640 1 -- 172.21.15.98:0/3774121512 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f084804eb20 msgr2=0x7f08480dee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:20.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.854+0000 7f084f7fe640 1 --2- 172.21.15.98:0/3774121512 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f084804eb20 0x7f08480dee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:20.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.854+0000 7f084f7fe640 1 -- 172.21.15.98:0/3774121512 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f08480e69b0 msgr2=0x7f08480df380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:20.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.854+0000 7f084f7fe640 1 --2- 172.21.15.98:0/3774121512 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f08480e69b0 0x7f08480df380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:20.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.855+0000 7f084f7fe640 1 -- 172.21.15.98:0/3774121512 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f084804b7f0 con 0x7f08480e6d90 2024-09-16T15:37:20.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.855+0000 7f084f7fe640 1 --2- 172.21.15.98:0/3774121512 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08480e6d90 0x7f08480df8c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f085006b4b0 tx=0x7f08500bfd10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:20.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.856+0000 7f76db29b640 1 -- 172.21.15.98:0/2746317652 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7f76b00052f0 con 0x7f76d40d0900 2024-09-16T15:37:20.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.857+0000 7f08377fe640 1 -- 172.21.15.98:0/3774121512 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0850098070 con 0x7f08480e6d90 2024-09-16T15:37:20.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.857+0000 7f08377fe640 1 -- 172.21.15.98:0/3774121512 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f08500be760 con 0x7f08480e6d90 2024-09-16T15:37:20.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.857+0000 7f08377fe640 1 -- 172.21.15.98:0/3774121512 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08500beb70 con 0x7f08480e6d90 2024-09-16T15:37:20.864 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.862+0000 7f5d85ffb640 1 -- 172.21.15.98:0/4276306138 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f5d8801e460 con 0x7f5d90155cb0 2024-09-16T15:37:20.867 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.866+0000 7f085574b640 1 -- 172.21.15.98:0/3774121512 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f084804bad0 con 0x7f08480e6d90 2024-09-16T15:37:20.867 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.866+0000 7f085574b640 1 -- 172.21.15.98:0/3774121512 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f08480d6cb0 con 0x7f08480e6d90 2024-09-16T15:37:20.868 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.867+0000 7f08377fe640 1 -- 172.21.15.98:0/3774121512 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f085009b070 con 0x7f08480e6d90 2024-09-16T15:37:20.868 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.867+0000 7f08377fe640 1 -- 172.21.15.98:0/3774121512 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f085009cc20 con 0x7f08480e6d90 2024-09-16T15:37:20.868 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.867+0000 7f76c9ffb640 1 -- 172.21.15.98:0/2746317652 <== mon.0 v2:172.21.15.98:3300/0 9 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v7)=0 v7) ==== 108+0+0 (secure 0 0 0) 0x7f76d0025020 con 0x7f76d40d0900 2024-09-16T15:37:20.870 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.869+0000 7f76db29b640 1 -- 172.21.15.98:0/2746317652 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f76d40d0900 msgr2=0x7f76d40ae150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:20.870 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.869+0000 7f76db29b640 1 --2- 172.21.15.98:0/2746317652 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f76d40d0900 0x7f76d40ae150 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f76d000b5c0 tx=0x7f76d000ba80 comp rx=0 tx=0).stop 2024-09-16T15:37:20.871 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.869+0000 7f76db29b640 1 -- 172.21.15.98:0/2746317652 shutdown_connections 2024-09-16T15:37:20.871 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.869+0000 7f76db29b640 1 --2- 172.21.15.98:0/2746317652 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76d415da20 0x7f76d40999c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:20.871 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.869+0000 7f76db29b640 1 --2- 172.21.15.98:0/2746317652 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f76d40d0900 0x7f76d40ae150 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:20.871 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.868+0000 7f08357fa640 1 -- 172.21.15.98:0/3774121512 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0830005290 con 0x7f08480e6d90 2024-09-16T15:37:20.871 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.870+0000 7f76db29b640 1 --2- 172.21.15.98:0/2746317652 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f76d40cffa0 0x7f76d415b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:20.872 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.870+0000 7f76db29b640 1 -- 172.21.15.98:0/2746317652 >> 172.21.15.98:0/2746317652 conn(0x7f76d4074240 msgr2=0x7f76d40c4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:20.872 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.870+0000 7f76db29b640 1 -- 172.21.15.98:0/2746317652 shutdown_connections 2024-09-16T15:37:20.872 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.870+0000 7f76db29b640 1 -- 172.21.15.98:0/2746317652 wait complete. 2024-09-16T15:37:20.872 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.868+0000 7facb4e8c640 1 -- 172.21.15.98:0/4177237399 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facb00cffa0 msgr2=0x7facb00d03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:20.872 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.868+0000 7facb4e8c640 1 --2- 172.21.15.98:0/4177237399 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facb00cffa0 0x7facb00d03c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7facb00cfaf0 tx=0x7faca802aa30 comp rx=0 tx=0).stop 2024-09-16T15:37:20.872 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.869+0000 7facb4e8c640 1 -- 172.21.15.98:0/4177237399 shutdown_connections 2024-09-16T15:37:20.872 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.869+0000 7facb4e8c640 1 --2- 172.21.15.98:0/4177237399 >> v2:172.21.15.98:3300/0 conn(0x7facb00d0900 0x7facb00caa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:20.872 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.869+0000 7facb4e8c640 1 --2- 172.21.15.98:0/4177237399 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facb00cffa0 0x7facb00d03c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:20.872 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.869+0000 7facb4e8c640 1 -- 172.21.15.98:0/4177237399 >> 172.21.15.98:0/4177237399 conn(0x7facb0074240 msgr2=0x7facb0074650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:20.875 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.872+0000 7f08377fe640 1 -- 172.21.15.98:0/3774121512 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f08500b7c80 con 0x7f08480e6d90 2024-09-16T15:37:20.877 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.875+0000 7facb4e8c640 1 -- 172.21.15.98:0/4177237399 shutdown_connections 2024-09-16T15:37:20.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.882+0000 7facb4e8c640 1 -- 172.21.15.98:0/4177237399 wait complete. 2024-09-16T15:37:20.885 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.884+0000 7facb4e8c640 1 Processor -- start 2024-09-16T15:37:20.885 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.884+0000 7facb4e8c640 1 -- start start 2024-09-16T15:37:20.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.885+0000 7facb4e8c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facb00cffa0 0x7facb0154540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:20.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.885+0000 7facb4e8c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7facb00d0900 0x7facb01560b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:20.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.885+0000 7facb4e8c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7facb015da20 0x7facb01565f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:20.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.885+0000 7facb4e8c640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7facb00cb330 con 0x7facb015da20 2024-09-16T15:37:20.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.885+0000 7facb4e8c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7facb00cb1b0 con 0x7facb00cffa0 2024-09-16T15:37:20.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.885+0000 7facb4e8c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7facb00cb4b0 con 0x7facb00d0900 2024-09-16T15:37:20.887 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.885+0000 7f56c40b0640 1 -- 172.21.15.98:0/394447527 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56bc15ab40 msgr2=0x7f56bc0cc5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:20.887 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.885+0000 7f56c40b0640 1 --2- 172.21.15.98:0/394447527 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56bc15ab40 0x7f56bc0cc5c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f56bc06f540 tx=0x7f56b402aa30 comp rx=0 tx=0).stop 2024-09-16T15:37:20.887 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.885+0000 7facaed9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7facb015da20 0x7facb01565f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:20.887 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.885+0000 7facaed9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7facb015da20 0x7facb01565f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60810/0 (socket says 172.21.15.98:60810) 2024-09-16T15:37:20.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.885+0000 7facaed9d640 1 -- 172.21.15.98:0/955370432 learned_addr learned my addr 172.21.15.98:0/955370432 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:37:20.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.885+0000 7facaed9d640 1 -- 172.21.15.98:0/955370432 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7facb00d0900 msgr2=0x7facb01560b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-16T15:37:20.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.885+0000 7facaed9d640 1 --2- 172.21.15.98:0/955370432 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7facb00d0900 0x7facb01560b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:20.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.885+0000 7facaed9d640 1 -- 172.21.15.98:0/955370432 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facb00cffa0 msgr2=0x7facb0154540 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-16T15:37:20.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.885+0000 7facaed9d640 1 --2- 172.21.15.98:0/955370432 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facb00cffa0 0x7facb0154540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:20.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.885+0000 7facaed9d640 1 -- 172.21.15.98:0/955370432 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facb015cde0 con 0x7facb015da20 2024-09-16T15:37:20.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.885+0000 7facaed9d640 1 --2- 172.21.15.98:0/955370432 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7facb015da20 0x7facb01565f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7faca000b3f0 tx=0x7faca000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:20.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.886+0000 7fac9effd640 1 -- 172.21.15.98:0/955370432 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faca0015020 con 0x7facb015da20 2024-09-16T15:37:20.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.886+0000 7fac9effd640 1 -- 172.21.15.98:0/955370432 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faca0011920 con 0x7facb015da20 2024-09-16T15:37:20.889 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.886+0000 7fac9effd640 1 -- 172.21.15.98:0/955370432 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faca0011d50 con 0x7facb015da20 2024-09-16T15:37:20.890 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.889+0000 7f56c40b0640 1 -- 172.21.15.98:0/394447527 shutdown_connections 2024-09-16T15:37:20.891 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.889+0000 7f56c40b0640 1 --2- 172.21.15.98:0/394447527 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f56bc073790 0x7f56bc073be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:20.891 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.889+0000 7f56c40b0640 1 --2- 172.21.15.98:0/394447527 >> v2:172.21.15.98:3300/0 conn(0x7f56bc15f250 0x7f56bc070790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:20.891 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.889+0000 7f56c40b0640 1 --2- 172.21.15.98:0/394447527 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56bc15ab40 0x7f56bc0cc5c0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:20.891 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.889+0000 7f56c40b0640 1 -- 172.21.15.98:0/394447527 >> 172.21.15.98:0/394447527 conn(0x7f56bc0d0d40 msgr2=0x7f56bc0d1150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:20.891 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.889+0000 7f56c40b0640 1 -- 172.21.15.98:0/394447527 shutdown_connections 2024-09-16T15:37:20.892 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.889+0000 7facb4e8c640 1 -- 172.21.15.98:0/955370432 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facb015d0c0 con 0x7facb015da20 2024-09-16T15:37:20.892 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.889+0000 7facb4e8c640 1 -- 172.21.15.98:0/955370432 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facb0154020 con 0x7facb015da20 2024-09-16T15:37:20.892 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.891+0000 7fac9effd640 1 -- 172.21.15.98:0/955370432 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7faca0018020 con 0x7facb015da20 2024-09-16T15:37:20.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.891+0000 7fac9effd640 1 -- 172.21.15.98:0/955370432 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7faca0019a70 con 0x7facb015da20 2024-09-16T15:37:20.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.894+0000 7f56c40b0640 1 -- 172.21.15.98:0/394447527 wait complete. 2024-09-16T15:37:20.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.894+0000 7fac9cff9640 1 -- 172.21.15.98:0/955370432 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facb0154220 con 0x7facb015da20 2024-09-16T15:37:20.904 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.898+0000 7fe4557fa640 1 -- 172.21.15.98:0/3014183676 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7fe450005580 con 0x7fe468035860 2024-09-16T15:37:20.904 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.896+0000 7f56c40b0640 1 Processor -- start 2024-09-16T15:37:20.904 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.896+0000 7f56c40b0640 1 -- start start 2024-09-16T15:37:20.904 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.897+0000 7f56c40b0640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f56bc073790 0x7f56bc150ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:20.904 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.897+0000 7f56c40b0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56bc15ab40 0x7f56bc0c5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:20.904 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.897+0000 7f56c40b0640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f56bc15f250 0x7f56bc0c6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:20.904 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.897+0000 7f56c40b0640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f56bc0cf330 con 0x7f56bc073790 2024-09-16T15:37:20.904 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.897+0000 7f56c40b0640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f56bc0cf1b0 con 0x7f56bc15ab40 2024-09-16T15:37:20.904 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.897+0000 7f56c40b0640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f56bc0cf4b0 con 0x7f56bc15f250 2024-09-16T15:37:20.909 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.897+0000 7f56c1e4c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f56bc073790 0x7f56bc150ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:20.909 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.897+0000 7f56c1e4c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f56bc073790 0x7f56bc150ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60816/0 (socket says 172.21.15.98:60816) 2024-09-16T15:37:20.909 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.897+0000 7f56c1e4c640 1 -- 172.21.15.98:0/4139105451 learned_addr learned my addr 172.21.15.98:0/4139105451 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:37:20.909 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.898+0000 7f56c264d640 1 --2- 172.21.15.98:0/4139105451 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f56bc15f250 0x7f56bc0c6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:20.909 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.898+0000 7f56c164b640 1 --2- 172.21.15.98:0/4139105451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56bc15ab40 0x7f56bc0c5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:20.909 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.902+0000 7f56c264d640 1 -- 172.21.15.98:0/4139105451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56bc15ab40 msgr2=0x7f56bc0c5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:20.909 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.902+0000 7f56c264d640 1 --2- 172.21.15.98:0/4139105451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56bc15ab40 0x7f56bc0c5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:20.909 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.902+0000 7f56c264d640 1 -- 172.21.15.98:0/4139105451 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f56bc073790 msgr2=0x7f56bc150ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:20.909 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.902+0000 7f56c264d640 1 --2- 172.21.15.98:0/4139105451 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f56bc073790 0x7f56bc150ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:20.909 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.902+0000 7f56c264d640 1 -- 172.21.15.98:0/4139105451 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56bc1f3dc0 con 0x7f56bc15f250 2024-09-16T15:37:20.910 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.903+0000 7fac9effd640 1 -- 172.21.15.98:0/955370432 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7facb0154220 con 0x7facb015da20 2024-09-16T15:37:20.910 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi098') 2024-09-16T15:37:20.910 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.907+0000 7f3009bc8640 1 -- 172.21.15.98:0/1808938245 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7f2fe4005580 con 0x7f30040cd5c0 2024-09-16T15:37:20.911 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.907+0000 7f56c264d640 1 --2- 172.21.15.98:0/4139105451 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f56bc15f250 0x7f56bc0c6410 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f56ac00b3e0 tx=0x7f56ac00b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:20.913 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.911+0000 7fe4577fe640 1 -- 172.21.15.98:0/3014183676 <== mon.0 v2:172.21.15.98:3300/0 8 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v8)=0 v8) ==== 106+0+0 (secure 0 0 0) 0x7fe4700959a0 con 0x7fe468035860 2024-09-16T15:37:20.915 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.913+0000 7f56b27fc640 1 -- 172.21.15.98:0/4139105451 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56ac015020 con 0x7f56bc15f250 2024-09-16T15:37:20.915 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.913+0000 7f56b27fc640 1 -- 172.21.15.98:0/4139105451 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f56ac011940 con 0x7f56bc15f250 2024-09-16T15:37:20.915 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.913+0000 7f56b27fc640 1 -- 172.21.15.98:0/4139105451 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56ac011d90 con 0x7f56bc15f250 2024-09-16T15:37:20.918 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.913+0000 7fe46ffff640 1 -- 172.21.15.98:0/3014183676 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe468035860 msgr2=0x7fe4680f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:20.918 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.913+0000 7fe46ffff640 1 --2- 172.21.15.98:0/3014183676 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe468035860 0x7fe4680f6b00 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe47006b4b0 tx=0x7fe47009efa0 comp rx=0 tx=0).stop 2024-09-16T15:37:20.918 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.913+0000 7fe46ffff640 1 -- 172.21.15.98:0/3014183676 shutdown_connections 2024-09-16T15:37:20.918 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.914+0000 7fe46ffff640 1 --2- 172.21.15.98:0/3014183676 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe468035860 0x7fe4680f6b00 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:20.918 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.914+0000 7fe46ffff640 1 --2- 172.21.15.98:0/3014183676 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe468034070 0x7fe4680f65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:20.918 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.914+0000 7fe46ffff640 1 --2- 172.21.15.98:0/3014183676 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4680062f0 0x7fe4680f4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:20.918 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.914+0000 7fe46ffff640 1 -- 172.21.15.98:0/3014183676 >> 172.21.15.98:0/3014183676 conn(0x7fe46801d950 msgr2=0x7fe4680f8c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:20.918 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.914+0000 7fe46ffff640 1 -- 172.21.15.98:0/3014183676 shutdown_connections 2024-09-16T15:37:20.919 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.914+0000 7f56c40b0640 1 -- 172.21.15.98:0/4139105451 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56bc1f3000 con 0x7f56bc15f250 2024-09-16T15:37:20.919 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.914+0000 7f56c40b0640 1 -- 172.21.15.98:0/4139105451 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f56bc1f35c0 con 0x7f56bc15f250 2024-09-16T15:37:20.919 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.916+0000 7f56b27fc640 1 -- 172.21.15.98:0/4139105451 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f56ac018020 con 0x7f56bc15f250 2024-09-16T15:37:20.919 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.916+0000 7f56b27fc640 1 -- 172.21.15.98:0/4139105451 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f56ac0199d0 con 0x7f56bc15f250 2024-09-16T15:37:20.919 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.916+0000 7f569ffff640 1 -- 172.21.15.98:0/4139105451 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56bc0b0f80 con 0x7f56bc15f250 2024-09-16T15:37:20.919 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.918+0000 7fe46ffff640 1 -- 172.21.15.98:0/3014183676 wait complete. 2024-09-16T15:37:20.921 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.918+0000 7f56b27fc640 1 -- 172.21.15.98:0/4139105451 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f56bc0b0f80 con 0x7f56bc15f250 2024-09-16T15:37:20.924 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.922+0000 7f90cdc39640 1 -- 172.21.15.98:0/1977046043 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f90c80cde20 msgr2=0x7f90b0003a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:20.924 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.922+0000 7f90cdc39640 1 --2- 172.21.15.98:0/1977046043 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f90c80cde20 0x7f90b0003a80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f90bc00c690 tx=0x7f90b0005830 comp rx=0 tx=0).stop 2024-09-16T15:37:20.924 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.922+0000 7f90cd438640 1 -- 172.21.15.98:0/1977046043 reap_dead start 2024-09-16T15:37:20.925 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.924+0000 7f30017fa640 1 -- 172.21.15.98:0/1808938245 <== mon.2 v2:172.21.15.135:3301/0 8 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v9)=0 v9) ==== 117+0+0 (secure 0 0 0) 0x7f2ffc003970 con 0x7f30040cd5c0 2024-09-16T15:37:20.926 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.925+0000 7f2b6dc7f640 1 -- 172.21.15.98:0/699891834 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2b681619e0 msgr2=0x7f2b68161dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:20.927 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.925+0000 7f2b6dc7f640 1 --2- 172.21.15.98:0/699891834 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2b681619e0 0x7f2b68161dc0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c009830 tx=0x7f2b5c02a3b0 comp rx=0 tx=0).stop 2024-09-16T15:37:20.927 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.926+0000 7f90cdc39640 1 -- 172.21.15.98:0/1977046043 shutdown_connections 2024-09-16T15:37:20.927 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.926+0000 7f90cdc39640 1 -- 172.21.15.98:0/1977046043 >> 172.21.15.98:0/1977046043 conn(0x7f90c80cf9f0 msgr2=0x7f90c80cfe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:20.928 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.926+0000 7f90cdc39640 1 -- 172.21.15.98:0/1977046043 shutdown_connections 2024-09-16T15:37:20.929 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.926+0000 7f90cdc39640 1 -- 172.21.15.98:0/1977046043 wait complete. 2024-09-16T15:37:20.930 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.928+0000 7f2feaffd640 1 -- 172.21.15.98:0/1808938245 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f30040cd5c0 msgr2=0x7f30041f9200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:20.930 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.928+0000 7f90cdc39640 1 Processor -- start 2024-09-16T15:37:20.930 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.928+0000 7f2feaffd640 1 --2- 172.21.15.98:0/1808938245 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f30040cd5c0 0x7f30041f9200 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc002230 tx=0x7f2ffc00a4f0 comp rx=0 tx=0).stop 2024-09-16T15:37:20.931 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.928+0000 7f90cdc39640 1 -- start start 2024-09-16T15:37:20.931 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.929+0000 7f90cdc39640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f90c80cde20 0x7f90c80aea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:20.931 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.929+0000 7f90cdc39640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90c81fd3e0 0x7f90c81f9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:20.931 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.929+0000 7f90cdc39640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f90c8155cf0 0x7f90c8156180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:20.931 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.929+0000 7f90cdc39640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f90c8070210 con 0x7f90c81fd3e0 2024-09-16T15:37:20.931 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.929+0000 7f90cdc39640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f90c8070090 con 0x7f90c80cde20 2024-09-16T15:37:20.932 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.929+0000 7f90cdc39640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f90c8070390 con 0x7f90c8155cf0 2024-09-16T15:37:20.932 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.929+0000 7f2feaffd640 1 -- 172.21.15.98:0/1808938245 shutdown_connections 2024-09-16T15:37:20.932 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.929+0000 7f2feaffd640 1 --2- 172.21.15.98:0/1808938245 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f30040cf5a0 0x7f30041f83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:20.932 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.929+0000 7f2feaffd640 1 --2- 172.21.15.98:0/1808938245 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f30040cd5c0 0x7f30041f9200 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:20.932 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.929+0000 7f2feaffd640 1 --2- 172.21.15.98:0/1808938245 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f30040ca960 0x7f30040c37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:20.932 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.929+0000 7f2feaffd640 1 -- 172.21.15.98:0/1808938245 >> 172.21.15.98:0/1808938245 conn(0x7f30040cf9f0 msgr2=0x7f300406fe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:20.933 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.930+0000 7f90ccc37640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f90c80cde20 0x7f90c80aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:20.933 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.930+0000 7f2b6dc7f640 1 -- 172.21.15.98:0/699891834 shutdown_connections 2024-09-16T15:37:20.933 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.930+0000 7f2b6dc7f640 1 --2- 172.21.15.98:0/699891834 >> v2:172.21.15.135:3300/0 conn(0x7f2b680b7910 0x7f2b6806e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:20.933 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.930+0000 7f2b6dc7f640 1 --2- 172.21.15.98:0/699891834 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2b681619e0 0x7f2b68161dc0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:20.933 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.930+0000 7f2b6dc7f640 1 -- 172.21.15.98:0/699891834 >> 172.21.15.98:0/699891834 conn(0x7f2b680d1c50 msgr2=0x7f2b680d2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:20.934 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.930+0000 7f90cd438640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f90c8155cf0 0x7f90c8156180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:20.934 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.930+0000 7f90cd438640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f90c8155cf0 0x7f90c8156180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.98:57930/0 (socket says 172.21.15.98:57930) 2024-09-16T15:37:20.934 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.930+0000 7f2b6dc7f640 1 -- 172.21.15.98:0/699891834 shutdown_connections 2024-09-16T15:37:20.934 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.932+0000 7f2feaffd640 1 -- 172.21.15.98:0/1808938245 shutdown_connections 2024-09-16T15:37:20.934 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.932+0000 7f2feaffd640 1 -- 172.21.15.98:0/1808938245 wait complete. 2024-09-16T15:37:20.935 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.930+0000 7f2b6dc7f640 1 -- 172.21.15.98:0/699891834 wait complete. 2024-09-16T15:37:20.935 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.930+0000 7f90cd438640 1 -- 172.21.15.98:0/2377327522 learned_addr learned my addr 172.21.15.98:0/2377327522 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:37:20.936 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.931+0000 7f90cd438640 1 -- 172.21.15.98:0/2377327522 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f90c80cde20 msgr2=0x7f90c80aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:20.936 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.931+0000 7f90cd438640 1 --2- 172.21.15.98:0/2377327522 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f90c80cde20 0x7f90c80aea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:20.936 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.931+0000 7f90cd438640 1 -- 172.21.15.98:0/2377327522 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90c81fd3e0 msgr2=0x7f90c81f9100 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-16T15:37:20.936 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.934+0000 7f90c7fff640 1 --2- 172.21.15.98:0/2377327522 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90c81fd3e0 0x7f90c81f9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:20.937 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.932+0000 7f2b6dc7f640 1 Processor -- start 2024-09-16T15:37:20.937 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.932+0000 7f2b6dc7f640 1 -- start start 2024-09-16T15:37:20.937 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.934+0000 7f2b6dc7f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2b680b7910 0x7f2b6809cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:20.937 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.934+0000 7f2b6dc7f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2b681619e0 0x7f2b680caaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:20.937 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.934+0000 7f2b6dc7f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b68162580 0x7f2b6809f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:20.937 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.934+0000 7f2b6dc7f640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2b680d0930 con 0x7f2b681619e0 2024-09-16T15:37:20.937 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.934+0000 7f2b6dc7f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2b680d07b0 con 0x7f2b68162580 2024-09-16T15:37:20.937 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.934+0000 7f2b6dc7f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f2b680d0ab0 con 0x7f2b680b7910 2024-09-16T15:37:20.938 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.934+0000 7f90cd438640 1 --2- 172.21.15.98:0/2377327522 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90c81fd3e0 0x7f90c81f9100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:20.938 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.934+0000 7f90cd438640 1 -- 172.21.15.98:0/2377327522 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90c81f9ab0 con 0x7f90c8155cf0 2024-09-16T15:37:20.938 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.934+0000 7f90c7fff640 1 --2- 172.21.15.98:0/2377327522 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90c81fd3e0 0x7f90c81f9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T15:37:20.938 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.934+0000 7f2b66ffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2b681619e0 0x7f2b680caaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:20.938 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.935+0000 7f2b66ffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2b681619e0 0x7f2b680caaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60842/0 (socket says 172.21.15.98:60842) 2024-09-16T15:37:20.939 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.935+0000 7f2b66ffd640 1 -- 172.21.15.98:0/472515275 learned_addr learned my addr 172.21.15.98:0/472515275 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:37:20.939 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.935+0000 7f2b677fe640 1 --2- 172.21.15.98:0/472515275 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2b680b7910 0x7f2b6809cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:20.939 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.935+0000 7f2b67fff640 1 --2- 172.21.15.98:0/472515275 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b68162580 0x7f2b6809f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:20.939 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.935+0000 7f90cd438640 1 --2- 172.21.15.98:0/2377327522 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f90c8155cf0 0x7f90c8156180 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f90b800d590 tx=0x7f90b800da50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:20.940 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.935+0000 7f2b67fff640 1 -- 172.21.15.98:0/472515275 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2b680b7910 msgr2=0x7f2b6809cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:20.940 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.935+0000 7f2b67fff640 1 --2- 172.21.15.98:0/472515275 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2b680b7910 0x7f2b6809cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:20.940 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.935+0000 7f2b67fff640 1 -- 172.21.15.98:0/472515275 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2b681619e0 msgr2=0x7f2b680caaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:20.940 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.935+0000 7f2b67fff640 1 --2- 172.21.15.98:0/472515275 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2b681619e0 0x7f2b680caaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:20.940 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.935+0000 7f2b67fff640 1 -- 172.21.15.98:0/472515275 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b6815d0f0 con 0x7f2b68162580 2024-09-16T15:37:20.940 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.935+0000 7f2b66ffd640 1 --2- 172.21.15.98:0/472515275 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2b681619e0 0x7f2b680caaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T15:37:20.940 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.936+0000 7f90c57fa640 1 -- 172.21.15.98:0/2377327522 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90b8004440 con 0x7f90c8155cf0 2024-09-16T15:37:20.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.936+0000 7f90c57fa640 1 -- 172.21.15.98:0/2377327522 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f90b8018070 con 0x7f90c8155cf0 2024-09-16T15:37:20.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.936+0000 7f90c57fa640 1 -- 172.21.15.98:0/2377327522 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90b8003830 con 0x7f90c8155cf0 2024-09-16T15:37:20.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.936+0000 7f90cdc39640 1 -- 172.21.15.98:0/2377327522 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90c81f9d90 con 0x7f90c8155cf0 2024-09-16T15:37:20.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.936+0000 7f90cdc39640 1 -- 172.21.15.98:0/2377327522 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f90c81554f0 con 0x7f90c8155cf0 2024-09-16T15:37:20.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.938+0000 7f2b67fff640 1 --2- 172.21.15.98:0/472515275 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b68162580 0x7f2b6809f0f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2b5400c460 tx=0x7f2b5400c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:20.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.938+0000 7f90c57fa640 1 -- 172.21.15.98:0/2377327522 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f90b80039d0 con 0x7f90c8155cf0 2024-09-16T15:37:20.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.938+0000 7f90c57fa640 1 -- 172.21.15.98:0/2377327522 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f90b801d460 con 0x7f90c8155cf0 2024-09-16T15:37:20.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.938+0000 7f2b53fff640 1 -- 172.21.15.98:0/472515275 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b54017070 con 0x7f2b68162580 2024-09-16T15:37:20.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.938+0000 7f2b53fff640 1 -- 172.21.15.98:0/472515275 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2b540035f0 con 0x7f2b68162580 2024-09-16T15:37:20.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.938+0000 7f2b53fff640 1 -- 172.21.15.98:0/472515275 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b54003a40 con 0x7f2b68162580 2024-09-16T15:37:20.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.938+0000 7f2b6dc7f640 1 -- 172.21.15.98:0/472515275 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b6815d390 con 0x7f2b68162580 2024-09-16T15:37:20.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.938+0000 7f2b6dc7f640 1 -- 172.21.15.98:0/472515275 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b6809d180 con 0x7f2b68162580 2024-09-16T15:37:20.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.939+0000 7f2b53fff640 1 -- 172.21.15.98:0/472515275 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2b5401a070 con 0x7f2b68162580 2024-09-16T15:37:20.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.939+0000 7f2b53fff640 1 -- 172.21.15.98:0/472515275 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f2b54012740 con 0x7f2b68162580 2024-09-16T15:37:20.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.942+0000 7f2b51ffb640 1 -- 172.21.15.98:0/472515275 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b6806e660 con 0x7f2b68162580 2024-09-16T15:37:20.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.943+0000 7f90cdc39640 1 -- 172.21.15.98:0/2377327522 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90c81620c0 con 0x7f90c8155cf0 2024-09-16T15:37:20.947 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.945+0000 7f2b53fff640 1 -- 172.21.15.98:0/472515275 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f2b54021020 con 0x7f2b68162580 2024-09-16T15:37:20.951 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi098') 2024-09-16T15:37:20.951 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi098') 2024-09-16T15:37:20.951 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.948+0000 7f90c57fa640 1 -- 172.21.15.98:0/2377327522 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f90b8005020 con 0x7f90c8155cf0 2024-09-16T15:37:20.960 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.958+0000 7fdc1b7f8640 1 -- 172.21.15.98:0/3241579505 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc1406cb70 msgr2=0x7fdc1406d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:20.960 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.958+0000 7fdc1b7f8640 1 --2- 172.21.15.98:0/3241579505 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc1406cb70 0x7fdc1406d020 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c005fd0 tx=0x7fdc0c02a9f0 comp rx=0 tx=0).stop 2024-09-16T15:37:20.960 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.958+0000 7fdc1b7f8640 1 -- 172.21.15.98:0/3241579505 shutdown_connections 2024-09-16T15:37:20.960 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.958+0000 7fdc1b7f8640 1 --2- 172.21.15.98:0/3241579505 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc1406cb70 0x7fdc1406d020 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:20.960 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.958+0000 7fdc1b7f8640 1 --2- 172.21.15.98:0/3241579505 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdc1415dff0 0x7fdc140cf9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:20.960 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.958+0000 7fdc1b7f8640 1 -- 172.21.15.98:0/3241579505 >> 172.21.15.98:0/3241579505 conn(0x7fdc140d0d40 msgr2=0x7fdc140d1150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:20.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.959+0000 7fdc1b7f8640 1 -- 172.21.15.98:0/3241579505 shutdown_connections 2024-09-16T15:37:20.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.959+0000 7f0041218640 1 -- 172.21.15.98:0/2052833194 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f003c0af170 msgr2=0x7f003c1620f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:20.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.959+0000 7f0041218640 1 --2- 172.21.15.98:0/2052833194 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f003c0af170 0x7f003c1620f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f003c072730 tx=0x7f003402a9a0 comp rx=0 tx=0).stop 2024-09-16T15:37:20.966 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.959+0000 7fdc1b7f8640 1 -- 172.21.15.98:0/3241579505 wait complete. 2024-09-16T15:37:20.966 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.961+0000 7fdc1b7f8640 1 Processor -- start 2024-09-16T15:37:20.966 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.961+0000 7fdc1b7f8640 1 -- start start 2024-09-16T15:37:20.966 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.963+0000 7fdc1b7f8640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc140d01a0 0x7fdc140b64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:20.966 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.963+0000 7fdc1b7f8640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdc1415dff0 0x7fdc140c7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:20.966 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.963+0000 7fdc1b7f8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc14154480 0x7fdc142162c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:20.966 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.963+0000 7fdc1b7f8640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fdc14073b20 con 0x7fdc140d01a0 2024-09-16T15:37:20.966 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.963+0000 7fdc1b7f8640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdc140739a0 con 0x7fdc14154480 2024-09-16T15:37:20.966 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.963+0000 7fdc1b7f8640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fdc14073ca0 con 0x7fdc1415dff0 2024-09-16T15:37:20.966 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.963+0000 7fdc19d95640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc14154480 0x7fdc142162c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:20.966 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.963+0000 7fdc19d95640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc14154480 0x7fdc142162c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.98:56630/0 (socket says 172.21.15.98:56630) 2024-09-16T15:37:20.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.963+0000 7fdc19d95640 1 -- 172.21.15.98:0/2114590174 learned_addr learned my addr 172.21.15.98:0/2114590174 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:37:20.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.963+0000 7fdc18d93640 1 --2- 172.21.15.98:0/2114590174 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdc1415dff0 0x7fdc140c7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:20.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.963+0000 7fdc19594640 1 --2- 172.21.15.98:0/2114590174 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc140d01a0 0x7fdc140b64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:20.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.963+0000 7fdc19d95640 1 -- 172.21.15.98:0/2114590174 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdc1415dff0 msgr2=0x7fdc140c7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:20.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.963+0000 7fdc19d95640 1 --2- 172.21.15.98:0/2114590174 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdc1415dff0 0x7fdc140c7470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:20.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.963+0000 7fdc19d95640 1 -- 172.21.15.98:0/2114590174 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc140d01a0 msgr2=0x7fdc140b64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:20.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.964+0000 7fdc19d95640 1 --2- 172.21.15.98:0/2114590174 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc140d01a0 0x7fdc140b64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:20.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.964+0000 7fdc19d95640 1 -- 172.21.15.98:0/2114590174 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc14215b00 con 0x7fdc14154480 2024-09-16T15:37:20.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.964+0000 7fdc18d93640 1 --2- 172.21.15.98:0/2114590174 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdc1415dff0 0x7fdc140c7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T15:37:20.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.964+0000 7fdc19594640 1 --2- 172.21.15.98:0/2114590174 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc140d01a0 0x7fdc140b64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T15:37:20.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.964+0000 7fdc19d95640 1 --2- 172.21.15.98:0/2114590174 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc14154480 0x7fdc142162c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c009d90 tx=0x7fdc0c009860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:20.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.964+0000 7fdc09ffb640 1 -- 172.21.15.98:0/2114590174 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc0c045070 con 0x7fdc14154480 2024-09-16T15:37:20.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.964+0000 7fdc1b7f8640 1 -- 172.21.15.98:0/2114590174 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc14154910 con 0x7fdc14154480 2024-09-16T15:37:20.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.964+0000 7fdc1b7f8640 1 -- 172.21.15.98:0/2114590174 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc14154ed0 con 0x7fdc14154480 2024-09-16T15:37:20.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.965+0000 7fdc09ffb640 1 -- 172.21.15.98:0/2114590174 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdc0c004640 con 0x7fdc14154480 2024-09-16T15:37:20.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.965+0000 7fdc09ffb640 1 -- 172.21.15.98:0/2114590174 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc0c033050 con 0x7fdc14154480 2024-09-16T15:37:20.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.965+0000 7fdc09ffb640 1 -- 172.21.15.98:0/2114590174 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fdc0c048070 con 0x7fdc14154480 2024-09-16T15:37:20.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.965+0000 7fdc09ffb640 1 -- 172.21.15.98:0/2114590174 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fdc0c04a780 con 0x7fdc14154480 2024-09-16T15:37:20.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.967+0000 7fdc1b7f8640 1 -- 172.21.15.98:0/2114590174 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc1406cb70 con 0x7fdc14154480 2024-09-16T15:37:20.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.965+0000 7f0041218640 1 -- 172.21.15.98:0/2052833194 shutdown_connections 2024-09-16T15:37:20.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.965+0000 7f0041218640 1 --2- 172.21.15.98:0/2052833194 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f003c0af170 0x7f003c1620f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:20.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.965+0000 7f0041218640 1 --2- 172.21.15.98:0/2052833194 >> v2:172.21.15.98:3300/0 conn(0x7f003c06fba0 0x7f003c161bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:20.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.965+0000 7f0041218640 1 -- 172.21.15.98:0/2052833194 >> 172.21.15.98:0/2052833194 conn(0x7f003c0b1840 msgr2=0x7f003c0b1c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:20.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.968+0000 7f8e7e0db640 1 -- 172.21.15.98:0/3447979085 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8e64003a50 msgr2=0x7f8e64003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:20.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.968+0000 7f8e7e0db640 1 --2- 172.21.15.98:0/3447979085 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8e64003a50 0x7f8e64003e70 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8e7400c4a0 tx=0x7f8e64005830 comp rx=0 tx=0).stop 2024-09-16T15:37:20.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.970+0000 7f0041218640 1 -- 172.21.15.98:0/2052833194 shutdown_connections 2024-09-16T15:37:20.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.971+0000 7fdc09ffb640 1 -- 172.21.15.98:0/2114590174 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fdc0c02fb90 con 0x7fdc14154480 2024-09-16T15:37:20.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.970+0000 7f0041218640 1 -- 172.21.15.98:0/2052833194 wait complete. 2024-09-16T15:37:20.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.972+0000 7f0041218640 1 Processor -- start 2024-09-16T15:37:20.975 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.968+0000 7f8e7e0db640 1 -- 172.21.15.98:0/3447979085 shutdown_connections 2024-09-16T15:37:20.975 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.968+0000 7f8e7e0db640 1 --2- 172.21.15.98:0/3447979085 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8e64003a50 0x7f8e64003e70 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:20.975 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.968+0000 7f8e7e0db640 1 -- 172.21.15.98:0/3447979085 >> 172.21.15.98:0/3447979085 conn(0x7f8e780cf9f0 msgr2=0x7f8e780cfe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:20.975 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.968+0000 7f8e7e0db640 1 -- 172.21.15.98:0/3447979085 shutdown_connections 2024-09-16T15:37:20.975 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.968+0000 7f8e7e0db640 1 -- 172.21.15.98:0/3447979085 wait complete. 2024-09-16T15:37:20.975 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.970+0000 7f8e7e0db640 1 Processor -- start 2024-09-16T15:37:20.976 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.970+0000 7f8e7e0db640 1 -- start start 2024-09-16T15:37:20.976 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.971+0000 7f8e7e0db640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8e64003a50 0x7f8e7815e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:20.976 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.971+0000 7f8e7e0db640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e7815abc0 0x7f8e7815b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:20.976 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.971+0000 7f8e7e0db640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e780c6ac0 0x7f8e780c6f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:20.976 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.971+0000 7f8e7e0db640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8e78070420 con 0x7f8e7815abc0 2024-09-16T15:37:20.976 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.971+0000 7f8e7e0db640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8e780702a0 con 0x7f8e780c6ac0 2024-09-16T15:37:20.976 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.971+0000 7f8e7e0db640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f8e7815cbc0 con 0x7f8e64003a50 2024-09-16T15:37:20.976 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.972+0000 7f8e7c8d8640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e7815abc0 0x7f8e7815b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:20.976 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.972+0000 7f8e7c8d8640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e7815abc0 0x7f8e7815b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60886/0 (socket says 172.21.15.98:60886) 2024-09-16T15:37:20.976 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.972+0000 7f8e7c8d8640 1 -- 172.21.15.98:0/88086205 learned_addr learned my addr 172.21.15.98:0/88086205 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:37:20.976 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.972+0000 7f8e7c8d8640 1 -- 172.21.15.98:0/88086205 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8e64003a50 msgr2=0x7f8e7815e800 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-16T15:37:20.976 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.972+0000 7f8e7c8d8640 1 --2- 172.21.15.98:0/88086205 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8e64003a50 0x7f8e7815e800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:20.976 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.972+0000 7f8e7c8d8640 1 -- 172.21.15.98:0/88086205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e780c6ac0 msgr2=0x7f8e780c6f40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-16T15:37:20.976 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.972+0000 7f8e7c8d8640 1 --2- 172.21.15.98:0/88086205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e780c6ac0 0x7f8e780c6f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:20.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.972+0000 7f8e7c8d8640 1 -- 172.21.15.98:0/88086205 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e7815b580 con 0x7f8e7815abc0 2024-09-16T15:37:20.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.972+0000 7f8e7c8d8640 1 --2- 172.21.15.98:0/88086205 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e7815abc0 0x7f8e7815b040 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8e7000ecb0 tx=0x7f8e7000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:20.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.973+0000 7f8e6dffb640 1 -- 172.21.15.98:0/88086205 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e70004b20 con 0x7f8e7815abc0 2024-09-16T15:37:20.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.973+0000 7f8e7e0db640 1 -- 172.21.15.98:0/88086205 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e7815bad0 con 0x7f8e7815abc0 2024-09-16T15:37:20.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.973+0000 7f8e7e0db640 1 -- 172.21.15.98:0/88086205 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e7815dd20 con 0x7f8e7815abc0 2024-09-16T15:37:20.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.975+0000 7f8e6dffb640 1 -- 172.21.15.98:0/88086205 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8e70004cc0 con 0x7f8e7815abc0 2024-09-16T15:37:20.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.975+0000 7f8e6dffb640 1 -- 172.21.15.98:0/88086205 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e70005280 con 0x7f8e7815abc0 2024-09-16T15:37:20.978 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.975+0000 7f8e6dffb640 1 -- 172.21.15.98:0/88086205 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8e700057f0 con 0x7f8e7815abc0 2024-09-16T15:37:20.978 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.975+0000 7f8e6dffb640 1 -- 172.21.15.98:0/88086205 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f8e70018770 con 0x7f8e7815abc0 2024-09-16T15:37:20.979 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.976+0000 7f0041218640 1 -- start start 2024-09-16T15:37:20.979 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.977+0000 7f0041218640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f003c06fba0 0x7f003c161c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:20.979 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.977+0000 7f0041218640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f003c0af170 0x7f003c155730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:20.979 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.977+0000 7f0041218640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f003c0b2b40 0x7f003c205080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:20.979 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.977+0000 7f0041218640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f003c070100 con 0x7f003c0b2b40 2024-09-16T15:37:20.979 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.977+0000 7f0041218640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f003c06ff80 con 0x7f003c0af170 2024-09-16T15:37:20.979 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.977+0000 7f0041218640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f003c070280 con 0x7f003c06fba0 2024-09-16T15:37:20.980 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.976+0000 7f8e637fe640 1 -- 172.21.15.98:0/88086205 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e7815d060 con 0x7f8e7815abc0 2024-09-16T15:37:20.980 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.977+0000 7f003b59e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f003c0b2b40 0x7f003c205080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:20.980 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.977+0000 7f003b59e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f003c0b2b40 0x7f003c205080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60898/0 (socket says 172.21.15.98:60898) 2024-09-16T15:37:20.980 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.977+0000 7f003b59e640 1 -- 172.21.15.98:0/974567828 learned_addr learned my addr 172.21.15.98:0/974567828 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:37:20.981 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.977+0000 7f003a59c640 1 --2- 172.21.15.98:0/974567828 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f003c0af170 0x7f003c155730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:20.981 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.977+0000 7f003ad9d640 1 --2- 172.21.15.98:0/974567828 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f003c06fba0 0x7f003c161c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:20.981 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.978+0000 7f003a59c640 1 -- 172.21.15.98:0/974567828 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f003c06fba0 msgr2=0x7f003c161c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:20.981 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.978+0000 7f003a59c640 1 --2- 172.21.15.98:0/974567828 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f003c06fba0 0x7f003c161c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:20.981 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.978+0000 7f003a59c640 1 -- 172.21.15.98:0/974567828 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f003c0b2b40 msgr2=0x7f003c205080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:20.981 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.978+0000 7f003a59c640 1 --2- 172.21.15.98:0/974567828 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f003c0b2b40 0x7f003c205080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:20.981 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.978+0000 7f003a59c640 1 -- 172.21.15.98:0/974567828 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f003c205c50 con 0x7f003c0af170 2024-09-16T15:37:20.981 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.978+0000 7f003b59e640 1 --2- 172.21.15.98:0/974567828 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f003c0b2b40 0x7f003c205080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T15:37:20.981 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.978+0000 7f003a59c640 1 --2- 172.21.15.98:0/974567828 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f003c0af170 0x7f003c155730 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0034032000 tx=0x7f0034003f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:20.983 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.981+0000 7f8e6dffb640 1 -- 172.21.15.98:0/88086205 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f8e70021d00 con 0x7f8e7815abc0 2024-09-16T15:37:20.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.982+0000 7f00237fe640 1 -- 172.21.15.98:0/974567828 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0034047070 con 0x7f003c0af170 2024-09-16T15:37:20.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.982+0000 7f0041218640 1 -- 172.21.15.98:0/974567828 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f003c0ccde0 con 0x7f003c0af170 2024-09-16T15:37:20.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.982+0000 7f0041218640 1 -- 172.21.15.98:0/974567828 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f003c205ec0 con 0x7f003c0af170 2024-09-16T15:37:20.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.982+0000 7f00237fe640 1 -- 172.21.15.98:0/974567828 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0034004250 con 0x7f003c0af170 2024-09-16T15:37:20.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.982+0000 7f00237fe640 1 -- 172.21.15.98:0/974567828 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0034033050 con 0x7f003c0af170 2024-09-16T15:37:20.985 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.983+0000 7f00237fe640 1 -- 172.21.15.98:0/974567828 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0034036070 con 0x7f003c0af170 2024-09-16T15:37:20.985 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.983+0000 7f00237fe640 1 -- 172.21.15.98:0/974567828 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f0034030020 con 0x7f003c0af170 2024-09-16T15:37:20.989 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.988+0000 7f0041218640 1 -- 172.21.15.98:0/974567828 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f001c005290 con 0x7f003c0af170 2024-09-16T15:37:20.995 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:20.994+0000 7f00237fe640 1 -- 172.21.15.98:0/974567828 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f0034050020 con 0x7f003c0af170 2024-09-16T15:37:21.008 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.006+0000 7f1bc4e18640 1 -- 172.21.15.98:0/4067436639 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7f1ba4005580 con 0x7f1bc006fba0 2024-09-16T15:37:21.016 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.014+0000 7f1baeffd640 1 -- 172.21.15.98:0/4067436639 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v10)=0 v10) ==== 115+0+0 (secure 0 0 0) 0x7f1bb40194f0 con 0x7f1bc006fba0 2024-09-16T15:37:21.020 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.019+0000 7f1bc4e18640 1 -- 172.21.15.98:0/4067436639 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1bc006fba0 msgr2=0x7f1bc01601b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:21.020 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.019+0000 7f1bc4e18640 1 --2- 172.21.15.98:0/4067436639 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1bc006fba0 0x7f1bc01601b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1bb400b450 tx=0x7f1bb400b910 comp rx=0 tx=0).stop 2024-09-16T15:37:21.022 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.020+0000 7f1bc4e18640 1 -- 172.21.15.98:0/4067436639 shutdown_connections 2024-09-16T15:37:21.022 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.020+0000 7f1bc4e18640 1 --2- 172.21.15.98:0/4067436639 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1bc015e950 0x7f1bc01559b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:21.022 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.020+0000 7f1bc4e18640 1 --2- 172.21.15.98:0/4067436639 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1bc00af170 0x7f1bc0155470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:21.022 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.020+0000 7f1bc4e18640 1 --2- 172.21.15.98:0/4067436639 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1bc006fba0 0x7f1bc01601b0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:21.022 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.020+0000 7f1bc4e18640 1 -- 172.21.15.98:0/4067436639 >> 172.21.15.98:0/4067436639 conn(0x7f1bc00b1840 msgr2=0x7f1bc015c6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:21.022 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.020+0000 7f1bc4e18640 1 -- 172.21.15.98:0/4067436639 shutdown_connections 2024-09-16T15:37:21.022 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.020+0000 7f1bc4e18640 1 -- 172.21.15.98:0/4067436639 wait complete. 2024-09-16T15:37:21.037 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi098') 2024-09-16T15:37:21.044 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.042+0000 7f5d97952640 1 -- 172.21.15.98:0/4276306138 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7f5d900d1070 con 0x7f5d90155cb0 2024-09-16T15:37:21.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.048+0000 7f5d85ffb640 1 -- 172.21.15.98:0/4276306138 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v11)=0 v11) ==== 122+0+0 (secure 0 0 0) 0x7f5d88011a40 con 0x7f5d90155cb0 2024-09-16T15:37:21.054 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.052+0000 7f5d97952640 1 -- 172.21.15.98:0/4276306138 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d90155cb0 msgr2=0x7f5d90156110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:21.054 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.052+0000 7f5d97952640 1 --2- 172.21.15.98:0/4276306138 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d90155cb0 0x7f5d90156110 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5d88005fd0 tx=0x7f5d8800ee60 comp rx=0 tx=0).stop 2024-09-16T15:37:21.054 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.052+0000 7f5d97952640 1 -- 172.21.15.98:0/4276306138 shutdown_connections 2024-09-16T15:37:21.054 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.052+0000 7f5d97952640 1 --2- 172.21.15.98:0/4276306138 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d90155cb0 0x7f5d90156110 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:21.054 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.052+0000 7f5d97952640 1 --2- 172.21.15.98:0/4276306138 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5d901e5920 0x7f5d901e5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:21.054 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.052+0000 7f5d97952640 1 --2- 172.21.15.98:0/4276306138 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d7c003a50 0x7f5d900998c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:21.054 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.052+0000 7f5d97952640 1 -- 172.21.15.98:0/4276306138 >> 172.21.15.98:0/4276306138 conn(0x7f5d90074220 msgr2=0x7f5d9015bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:21.054 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.052+0000 7f5d97952640 1 -- 172.21.15.98:0/4276306138 shutdown_connections 2024-09-16T15:37:21.054 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.052+0000 7f5d97952640 1 -- 172.21.15.98:0/4276306138 wait complete. 2024-09-16T15:37:21.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.058+0000 7f08357fa640 1 -- 172.21.15.98:0/3774121512 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7f0830005580 con 0x7f08480e6d90 2024-09-16T15:37:21.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.064+0000 7f08377fe640 1 -- 172.21.15.98:0/3774121512 <== mon.2 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v12)=0 v12) ==== 121+0+0 (secure 0 0 0) 0x7f08500bed10 con 0x7f08480e6d90 2024-09-16T15:37:21.067 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.066+0000 7f08357fa640 1 -- 172.21.15.98:0/3774121512 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08480e6d90 msgr2=0x7f08480df8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:21.067 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.066+0000 7f08357fa640 1 --2- 172.21.15.98:0/3774121512 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08480e6d90 0x7f08480df8c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f085006b4b0 tx=0x7f08500bfd10 comp rx=0 tx=0).stop 2024-09-16T15:37:21.068 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.066+0000 7fac9cff9640 1 -- 172.21.15.98:0/955370432 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7facb01f58c0 con 0x7facb015da20 2024-09-16T15:37:21.068 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.066+0000 7f08357fa640 1 -- 172.21.15.98:0/3774121512 shutdown_connections 2024-09-16T15:37:21.068 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.066+0000 7f08357fa640 1 --2- 172.21.15.98:0/3774121512 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f08480e6d90 0x7f08480df8c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:21.068 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.066+0000 7f08357fa640 1 --2- 172.21.15.98:0/3774121512 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f08480e69b0 0x7f08480df380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:21.068 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.066+0000 7f08357fa640 1 --2- 172.21.15.98:0/3774121512 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f084804eb20 0x7f08480dee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:21.069 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.066+0000 7f08357fa640 1 -- 172.21.15.98:0/3774121512 >> 172.21.15.98:0/3774121512 conn(0x7f084801d770 msgr2=0x7f08480e1930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:21.069 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.066+0000 7f08357fa640 1 -- 172.21.15.98:0/3774121512 shutdown_connections 2024-09-16T15:37:21.069 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.066+0000 7f08357fa640 1 -- 172.21.15.98:0/3774121512 wait complete. 2024-09-16T15:37:21.070 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi098') 2024-09-16T15:37:21.073 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.071+0000 7f569ffff640 1 -- 172.21.15.98:0/4139105451 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7f56bc069fa0 con 0x7f56bc15f250 2024-09-16T15:37:21.073 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.072+0000 7fac9effd640 1 -- 172.21.15.98:0/955370432 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v13)=0 v13) ==== 121+0+0 (secure 0 0 0) 0x7faca00193b0 con 0x7facb015da20 2024-09-16T15:37:21.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.074+0000 7fac9cff9640 1 -- 172.21.15.98:0/955370432 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7facb015da20 msgr2=0x7facb01565f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:21.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.074+0000 7fac9cff9640 1 --2- 172.21.15.98:0/955370432 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7facb015da20 0x7facb01565f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7faca000b3f0 tx=0x7faca000b8b0 comp rx=0 tx=0).stop 2024-09-16T15:37:21.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.074+0000 7fac9cff9640 1 -- 172.21.15.98:0/955370432 shutdown_connections 2024-09-16T15:37:21.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.075+0000 7fac9cff9640 1 --2- 172.21.15.98:0/955370432 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7facb015da20 0x7facb01565f0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:21.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.075+0000 7fac9cff9640 1 --2- 172.21.15.98:0/955370432 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7facb00d0900 0x7facb01560b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:21.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.075+0000 7fac9cff9640 1 --2- 172.21.15.98:0/955370432 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facb00cffa0 0x7facb0154540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:21.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.075+0000 7fac9cff9640 1 -- 172.21.15.98:0/955370432 >> 172.21.15.98:0/955370432 conn(0x7facb0074240 msgr2=0x7facb006fc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:21.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.075+0000 7fac9cff9640 1 -- 172.21.15.98:0/955370432 shutdown_connections 2024-09-16T15:37:21.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.075+0000 7fac9cff9640 1 -- 172.21.15.98:0/955370432 wait complete. 2024-09-16T15:37:21.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.077+0000 7f56b27fc640 1 -- 172.21.15.98:0/4139105451 <== mon.2 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v14)=0 v14) ==== 119+0+0 (secure 0 0 0) 0x7f56bc069fa0 con 0x7f56bc15f250 2024-09-16T15:37:21.088 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.086+0000 7f569ffff640 1 -- 172.21.15.98:0/4139105451 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f56bc15f250 msgr2=0x7f56bc0c6410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:21.088 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.086+0000 7f569ffff640 1 --2- 172.21.15.98:0/4139105451 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f56bc15f250 0x7f56bc0c6410 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f56ac00b3e0 tx=0x7f56ac00b8a0 comp rx=0 tx=0).stop 2024-09-16T15:37:21.089 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi098') 2024-09-16T15:37:21.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.086+0000 7f569ffff640 1 -- 172.21.15.98:0/4139105451 shutdown_connections 2024-09-16T15:37:21.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.086+0000 7f569ffff640 1 --2- 172.21.15.98:0/4139105451 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f56bc15f250 0x7f56bc0c6410 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:21.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.086+0000 7f569ffff640 1 --2- 172.21.15.98:0/4139105451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56bc15ab40 0x7f56bc0c5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:21.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.086+0000 7f569ffff640 1 --2- 172.21.15.98:0/4139105451 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f56bc073790 0x7f56bc150ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:21.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.086+0000 7f569ffff640 1 -- 172.21.15.98:0/4139105451 >> 172.21.15.98:0/4139105451 conn(0x7f56bc0d0d40 msgr2=0x7f56bc0b1860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:21.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.086+0000 7f90cdc39640 1 -- 172.21.15.98:0/2377327522 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7f90c80d0900 con 0x7f90c8155cf0 2024-09-16T15:37:21.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.086+0000 7f569ffff640 1 -- 172.21.15.98:0/4139105451 shutdown_connections 2024-09-16T15:37:21.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.086+0000 7f569ffff640 1 -- 172.21.15.98:0/4139105451 wait complete. 2024-09-16T15:37:21.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.093+0000 7f90c57fa640 1 -- 172.21.15.98:0/2377327522 <== mon.2 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v15)=0 v15) ==== 121+0+0 (secure 0 0 0) 0x7f90b8005200 con 0x7f90c8155cf0 2024-09-16T15:37:21.097 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.094+0000 7f90cdc39640 1 -- 172.21.15.98:0/2377327522 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f90c8155cf0 msgr2=0x7f90c8156180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:21.097 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.094+0000 7f90cdc39640 1 --2- 172.21.15.98:0/2377327522 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f90c8155cf0 0x7f90c8156180 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f90b800d590 tx=0x7f90b800da50 comp rx=0 tx=0).stop 2024-09-16T15:37:21.097 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.095+0000 7f90cdc39640 1 -- 172.21.15.98:0/2377327522 shutdown_connections 2024-09-16T15:37:21.097 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.095+0000 7f90cdc39640 1 --2- 172.21.15.98:0/2377327522 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f90c8155cf0 0x7f90c8156180 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:21.097 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.095+0000 7f90cdc39640 1 --2- 172.21.15.98:0/2377327522 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90c81fd3e0 0x7f90c81f9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:21.097 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.095+0000 7f90cdc39640 1 --2- 172.21.15.98:0/2377327522 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f90c80cde20 0x7f90c80aea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:21.097 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.095+0000 7f90cdc39640 1 -- 172.21.15.98:0/2377327522 >> 172.21.15.98:0/2377327522 conn(0x7f90c80cf9f0 msgr2=0x7f90c80b51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:21.097 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.095+0000 7f90cdc39640 1 -- 172.21.15.98:0/2377327522 shutdown_connections 2024-09-16T15:37:21.098 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.095+0000 7f90cdc39640 1 -- 172.21.15.98:0/2377327522 wait complete. 2024-09-16T15:37:21.105 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi098') 2024-09-16T15:37:21.106 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi098') 2024-09-16T15:37:21.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.118+0000 7f8e637fe640 1 -- 172.21.15.98:0/88086205 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f8e780d0900 con 0x7f8e7815abc0 2024-09-16T15:37:21.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.119+0000 7f2b51ffb640 1 -- 172.21.15.98:0/472515275 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f2b680d2280 con 0x7f2b68162580 2024-09-16T15:37:21.123 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.122+0000 7f8e6dffb640 1 -- 172.21.15.98:0/88086205 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v16)=0 v16) ==== 120+0+0 (secure 0 0 0) 0x7f8e700189c0 con 0x7f8e7815abc0 2024-09-16T15:37:21.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.123+0000 7f8e637fe640 1 -- 172.21.15.98:0/88086205 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e7815abc0 msgr2=0x7f8e7815b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:21.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.123+0000 7f8e637fe640 1 --2- 172.21.15.98:0/88086205 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e7815abc0 0x7f8e7815b040 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8e7000ecb0 tx=0x7f8e7000c6a0 comp rx=0 tx=0).stop 2024-09-16T15:37:21.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.123+0000 7f8e637fe640 1 -- 172.21.15.98:0/88086205 shutdown_connections 2024-09-16T15:37:21.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.123+0000 7f8e637fe640 1 --2- 172.21.15.98:0/88086205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e780c6ac0 0x7f8e780c6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:21.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.123+0000 7f8e637fe640 1 --2- 172.21.15.98:0/88086205 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e7815abc0 0x7f8e7815b040 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:21.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.123+0000 7f8e637fe640 1 --2- 172.21.15.98:0/88086205 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8e64003a50 0x7f8e7815e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:21.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.123+0000 7f8e637fe640 1 -- 172.21.15.98:0/88086205 >> 172.21.15.98:0/88086205 conn(0x7f8e780cf9f0 msgr2=0x7f8e78072740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:21.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.123+0000 7f8e637fe640 1 -- 172.21.15.98:0/88086205 shutdown_connections 2024-09-16T15:37:21.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.123+0000 7f8e637fe640 1 -- 172.21.15.98:0/88086205 wait complete. 2024-09-16T15:37:21.127 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.125+0000 7f2b53fff640 1 -- 172.21.15.98:0/472515275 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v17)=0 v17) ==== 121+0+0 (secure 0 0 0) 0x7f2b54003c90 con 0x7f2b68162580 2024-09-16T15:37:21.129 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.126+0000 7f2b51ffb640 1 -- 172.21.15.98:0/472515275 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b68162580 msgr2=0x7f2b6809f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:21.129 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.126+0000 7f2b51ffb640 1 --2- 172.21.15.98:0/472515275 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b68162580 0x7f2b6809f0f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2b5400c460 tx=0x7f2b5400c920 comp rx=0 tx=0).stop 2024-09-16T15:37:21.129 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.126+0000 7f2b51ffb640 1 -- 172.21.15.98:0/472515275 shutdown_connections 2024-09-16T15:37:21.129 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.126+0000 7f2b51ffb640 1 --2- 172.21.15.98:0/472515275 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b68162580 0x7f2b6809f0f0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:21.129 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.126+0000 7f2b51ffb640 1 --2- 172.21.15.98:0/472515275 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2b681619e0 0x7f2b680caaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:21.129 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.126+0000 7f2b51ffb640 1 --2- 172.21.15.98:0/472515275 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2b680b7910 0x7f2b6809cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:21.129 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.126+0000 7f2b51ffb640 1 -- 172.21.15.98:0/472515275 >> 172.21.15.98:0/472515275 conn(0x7f2b680d1c50 msgr2=0x7f2b680b6830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:21.129 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.127+0000 7f2b51ffb640 1 -- 172.21.15.98:0/472515275 shutdown_connections 2024-09-16T15:37:21.129 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.127+0000 7f2b51ffb640 1 -- 172.21.15.98:0/472515275 wait complete. 2024-09-16T15:37:21.136 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi098') 2024-09-16T15:37:21.137 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.134+0000 7fdc1b7f8640 1 -- 172.21.15.98:0/2114590174 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7fdc140b6cc0 con 0x7fdc14154480 2024-09-16T15:37:21.140 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.138+0000 7fdc09ffb640 1 -- 172.21.15.98:0/2114590174 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v18)=0 v18) ==== 120+0+0 (secure 0 0 0) 0x7fdc0c038d10 con 0x7fdc14154480 2024-09-16T15:37:21.142 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.139+0000 7fdc1b7f8640 1 -- 172.21.15.98:0/2114590174 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc14154480 msgr2=0x7fdc142162c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:21.142 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.139+0000 7fdc1b7f8640 1 --2- 172.21.15.98:0/2114590174 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc14154480 0x7fdc142162c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c009d90 tx=0x7fdc0c009860 comp rx=0 tx=0).stop 2024-09-16T15:37:21.142 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.140+0000 7fdc1b7f8640 1 -- 172.21.15.98:0/2114590174 shutdown_connections 2024-09-16T15:37:21.142 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.140+0000 7fdc1b7f8640 1 --2- 172.21.15.98:0/2114590174 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc14154480 0x7fdc142162c0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:21.142 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.140+0000 7fdc1b7f8640 1 --2- 172.21.15.98:0/2114590174 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdc1415dff0 0x7fdc140c7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:21.142 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.140+0000 7fdc1b7f8640 1 --2- 172.21.15.98:0/2114590174 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc140d01a0 0x7fdc140b64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:21.142 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.140+0000 7fdc1b7f8640 1 -- 172.21.15.98:0/2114590174 >> 172.21.15.98:0/2114590174 conn(0x7fdc140d0d40 msgr2=0x7fdc14074100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:21.142 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.140+0000 7fdc1b7f8640 1 -- 172.21.15.98:0/2114590174 shutdown_connections 2024-09-16T15:37:21.142 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.140+0000 7fdc1b7f8640 1 -- 172.21.15.98:0/2114590174 wait complete. 2024-09-16T15:37:21.152 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi098') 2024-09-16T15:37:21.152 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mon', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi098') 2024-09-16T15:37:21.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.170+0000 7f0041218640 1 -- 172.21.15.98:0/974567828 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7f001c005580 con 0x7f003c0af170 2024-09-16T15:37:21.175 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.173+0000 7f00237fe640 1 -- 172.21.15.98:0/974567828 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v19)=0 v19) ==== 125+0+0 (secure 0 0 0) 0x7f00340046a0 con 0x7f003c0af170 2024-09-16T15:37:21.176 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.174+0000 7f0041218640 1 -- 172.21.15.98:0/974567828 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f003c0af170 msgr2=0x7f003c155730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:21.177 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.174+0000 7f0041218640 1 --2- 172.21.15.98:0/974567828 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f003c0af170 0x7f003c155730 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0034032000 tx=0x7f0034003f10 comp rx=0 tx=0).stop 2024-09-16T15:37:21.177 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.174+0000 7f0041218640 1 -- 172.21.15.98:0/974567828 shutdown_connections 2024-09-16T15:37:21.177 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.174+0000 7f0041218640 1 --2- 172.21.15.98:0/974567828 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f003c0b2b40 0x7f003c205080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:21.177 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.174+0000 7f0041218640 1 --2- 172.21.15.98:0/974567828 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f003c0af170 0x7f003c155730 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:21.177 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.174+0000 7f0041218640 1 --2- 172.21.15.98:0/974567828 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f003c06fba0 0x7f003c161c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:21.177 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.174+0000 7f0041218640 1 -- 172.21.15.98:0/974567828 >> 172.21.15.98:0/974567828 conn(0x7f003c0b1840 msgr2=0x7f003c0b1c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:21.177 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.174+0000 7f0041218640 1 -- 172.21.15.98:0/974567828 shutdown_connections 2024-09-16T15:37:21.177 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.174+0000 7f0041218640 1 -- 172.21.15.98:0/974567828 wait complete. 2024-09-16T15:37:21.187 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi098') 2024-09-16T15:37:21.187 INFO:tasks.ceph:Setting crush tunables to default 2024-09-16T15:37:21.187 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --cluster ceph osd crush tunables default 2024-09-16T15:37:21.329 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.327+0000 7f9100440640 1 -- 172.21.15.98:0/3362076877 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f90f815ad50 msgr2=0x7f90f815e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:21.329 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.327+0000 7f9100440640 1 --2- 172.21.15.98:0/3362076877 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f90f815ad50 0x7f90f815e9a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f90f4009890 tx=0x7f90f402a5f0 comp rx=0 tx=0).stop 2024-09-16T15:37:21.329 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.327+0000 7f9100440640 1 -- 172.21.15.98:0/3362076877 shutdown_connections 2024-09-16T15:37:21.329 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.327+0000 7f9100440640 1 --2- 172.21.15.98:0/3362076877 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f90f815ad50 0x7f90f815e9a0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:21.329 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.327+0000 7f9100440640 1 -- 172.21.15.98:0/3362076877 >> 172.21.15.98:0/3362076877 conn(0x7f90f80cd6f0 msgr2=0x7f90f80cdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:21.329 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.327+0000 7f9100440640 1 -- 172.21.15.98:0/3362076877 shutdown_connections 2024-09-16T15:37:21.329 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.327+0000 7f9100440640 1 -- 172.21.15.98:0/3362076877 wait complete. 2024-09-16T15:37:21.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.328+0000 7f9100440640 1 Processor -- start 2024-09-16T15:37:21.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.328+0000 7f9100440640 1 -- start start 2024-09-16T15:37:21.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.329+0000 7f9100440640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f90f80cbc40 0x7f90f8158880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:21.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.329+0000 7f9100440640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f90f80cf430 0x7f90f814da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:21.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.329+0000 7f9100440640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90f815ad50 0x7f90f815eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:21.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.329+0000 7f9100440640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f90f80cfff0 con 0x7f90f815ad50 2024-09-16T15:37:21.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.329+0000 7f9100440640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f90f815f800 con 0x7f90f80cbc40 2024-09-16T15:37:21.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.329+0000 7f9100440640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f90f80d0170 con 0x7f90f80cf430 2024-09-16T15:37:21.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.329+0000 7f90fe9dd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90f815ad50 0x7f90f815eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:21.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.329+0000 7f90fe9dd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90f815ad50 0x7f90f815eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60908/0 (socket says 172.21.15.98:60908) 2024-09-16T15:37:21.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.329+0000 7f90fe9dd640 1 -- 172.21.15.98:0/2961048073 learned_addr learned my addr 172.21.15.98:0/2961048073 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:37:21.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.329+0000 7f90fe1dc640 1 --2- 172.21.15.98:0/2961048073 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f90f80cbc40 0x7f90f8158880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:21.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.329+0000 7f90fd9db640 1 --2- 172.21.15.98:0/2961048073 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f90f80cf430 0x7f90f814da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:21.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.329+0000 7f90fe9dd640 1 -- 172.21.15.98:0/2961048073 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f90f80cf430 msgr2=0x7f90f814da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:21.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.329+0000 7f90fe9dd640 1 --2- 172.21.15.98:0/2961048073 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f90f80cf430 0x7f90f814da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:21.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.329+0000 7f90fe9dd640 1 -- 172.21.15.98:0/2961048073 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f90f80cbc40 msgr2=0x7f90f8158880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:21.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.329+0000 7f90fe9dd640 1 --2- 172.21.15.98:0/2961048073 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f90f80cbc40 0x7f90f8158880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:21.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.329+0000 7f90fe9dd640 1 -- 172.21.15.98:0/2961048073 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90f8070e40 con 0x7f90f815ad50 2024-09-16T15:37:21.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.329+0000 7f90fe9dd640 1 --2- 172.21.15.98:0/2961048073 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90f815ad50 0x7f90f815eeb0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f90f000cc40 tx=0x7f90f000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:21.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.329+0000 7f90eeffd640 1 -- 172.21.15.98:0/2961048073 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90f0016020 con 0x7f90f815ad50 2024-09-16T15:37:21.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.329+0000 7f90eeffd640 1 -- 172.21.15.98:0/2961048073 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f90f0012420 con 0x7f90f815ad50 2024-09-16T15:37:21.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.329+0000 7f9100440640 1 -- 172.21.15.98:0/2961048073 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90f8071120 con 0x7f90f815ad50 2024-09-16T15:37:21.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.330+0000 7f90eeffd640 1 -- 172.21.15.98:0/2961048073 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90f00128b0 con 0x7f90f815ad50 2024-09-16T15:37:21.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.330+0000 7f9100440640 1 -- 172.21.15.98:0/2961048073 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90f80716e0 con 0x7f90f815ad50 2024-09-16T15:37:21.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.330+0000 7f90eeffd640 1 -- 172.21.15.98:0/2961048073 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f90f0019020 con 0x7f90f815ad50 2024-09-16T15:37:21.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.330+0000 7f90eeffd640 1 -- 172.21.15.98:0/2961048073 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f90f001a3b0 con 0x7f90f815ad50 2024-09-16T15:37:21.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.330+0000 7f9100440640 1 -- 172.21.15.98:0/2961048073 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90f80d06d0 con 0x7f90f815ad50 2024-09-16T15:37:21.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.332+0000 7f90eeffd640 1 -- 172.21.15.98:0/2961048073 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f90f0020020 con 0x7f90f815ad50 2024-09-16T15:37:21.400 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.398+0000 7f9100440640 1 -- 172.21.15.98:0/2961048073 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f90f80caf90 con 0x7f90f815ad50 2024-09-16T15:37:21.401 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.399+0000 7f90eeffd640 1 -- 172.21.15.98:0/2961048073 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f90f001b400 con 0x7f90f815ad50 2024-09-16T15:37:21.401 INFO:teuthology.orchestra.run.smithi098.stderr:adjusted tunables profile to default 2024-09-16T15:37:21.402 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.400+0000 7f9100440640 1 -- 172.21.15.98:0/2961048073 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90f815ad50 msgr2=0x7f90f815eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:21.402 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.400+0000 7f9100440640 1 --2- 172.21.15.98:0/2961048073 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90f815ad50 0x7f90f815eeb0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f90f000cc40 tx=0x7f90f000a430 comp rx=0 tx=0).stop 2024-09-16T15:37:21.402 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.400+0000 7f9100440640 1 -- 172.21.15.98:0/2961048073 shutdown_connections 2024-09-16T15:37:21.402 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.400+0000 7f9100440640 1 --2- 172.21.15.98:0/2961048073 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90f815ad50 0x7f90f815eeb0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:21.403 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.400+0000 7f9100440640 1 --2- 172.21.15.98:0/2961048073 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f90f80cf430 0x7f90f814da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:21.403 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.400+0000 7f9100440640 1 --2- 172.21.15.98:0/2961048073 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f90f80cbc40 0x7f90f8158880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:21.403 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.400+0000 7f9100440640 1 -- 172.21.15.98:0/2961048073 >> 172.21.15.98:0/2961048073 conn(0x7f90f80cd6f0 msgr2=0x7f90f80cb2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:21.403 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.400+0000 7f9100440640 1 -- 172.21.15.98:0/2961048073 shutdown_connections 2024-09-16T15:37:21.403 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:21.400+0000 7f9100440640 1 -- 172.21.15.98:0/2961048073 wait complete. 2024-09-16T15:37:21.412 INFO:tasks.ceph:check_enable_crimson: False 2024-09-16T15:37:21.412 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-16T15:37:21.413 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-16T15:37:21.413 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-16T15:37:21.436 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-16T15:37:21.436 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-16T15:37:21.501 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-16T15:37:21.501 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-16T15:37:21.566 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-16T15:37:21.566 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-16T15:37:21.630 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-16T15:37:21.630 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-16T15:37:21.655 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-16T15:37:21.655 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-16T15:37:21.720 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-16T15:37:21.720 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-16T15:37:21.784 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-16T15:37:21.785 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-16T15:37:21.850 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new a2d61df4-2577-47e6-a4ac-c36bbb85ab8a 0 2024-09-16T15:37:21.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:21.991+0000 7f544e6c6640 1 -- 172.21.15.135:0/1888991487 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54481605e0 msgr2=0x7f54480d0290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:21.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:21.991+0000 7f544e6c6640 1 --2- 172.21.15.135:0/1888991487 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54481605e0 0x7f54480d0290 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f544806da60 tx=0x7f543802a540 comp rx=0 tx=0).stop 2024-09-16T15:37:21.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:21.991+0000 7f544e6c6640 1 -- 172.21.15.135:0/1888991487 shutdown_connections 2024-09-16T15:37:21.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:21.991+0000 7f544e6c6640 1 --2- 172.21.15.135:0/1888991487 >> v2:172.21.15.98:3300/0 conn(0x7f54480afad0 0x7f54480d07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:21.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:21.991+0000 7f544e6c6640 1 --2- 172.21.15.135:0/1888991487 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54481605e0 0x7f54480d0290 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:21.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:21.991+0000 7f544e6c6640 1 -- 172.21.15.135:0/1888991487 >> 172.21.15.135:0/1888991487 conn(0x7f544809b080 msgr2=0x7f54480d1e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:21.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:21.991+0000 7f544e6c6640 1 -- 172.21.15.135:0/1888991487 shutdown_connections 2024-09-16T15:37:21.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:21.991+0000 7f544e6c6640 1 -- 172.21.15.135:0/1888991487 wait complete. 2024-09-16T15:37:21.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:21.992+0000 7f544e6c6640 1 Processor -- start 2024-09-16T15:37:21.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:21.992+0000 7f544e6c6640 1 -- start start 2024-09-16T15:37:21.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:21.993+0000 7f544e6c6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f54480afad0 0x7f54480c8f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:21.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:21.993+0000 7f544e6c6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54481605e0 0x7f544806f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:21.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:21.993+0000 7f544e6c6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f54481609c0 0x7f54481f5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:21.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:21.993+0000 7f544e6c6640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f54480cfec0 con 0x7f54481609c0 2024-09-16T15:37:21.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:21.993+0000 7f544e6c6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f54480cfd40 con 0x7f54481605e0 2024-09-16T15:37:21.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:21.993+0000 7f544e6c6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f54480d0040 con 0x7f54480afad0 2024-09-16T15:37:21.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:21.993+0000 7f5447fff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f54480afad0 0x7f54480c8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:21.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:21.993+0000 7f54477fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54481605e0 0x7f544806f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:21.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:21.993+0000 7f5447fff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f54480afad0 0x7f54480c8f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.135:45692/0 (socket says 172.21.15.135:45692) 2024-09-16T15:37:21.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:21.993+0000 7f54477fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54481605e0 0x7f544806f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42244/0 (socket says 172.21.15.135:42244) 2024-09-16T15:37:21.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:21.993+0000 7f5447fff640 1 -- 172.21.15.135:0/1770020635 learned_addr learned my addr 172.21.15.135:0/1770020635 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-09-16T15:37:21.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:21.993+0000 7f544cc63640 1 --2- 172.21.15.135:0/1770020635 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f54481609c0 0x7f54481f5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:21.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:21.994+0000 7f54477fe640 1 -- 172.21.15.135:0/1770020635 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f54480afad0 msgr2=0x7f54480c8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:21.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:21.994+0000 7f54477fe640 1 --2- 172.21.15.135:0/1770020635 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f54480afad0 0x7f54480c8f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:21.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:21.994+0000 7f54477fe640 1 -- 172.21.15.135:0/1770020635 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f54481609c0 msgr2=0x7f54481f5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:21.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:21.994+0000 7f54477fe640 1 --2- 172.21.15.135:0/1770020635 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f54481609c0 0x7f54481f5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:21.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:21.994+0000 7f54477fe640 1 -- 172.21.15.135:0/1770020635 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f544806f5c0 con 0x7f54481605e0 2024-09-16T15:37:21.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:21.994+0000 7f5447fff640 1 --2- 172.21.15.135:0/1770020635 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f54480afad0 0x7f54480c8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T15:37:21.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:21.994+0000 7f54477fe640 1 --2- 172.21.15.135:0/1770020635 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54481605e0 0x7f544806f080 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5448160da0 tx=0x7f543000b870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:21.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:21.994+0000 7f5444ff9640 1 -- 172.21.15.135:0/1770020635 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5430015030 con 0x7f54481605e0 2024-09-16T15:37:21.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:21.994+0000 7f5444ff9640 1 -- 172.21.15.135:0/1770020635 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5430004020 con 0x7f54481605e0 2024-09-16T15:37:21.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:21.994+0000 7f544e6c6640 1 -- 172.21.15.135:0/1770020635 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54480c9560 con 0x7f54481605e0 2024-09-16T15:37:21.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:21.994+0000 7f5444ff9640 1 -- 172.21.15.135:0/1770020635 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5430011630 con 0x7f54481605e0 2024-09-16T15:37:21.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:21.994+0000 7f544e6c6640 1 -- 172.21.15.135:0/1770020635 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54480c9b20 con 0x7f54481605e0 2024-09-16T15:37:21.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:21.994+0000 7f5444ff9640 1 -- 172.21.15.135:0/1770020635 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5430018070 con 0x7f54481605e0 2024-09-16T15:37:21.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:21.994+0000 7f5444ff9640 1 -- 172.21.15.135:0/1770020635 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f543001a410 con 0x7f54481605e0 2024-09-16T15:37:21.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:21.995+0000 7f544e6c6640 1 -- 172.21.15.135:0/1770020635 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54480cee70 con 0x7f54481605e0 2024-09-16T15:37:21.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:21.997+0000 7f5444ff9640 1 -- 172.21.15.135:0/1770020635 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f54300035f0 con 0x7f54481605e0 2024-09-16T15:37:22.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.068+0000 7f544e6c6640 1 -- 172.21.15.135:0/1770020635 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a2d61df4-2577-47e6-a4ac-c36bbb85ab8a", "id": 0} v 0) -- 0x7f54480b0790 con 0x7f54481605e0 2024-09-16T15:37:22.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.071+0000 7f5444ff9640 1 -- 172.21.15.135:0/1770020635 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a2d61df4-2577-47e6-a4ac-c36bbb85ab8a", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f5430011910 con 0x7f54481605e0 2024-09-16T15:37:22.072 INFO:teuthology.orchestra.run.smithi135.stdout:0 2024-09-16T15:37:22.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.072+0000 7f544e6c6640 1 -- 172.21.15.135:0/1770020635 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54481605e0 msgr2=0x7f544806f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:22.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.072+0000 7f544e6c6640 1 --2- 172.21.15.135:0/1770020635 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54481605e0 0x7f544806f080 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5448160da0 tx=0x7f543000b870 comp rx=0 tx=0).stop 2024-09-16T15:37:22.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.072+0000 7f544e6c6640 1 -- 172.21.15.135:0/1770020635 shutdown_connections 2024-09-16T15:37:22.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.072+0000 7f544e6c6640 1 --2- 172.21.15.135:0/1770020635 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f54481609c0 0x7f54481f5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:22.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.072+0000 7f544e6c6640 1 --2- 172.21.15.135:0/1770020635 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54481605e0 0x7f544806f080 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:22.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.072+0000 7f544e6c6640 1 --2- 172.21.15.135:0/1770020635 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f54480afad0 0x7f54480c8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:22.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.072+0000 7f544e6c6640 1 -- 172.21.15.135:0/1770020635 >> 172.21.15.135:0/1770020635 conn(0x7f544809b080 msgr2=0x7f544815f880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:22.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.072+0000 7f544e6c6640 1 -- 172.21.15.135:0/1770020635 shutdown_connections 2024-09-16T15:37:22.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.072+0000 7f544e6c6640 1 -- 172.21.15.135:0/1770020635 wait complete. 2024-09-16T15:37:22.084 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new bb3a68a5-c22f-442b-b292-7c272fe01ff2 1 2024-09-16T15:37:22.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.184+0000 7f57ce0b8640 1 -- 172.21.15.135:0/566966483 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57c80ad620 msgr2=0x7f57c80ada70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:22.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.184+0000 7f57ce0b8640 1 --2- 172.21.15.135:0/566966483 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57c80ad620 0x7f57c80ada70 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f57c0005fd0 tx=0x7f57c002aae0 comp rx=0 tx=0).stop 2024-09-16T15:37:22.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.184+0000 7f57ce0b8640 1 -- 172.21.15.135:0/566966483 shutdown_connections 2024-09-16T15:37:22.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.184+0000 7f57ce0b8640 1 --2- 172.21.15.135:0/566966483 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57c80ad620 0x7f57c80ada70 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:22.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.184+0000 7f57ce0b8640 1 --2- 172.21.15.135:0/566966483 >> v2:172.21.15.98:3300/0 conn(0x7f57c80ce1f0 0x7f57c80ce660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:22.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.184+0000 7f57ce0b8640 1 -- 172.21.15.135:0/566966483 >> 172.21.15.135:0/566966483 conn(0x7f57c8074240 msgr2=0x7f57c8074650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:22.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.184+0000 7f57ce0b8640 1 -- 172.21.15.135:0/566966483 shutdown_connections 2024-09-16T15:37:22.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.184+0000 7f57ce0b8640 1 -- 172.21.15.135:0/566966483 wait complete. 2024-09-16T15:37:22.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.185+0000 7f57ce0b8640 1 Processor -- start 2024-09-16T15:37:22.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.186+0000 7f57ce0b8640 1 -- start start 2024-09-16T15:37:22.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.186+0000 7f57ce0b8640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f57c80ad620 0x7f57c81594e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:22.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.186+0000 7f57ce0b8640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f57c80ce1f0 0x7f57c80ca030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:22.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.186+0000 7f57ce0b8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57c815e2a0 0x7f57c80c7d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:22.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.186+0000 7f57ce0b8640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f57c815e800 con 0x7f57c80ce1f0 2024-09-16T15:37:22.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.186+0000 7f57ce0b8640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f57c815e680 con 0x7f57c815e2a0 2024-09-16T15:37:22.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.186+0000 7f57ce0b8640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f57c80adfb0 con 0x7f57c80ad620 2024-09-16T15:37:22.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.187+0000 7f57c7fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57c815e2a0 0x7f57c80c7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:22.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.187+0000 7f57c77fe640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f57c80ad620 0x7f57c81594e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:22.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.187+0000 7f57c7fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57c815e2a0 0x7f57c80c7d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42256/0 (socket says 172.21.15.135:42256) 2024-09-16T15:37:22.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.187+0000 7f57c7fff640 1 -- 172.21.15.135:0/1180663289 learned_addr learned my addr 172.21.15.135:0/1180663289 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-09-16T15:37:22.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.187+0000 7f57c6ffd640 1 --2- 172.21.15.135:0/1180663289 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f57c80ce1f0 0x7f57c80ca030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:22.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.187+0000 7f57c7fff640 1 -- 172.21.15.135:0/1180663289 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f57c80ad620 msgr2=0x7f57c81594e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:22.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.187+0000 7f57c7fff640 1 --2- 172.21.15.135:0/1180663289 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f57c80ad620 0x7f57c81594e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:22.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.187+0000 7f57c7fff640 1 -- 172.21.15.135:0/1180663289 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f57c80ce1f0 msgr2=0x7f57c80ca030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:22.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.187+0000 7f57c7fff640 1 --2- 172.21.15.135:0/1180663289 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f57c80ce1f0 0x7f57c80ca030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:22.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.187+0000 7f57c7fff640 1 -- 172.21.15.135:0/1180663289 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57c8159a20 con 0x7f57c815e2a0 2024-09-16T15:37:22.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.187+0000 7f57c77fe640 1 --2- 172.21.15.135:0/1180663289 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f57c80ad620 0x7f57c81594e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T15:37:22.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.187+0000 7f57c6ffd640 1 --2- 172.21.15.135:0/1180663289 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f57c80ce1f0 0x7f57c80ca030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T15:37:22.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.187+0000 7f57c7fff640 1 --2- 172.21.15.135:0/1180663289 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57c815e2a0 0x7f57c80c7d90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f57c0006010 tx=0x7f57c0003f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:22.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.187+0000 7f57bffff640 1 -- 172.21.15.135:0/1180663289 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57c0046070 con 0x7f57c815e2a0 2024-09-16T15:37:22.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.187+0000 7f57bffff640 1 -- 172.21.15.135:0/1180663289 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f57c002e800 con 0x7f57c815e2a0 2024-09-16T15:37:22.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.187+0000 7f57bffff640 1 -- 172.21.15.135:0/1180663289 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57c00044b0 con 0x7f57c815e2a0 2024-09-16T15:37:22.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.187+0000 7f57ce0b8640 1 -- 172.21.15.135:0/1180663289 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57c80c69d0 con 0x7f57c815e2a0 2024-09-16T15:37:22.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.187+0000 7f57ce0b8640 1 -- 172.21.15.135:0/1180663289 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57c81f3a30 con 0x7f57c815e2a0 2024-09-16T15:37:22.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.188+0000 7f57bffff640 1 -- 172.21.15.135:0/1180663289 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f57c0049070 con 0x7f57c815e2a0 2024-09-16T15:37:22.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.188+0000 7f57bffff640 1 -- 172.21.15.135:0/1180663289 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f57c004b7f0 con 0x7f57c815e2a0 2024-09-16T15:37:22.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.188+0000 7f57ce0b8640 1 -- 172.21.15.135:0/1180663289 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57c80ada70 con 0x7f57c815e2a0 2024-09-16T15:37:22.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.190+0000 7f57bffff640 1 -- 172.21.15.135:0/1180663289 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f57c0050020 con 0x7f57c815e2a0 2024-09-16T15:37:22.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.260+0000 7f57ce0b8640 1 -- 172.21.15.135:0/1180663289 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd new", "uuid": "bb3a68a5-c22f-442b-b292-7c272fe01ff2", "id": 1} v 0) -- 0x7f57c8074ea0 con 0x7f57c815e2a0 2024-09-16T15:37:22.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.264+0000 7f57bffff640 1 -- 172.21.15.135:0/1180663289 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bb3a68a5-c22f-442b-b292-7c272fe01ff2", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f57c0032030 con 0x7f57c815e2a0 2024-09-16T15:37:22.265 INFO:teuthology.orchestra.run.smithi135.stdout:1 2024-09-16T15:37:22.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.265+0000 7f57ce0b8640 1 -- 172.21.15.135:0/1180663289 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57c815e2a0 msgr2=0x7f57c80c7d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:22.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.265+0000 7f57ce0b8640 1 --2- 172.21.15.135:0/1180663289 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57c815e2a0 0x7f57c80c7d90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f57c0006010 tx=0x7f57c0003f10 comp rx=0 tx=0).stop 2024-09-16T15:37:22.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.265+0000 7f57ce0b8640 1 -- 172.21.15.135:0/1180663289 shutdown_connections 2024-09-16T15:37:22.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.265+0000 7f57ce0b8640 1 --2- 172.21.15.135:0/1180663289 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57c815e2a0 0x7f57c80c7d90 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:22.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.265+0000 7f57ce0b8640 1 --2- 172.21.15.135:0/1180663289 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f57c80ce1f0 0x7f57c80ca030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:22.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.265+0000 7f57ce0b8640 1 --2- 172.21.15.135:0/1180663289 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f57c80ad620 0x7f57c81594e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:22.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.265+0000 7f57ce0b8640 1 -- 172.21.15.135:0/1180663289 >> 172.21.15.135:0/1180663289 conn(0x7f57c8074240 msgr2=0x7f57c80c3f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:22.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.265+0000 7f57ce0b8640 1 -- 172.21.15.135:0/1180663289 shutdown_connections 2024-09-16T15:37:22.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.265+0000 7f57ce0b8640 1 -- 172.21.15.135:0/1180663289 wait complete. 2024-09-16T15:37:22.277 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new c8429195-a480-409b-8e5f-8dc4c6abc0a1 2 2024-09-16T15:37:22.380 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.379+0000 7f22f9d32640 1 -- 172.21.15.135:0/1582427660 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22e0003c30 msgr2=0x7f22e0004030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:22.380 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.379+0000 7f22f9d32640 1 --2- 172.21.15.135:0/1582427660 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22e0003c30 0x7f22e0004030 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f22e4009b50 tx=0x7f22e0005830 comp rx=0 tx=0).stop 2024-09-16T15:37:22.380 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.379+0000 7f22f9d32640 1 -- 172.21.15.135:0/1582427660 shutdown_connections 2024-09-16T15:37:22.380 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.379+0000 7f22f9d32640 1 --2- 172.21.15.135:0/1582427660 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22e0003c30 0x7f22e0004030 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:22.380 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.379+0000 7f22f9d32640 1 -- 172.21.15.135:0/1582427660 >> 172.21.15.135:0/1582427660 conn(0x7f22f40cd750 msgr2=0x7f22f40cdb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:22.381 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.379+0000 7f22f9d32640 1 -- 172.21.15.135:0/1582427660 shutdown_connections 2024-09-16T15:37:22.381 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.379+0000 7f22f9d32640 1 -- 172.21.15.135:0/1582427660 wait complete. 2024-09-16T15:37:22.381 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.380+0000 7f22f9d32640 1 Processor -- start 2024-09-16T15:37:22.381 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.380+0000 7f22f9d32640 1 -- start start 2024-09-16T15:37:22.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.381+0000 7f22f9d32640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22e0003c30 0x7f22f4159af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:22.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.381+0000 7f22f9d32640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22f415ba10 0x7f22f40ca210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:22.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.381+0000 7f22f9d32640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22f415be70 0x7f22f409aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:22.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.381+0000 7f22f9d32640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f22f40cea20 con 0x7f22f415be70 2024-09-16T15:37:22.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.381+0000 7f22f9d32640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f22f40ce8a0 con 0x7f22f415ba10 2024-09-16T15:37:22.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.381+0000 7f22f9d32640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f22f40ceba0 con 0x7f22e0003c30 2024-09-16T15:37:22.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.381+0000 7f22f37fe640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22e0003c30 0x7f22f4159af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:22.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.381+0000 7f22eaffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22f415ba10 0x7f22f40ca210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:22.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.381+0000 7f22f37fe640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22e0003c30 0x7f22f4159af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.135:45708/0 (socket says 172.21.15.135:45708) 2024-09-16T15:37:22.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.381+0000 7f22f37fe640 1 -- 172.21.15.135:0/2853102273 learned_addr learned my addr 172.21.15.135:0/2853102273 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-09-16T15:37:22.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.381+0000 7f22f3fff640 1 --2- 172.21.15.135:0/2853102273 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22f415be70 0x7f22f409aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:22.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.381+0000 7f22f37fe640 1 -- 172.21.15.135:0/2853102273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22f415ba10 msgr2=0x7f22f40ca210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:22.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.381+0000 7f22f37fe640 1 --2- 172.21.15.135:0/2853102273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22f415ba10 0x7f22f40ca210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:22.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.381+0000 7f22f37fe640 1 -- 172.21.15.135:0/2853102273 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22f415be70 msgr2=0x7f22f409aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:22.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.381+0000 7f22f37fe640 1 --2- 172.21.15.135:0/2853102273 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22f415be70 0x7f22f409aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:22.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.381+0000 7f22f37fe640 1 -- 172.21.15.135:0/2853102273 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22f40c9170 con 0x7f22e0003c30 2024-09-16T15:37:22.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.381+0000 7f22eaffd640 1 --2- 172.21.15.135:0/2853102273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22f415ba10 0x7f22f40ca210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T15:37:22.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.381+0000 7f22f37fe640 1 --2- 172.21.15.135:0/2853102273 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22e0003c30 0x7f22f4159af0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f22e4009a70 tx=0x7f22e40336f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:22.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.382+0000 7f22f0ff9640 1 -- 172.21.15.135:0/2853102273 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22e4038040 con 0x7f22e0003c30 2024-09-16T15:37:22.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.382+0000 7f22f0ff9640 1 -- 172.21.15.135:0/2853102273 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f22e40338e0 con 0x7f22e0003c30 2024-09-16T15:37:22.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.382+0000 7f22f0ff9640 1 -- 172.21.15.135:0/2853102273 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22e4033d30 con 0x7f22e0003c30 2024-09-16T15:37:22.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.382+0000 7f22f9d32640 1 -- 172.21.15.135:0/2853102273 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22f40c9450 con 0x7f22e0003c30 2024-09-16T15:37:22.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.382+0000 7f22f9d32640 1 -- 172.21.15.135:0/2853102273 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f22f40c9a10 con 0x7f22e0003c30 2024-09-16T15:37:22.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.382+0000 7f22f0ff9640 1 -- 172.21.15.135:0/2853102273 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f22e4043020 con 0x7f22e0003c30 2024-09-16T15:37:22.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.382+0000 7f22f0ff9640 1 -- 172.21.15.135:0/2853102273 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f22e40458c0 con 0x7f22e0003c30 2024-09-16T15:37:22.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.383+0000 7f22f9d32640 1 -- 172.21.15.135:0/2853102273 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22f40c8f00 con 0x7f22e0003c30 2024-09-16T15:37:22.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.385+0000 7f22f0ff9640 1 -- 172.21.15.135:0/2853102273 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f22e404a020 con 0x7f22e0003c30 2024-09-16T15:37:22.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.455+0000 7f22f9d32640 1 -- 172.21.15.135:0/2853102273 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c8429195-a480-409b-8e5f-8dc4c6abc0a1", "id": 2} v 0) -- 0x7f22f40b28c0 con 0x7f22e0003c30 2024-09-16T15:37:22.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.458+0000 7f22f0ff9640 1 -- 172.21.15.135:0/2853102273 <== mon.2 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c8429195-a480-409b-8e5f-8dc4c6abc0a1", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f22e4045460 con 0x7f22e0003c30 2024-09-16T15:37:22.459 INFO:teuthology.orchestra.run.smithi135.stdout:2 2024-09-16T15:37:22.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.459+0000 7f22f9d32640 1 -- 172.21.15.135:0/2853102273 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22e0003c30 msgr2=0x7f22f4159af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:22.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.459+0000 7f22f9d32640 1 --2- 172.21.15.135:0/2853102273 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22e0003c30 0x7f22f4159af0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f22e4009a70 tx=0x7f22e40336f0 comp rx=0 tx=0).stop 2024-09-16T15:37:22.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.459+0000 7f22f9d32640 1 -- 172.21.15.135:0/2853102273 shutdown_connections 2024-09-16T15:37:22.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.459+0000 7f22f9d32640 1 --2- 172.21.15.135:0/2853102273 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22f415be70 0x7f22f409aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:22.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.459+0000 7f22f9d32640 1 --2- 172.21.15.135:0/2853102273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22f415ba10 0x7f22f40ca210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:22.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.459+0000 7f22f9d32640 1 --2- 172.21.15.135:0/2853102273 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22e0003c30 0x7f22f4159af0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:22.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.459+0000 7f22f9d32640 1 -- 172.21.15.135:0/2853102273 >> 172.21.15.135:0/2853102273 conn(0x7f22f40cd750 msgr2=0x7f22f40b5b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:22.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.459+0000 7f22f9d32640 1 -- 172.21.15.135:0/2853102273 shutdown_connections 2024-09-16T15:37:22.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.459+0000 7f22f9d32640 1 -- 172.21.15.135:0/2853102273 wait complete. 2024-09-16T15:37:22.470 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new 0e800d7b-096f-4f65-b3cc-c7cda3870de4 3 2024-09-16T15:37:22.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.572+0000 7f1bfa7a0640 1 -- 172.21.15.135:0/1634916194 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1bf40cbc40 msgr2=0x7f1bf415eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:22.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.572+0000 7f1bfa7a0640 1 --2- 172.21.15.135:0/1634916194 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1bf40cbc40 0x7f1bf415eee0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc009900 tx=0x7f1bdc02a690 comp rx=0 tx=0).stop 2024-09-16T15:37:22.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.572+0000 7f1bfa7a0640 1 -- 172.21.15.135:0/1634916194 shutdown_connections 2024-09-16T15:37:22.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.572+0000 7f1bfa7a0640 1 --2- 172.21.15.135:0/1634916194 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1bf40cbc40 0x7f1bf415eee0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:22.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.572+0000 7f1bfa7a0640 1 --2- 172.21.15.135:0/1634916194 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1bf415ad50 0x7f1bf415e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:22.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.572+0000 7f1bfa7a0640 1 -- 172.21.15.135:0/1634916194 >> 172.21.15.135:0/1634916194 conn(0x7f1bf40cd6f0 msgr2=0x7f1bf40cdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:22.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.572+0000 7f1bfa7a0640 1 -- 172.21.15.135:0/1634916194 shutdown_connections 2024-09-16T15:37:22.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.572+0000 7f1bfa7a0640 1 -- 172.21.15.135:0/1634916194 wait complete. 2024-09-16T15:37:22.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.574+0000 7f1bfa7a0640 1 Processor -- start 2024-09-16T15:37:22.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.574+0000 7f1bfa7a0640 1 -- start start 2024-09-16T15:37:22.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.574+0000 7f1bfa7a0640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1bf40cbc40 0x7f1bf40ca390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:22.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.574+0000 7f1bfa7a0640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1bf415ad50 0x7f1bf40b5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:22.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.574+0000 7f1bfa7a0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1bf415f420 0x7f1bf41f4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:22.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.574+0000 7f1bfa7a0640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1bf4073d60 con 0x7f1bf415ad50 2024-09-16T15:37:22.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.574+0000 7f1bfa7a0640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1bf40d0650 con 0x7f1bf415f420 2024-09-16T15:37:22.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.574+0000 7f1bfa7a0640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f1bf4073ee0 con 0x7f1bf40cbc40 2024-09-16T15:37:22.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.575+0000 7f1bf3fff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1bf40cbc40 0x7f1bf40ca390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:22.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.575+0000 7f1bf8d3d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1bf415f420 0x7f1bf41f4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:22.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.575+0000 7f1bf3fff640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1bf40cbc40 0x7f1bf40ca390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.135:45736/0 (socket says 172.21.15.135:45736) 2024-09-16T15:37:22.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.575+0000 7f1bf8d3d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1bf415f420 0x7f1bf41f4d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42288/0 (socket says 172.21.15.135:42288) 2024-09-16T15:37:22.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.575+0000 7f1bf3fff640 1 -- 172.21.15.135:0/4285551690 learned_addr learned my addr 172.21.15.135:0/4285551690 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-09-16T15:37:22.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.575+0000 7f1bf37fe640 1 --2- 172.21.15.135:0/4285551690 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1bf415ad50 0x7f1bf40b5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:22.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.575+0000 7f1bf3fff640 1 -- 172.21.15.135:0/4285551690 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1bf415f420 msgr2=0x7f1bf41f4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:22.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.575+0000 7f1bf3fff640 1 --2- 172.21.15.135:0/4285551690 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1bf415f420 0x7f1bf41f4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:22.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.575+0000 7f1bf3fff640 1 -- 172.21.15.135:0/4285551690 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1bf415ad50 msgr2=0x7f1bf40b5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:22.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.575+0000 7f1bf3fff640 1 --2- 172.21.15.135:0/4285551690 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1bf415ad50 0x7f1bf40b5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:22.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.575+0000 7f1bf3fff640 1 -- 172.21.15.135:0/4285551690 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bf41f5810 con 0x7f1bf40cbc40 2024-09-16T15:37:22.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.575+0000 7f1bf8d3d640 1 --2- 172.21.15.135:0/4285551690 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1bf415f420 0x7f1bf41f4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T15:37:22.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.575+0000 7f1bf3fff640 1 --2- 172.21.15.135:0/4285551690 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1bf40cbc40 0x7f1bf40ca390 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1be400ea60 tx=0x7f1be400ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:22.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.575+0000 7f1bf0ff9640 1 -- 172.21.15.135:0/4285551690 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1be400cde0 con 0x7f1bf40cbc40 2024-09-16T15:37:22.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.575+0000 7f1bf0ff9640 1 -- 172.21.15.135:0/4285551690 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1be4004020 con 0x7f1bf40cbc40 2024-09-16T15:37:22.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.575+0000 7f1bf0ff9640 1 -- 172.21.15.135:0/4285551690 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1be4004450 con 0x7f1bf40cbc40 2024-09-16T15:37:22.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.575+0000 7f1bfa7a0640 1 -- 172.21.15.135:0/4285551690 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bf41f5af0 con 0x7f1bf40cbc40 2024-09-16T15:37:22.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.575+0000 7f1bfa7a0640 1 -- 172.21.15.135:0/4285551690 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bf40b65d0 con 0x7f1bf40cbc40 2024-09-16T15:37:22.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.576+0000 7f1bf0ff9640 1 -- 172.21.15.135:0/4285551690 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1be4003980 con 0x7f1bf40cbc40 2024-09-16T15:37:22.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.576+0000 7f1bf0ff9640 1 -- 172.21.15.135:0/4285551690 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f1be4021c50 con 0x7f1bf40cbc40 2024-09-16T15:37:22.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.576+0000 7f1bfa7a0640 1 -- 172.21.15.135:0/4285551690 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bf4074400 con 0x7f1bf40cbc40 2024-09-16T15:37:22.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.578+0000 7f1bf0ff9640 1 -- 172.21.15.135:0/4285551690 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f1be4038860 con 0x7f1bf40cbc40 2024-09-16T15:37:22.651 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.649+0000 7f1bfa7a0640 1 -- 172.21.15.135:0/4285551690 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "osd new", "uuid": "0e800d7b-096f-4f65-b3cc-c7cda3870de4", "id": 3} v 0) -- 0x7f1bf40b3550 con 0x7f1bf40cbc40 2024-09-16T15:37:22.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.653+0000 7f1bf0ff9640 1 -- 172.21.15.135:0/4285551690 <== mon.2 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0e800d7b-096f-4f65-b3cc-c7cda3870de4", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f1be4026030 con 0x7f1bf40cbc40 2024-09-16T15:37:22.654 INFO:teuthology.orchestra.run.smithi135.stdout:3 2024-09-16T15:37:22.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.654+0000 7f1bfa7a0640 1 -- 172.21.15.135:0/4285551690 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1bf40cbc40 msgr2=0x7f1bf40ca390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:22.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.654+0000 7f1bfa7a0640 1 --2- 172.21.15.135:0/4285551690 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1bf40cbc40 0x7f1bf40ca390 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1be400ea60 tx=0x7f1be400ef20 comp rx=0 tx=0).stop 2024-09-16T15:37:22.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.654+0000 7f1bfa7a0640 1 -- 172.21.15.135:0/4285551690 shutdown_connections 2024-09-16T15:37:22.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.654+0000 7f1bfa7a0640 1 --2- 172.21.15.135:0/4285551690 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1bf415f420 0x7f1bf41f4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:22.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.654+0000 7f1bfa7a0640 1 --2- 172.21.15.135:0/4285551690 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1bf415ad50 0x7f1bf40b5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:22.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.654+0000 7f1bfa7a0640 1 --2- 172.21.15.135:0/4285551690 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1bf40cbc40 0x7f1bf40ca390 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:22.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.654+0000 7f1bfa7a0640 1 -- 172.21.15.135:0/4285551690 >> 172.21.15.135:0/4285551690 conn(0x7f1bf40cd6f0 msgr2=0x7f1bf40cb2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:22.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.654+0000 7f1bfa7a0640 1 -- 172.21.15.135:0/4285551690 shutdown_connections 2024-09-16T15:37:22.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.654+0000 7f1bfa7a0640 1 -- 172.21.15.135:0/4285551690 wait complete. 2024-09-16T15:37:22.665 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new c7822e9b-8e29-48d9-b92a-e8f9c7bc5247 4 2024-09-16T15:37:22.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.765+0000 7fd58bb5d640 1 -- 172.21.15.135:0/3437507066 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5840d0440 msgr2=0x7fd584165cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:22.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.765+0000 7fd58bb5d640 1 --2- 172.21.15.135:0/3437507066 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5840d0440 0x7fd584165cd0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd57c005fd0 tx=0x7fd57c02abc0 comp rx=0 tx=0).stop 2024-09-16T15:37:22.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.766+0000 7fd58bb5d640 1 -- 172.21.15.135:0/3437507066 shutdown_connections 2024-09-16T15:37:22.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.766+0000 7fd58bb5d640 1 --2- 172.21.15.135:0/3437507066 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5840d0440 0x7fd584165cd0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:22.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.766+0000 7fd58bb5d640 1 -- 172.21.15.135:0/3437507066 >> 172.21.15.135:0/3437507066 conn(0x7fd5840cd6f0 msgr2=0x7fd5840cdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:22.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.766+0000 7fd58bb5d640 1 -- 172.21.15.135:0/3437507066 shutdown_connections 2024-09-16T15:37:22.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.766+0000 7fd58bb5d640 1 -- 172.21.15.135:0/3437507066 wait complete. 2024-09-16T15:37:22.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.767+0000 7fd58bb5d640 1 Processor -- start 2024-09-16T15:37:22.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.767+0000 7fd58bb5d640 1 -- start start 2024-09-16T15:37:22.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.768+0000 7fd58bb5d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd5840cbc40 0x7fd5840b6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:22.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.768+0000 7fd58bb5d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5840d0440 0x7fd584163dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:22.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.768+0000 7fd58bb5d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd58415ad50 0x7fd584159530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:22.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.768+0000 7fd58bb5d640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd584166390 con 0x7fd58415ad50 2024-09-16T15:37:22.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.768+0000 7fd58bb5d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd584166210 con 0x7fd5840d0440 2024-09-16T15:37:22.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.768+0000 7fd58bb5d640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fd584166510 con 0x7fd5840cbc40 2024-09-16T15:37:22.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.768+0000 7fd5898f9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd5840cbc40 0x7fd5840b6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:22.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.768+0000 7fd5890f8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5840d0440 0x7fd584163dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:22.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.768+0000 7fd5898f9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd5840cbc40 0x7fd5840b6690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.135:45746/0 (socket says 172.21.15.135:45746) 2024-09-16T15:37:22.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.768+0000 7fd5898f9640 1 -- 172.21.15.135:0/3953463299 learned_addr learned my addr 172.21.15.135:0/3953463299 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-09-16T15:37:22.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.768+0000 7fd58a0fa640 1 --2- 172.21.15.135:0/3953463299 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd58415ad50 0x7fd584159530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:22.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.768+0000 7fd5898f9640 1 -- 172.21.15.135:0/3953463299 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5840d0440 msgr2=0x7fd584163dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:22.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.768+0000 7fd5898f9640 1 --2- 172.21.15.135:0/3953463299 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5840d0440 0x7fd584163dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:22.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.768+0000 7fd5898f9640 1 -- 172.21.15.135:0/3953463299 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd58415ad50 msgr2=0x7fd584159530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:22.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.768+0000 7fd5898f9640 1 --2- 172.21.15.135:0/3953463299 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd58415ad50 0x7fd584159530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:22.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.768+0000 7fd5898f9640 1 -- 172.21.15.135:0/3953463299 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5840b2a40 con 0x7fd5840cbc40 2024-09-16T15:37:22.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.768+0000 7fd5890f8640 1 --2- 172.21.15.135:0/3953463299 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5840d0440 0x7fd584163dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T15:37:22.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.768+0000 7fd5898f9640 1 --2- 172.21.15.135:0/3953463299 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd5840cbc40 0x7fd5840b6690 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd58000c400 tx=0x7fd58000c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:22.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.768+0000 7fd57a7fc640 1 -- 172.21.15.135:0/3953463299 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd580017070 con 0x7fd5840cbc40 2024-09-16T15:37:22.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.768+0000 7fd57a7fc640 1 -- 172.21.15.135:0/3953463299 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd5800053c0 con 0x7fd5840cbc40 2024-09-16T15:37:22.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.768+0000 7fd57a7fc640 1 -- 172.21.15.135:0/3953463299 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd580003850 con 0x7fd5840cbc40 2024-09-16T15:37:22.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.768+0000 7fd58bb5d640 1 -- 172.21.15.135:0/3953463299 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5840b5d30 con 0x7fd5840cbc40 2024-09-16T15:37:22.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.769+0000 7fd58bb5d640 1 -- 172.21.15.135:0/3953463299 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd584158d20 con 0x7fd5840cbc40 2024-09-16T15:37:22.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.770+0000 7fd57a7fc640 1 -- 172.21.15.135:0/3953463299 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd58001a070 con 0x7fd5840cbc40 2024-09-16T15:37:22.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.770+0000 7fd57a7fc640 1 -- 172.21.15.135:0/3953463299 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fd580011590 con 0x7fd5840cbc40 2024-09-16T15:37:22.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.770+0000 7fd58bb5d640 1 -- 172.21.15.135:0/3953463299 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5840cb5d0 con 0x7fd5840cbc40 2024-09-16T15:37:22.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.772+0000 7fd57a7fc640 1 -- 172.21.15.135:0/3953463299 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fd5840cb5d0 con 0x7fd5840cbc40 2024-09-16T15:37:22.843 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.842+0000 7fd58bb5d640 1 -- 172.21.15.135:0/3953463299 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c7822e9b-8e29-48d9-b92a-e8f9c7bc5247", "id": 4} v 0) -- 0x7fd5840a2030 con 0x7fd5840cbc40 2024-09-16T15:37:22.847 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.846+0000 7fd57a7fc640 1 -- 172.21.15.135:0/3953463299 <== mon.2 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c7822e9b-8e29-48d9-b92a-e8f9c7bc5247", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7fd5840a2030 con 0x7fd5840cbc40 2024-09-16T15:37:22.847 INFO:teuthology.orchestra.run.smithi135.stdout:4 2024-09-16T15:37:22.849 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.847+0000 7fd58bb5d640 1 -- 172.21.15.135:0/3953463299 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd5840cbc40 msgr2=0x7fd5840b6690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:22.849 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.847+0000 7fd58bb5d640 1 --2- 172.21.15.135:0/3953463299 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd5840cbc40 0x7fd5840b6690 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd58000c400 tx=0x7fd58000c8c0 comp rx=0 tx=0).stop 2024-09-16T15:37:22.849 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.847+0000 7fd58bb5d640 1 -- 172.21.15.135:0/3953463299 shutdown_connections 2024-09-16T15:37:22.849 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.847+0000 7fd58bb5d640 1 --2- 172.21.15.135:0/3953463299 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd58415ad50 0x7fd584159530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:22.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.847+0000 7fd58bb5d640 1 --2- 172.21.15.135:0/3953463299 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5840d0440 0x7fd584163dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:22.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.847+0000 7fd58bb5d640 1 --2- 172.21.15.135:0/3953463299 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd5840cbc40 0x7fd5840b6690 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:22.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.847+0000 7fd58bb5d640 1 -- 172.21.15.135:0/3953463299 >> 172.21.15.135:0/3953463299 conn(0x7fd5840cd6f0 msgr2=0x7fd584151e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:22.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.848+0000 7fd58bb5d640 1 -- 172.21.15.135:0/3953463299 shutdown_connections 2024-09-16T15:37:22.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.848+0000 7fd58bb5d640 1 -- 172.21.15.135:0/3953463299 wait complete. 2024-09-16T15:37:22.863 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new 35805e02-484a-4404-a78f-aa44f4daa41f 5 2024-09-16T15:37:22.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.963+0000 7fe5bb5bb640 1 -- 172.21.15.135:0/3286355819 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe5b40cc650 msgr2=0x7fe5b406ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:22.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.963+0000 7fe5bb5bb640 1 --2- 172.21.15.135:0/3286355819 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe5b40cc650 0x7fe5b406ff70 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac009be0 tx=0x7fe5ac02a920 comp rx=0 tx=0).stop 2024-09-16T15:37:22.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.964+0000 7fe5bb5bb640 1 -- 172.21.15.135:0/3286355819 shutdown_connections 2024-09-16T15:37:22.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.964+0000 7fe5bb5bb640 1 --2- 172.21.15.135:0/3286355819 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe5b40cc650 0x7fe5b406ff70 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:22.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.964+0000 7fe5bb5bb640 1 -- 172.21.15.135:0/3286355819 >> 172.21.15.135:0/3286355819 conn(0x7fe5b40d0d40 msgr2=0x7fe5b40d1150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:22.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.964+0000 7fe5bb5bb640 1 -- 172.21.15.135:0/3286355819 shutdown_connections 2024-09-16T15:37:22.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.964+0000 7fe5bb5bb640 1 -- 172.21.15.135:0/3286355819 wait complete. 2024-09-16T15:37:22.966 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.965+0000 7fe5bb5bb640 1 Processor -- start 2024-09-16T15:37:22.966 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.965+0000 7fe5bb5bb640 1 -- start start 2024-09-16T15:37:22.968 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.966+0000 7fe5bb5bb640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5b406d280 0x7fe5b41f51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:22.968 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.966+0000 7fe5bb5bb640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe5b40cc270 0x7fe5b41532e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:22.969 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.966+0000 7fe5bb5bb640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe5b40cc650 0x7fe5b40c8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:22.969 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.966+0000 7fe5bb5bb640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe5b4155fb0 con 0x7fe5b406d280 2024-09-16T15:37:22.969 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.966+0000 7fe5bb5bb640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe5b4155e30 con 0x7fe5b40cc270 2024-09-16T15:37:22.969 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.966+0000 7fe5bb5bb640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fe5b4156130 con 0x7fe5b40cc650 2024-09-16T15:37:22.969 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.966+0000 7fe5b9b58640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe5b40cc650 0x7fe5b40c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:22.969 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.966+0000 7fe5b8b56640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe5b40cc270 0x7fe5b41532e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:22.969 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.966+0000 7fe5b9b58640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe5b40cc650 0x7fe5b40c8700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.135:45762/0 (socket says 172.21.15.135:45762) 2024-09-16T15:37:22.969 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.966+0000 7fe5b8b56640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe5b40cc270 0x7fe5b41532e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42300/0 (socket says 172.21.15.135:42300) 2024-09-16T15:37:22.969 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.966+0000 7fe5b9b58640 1 -- 172.21.15.135:0/801724679 learned_addr learned my addr 172.21.15.135:0/801724679 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-09-16T15:37:22.969 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.966+0000 7fe5b9357640 1 --2- 172.21.15.135:0/801724679 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5b406d280 0x7fe5b41f51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:22.969 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.966+0000 7fe5b8b56640 1 -- 172.21.15.135:0/801724679 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe5b40cc650 msgr2=0x7fe5b40c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:22.969 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.966+0000 7fe5b8b56640 1 --2- 172.21.15.135:0/801724679 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe5b40cc650 0x7fe5b40c8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:22.969 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.966+0000 7fe5b8b56640 1 -- 172.21.15.135:0/801724679 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5b406d280 msgr2=0x7fe5b41f51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:22.969 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.966+0000 7fe5b8b56640 1 --2- 172.21.15.135:0/801724679 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5b406d280 0x7fe5b41f51e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:22.970 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.966+0000 7fe5b8b56640 1 -- 172.21.15.135:0/801724679 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5b40c90a0 con 0x7fe5b40cc270 2024-09-16T15:37:22.970 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.966+0000 7fe5b9b58640 1 --2- 172.21.15.135:0/801724679 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe5b40cc650 0x7fe5b40c8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T15:37:22.970 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.966+0000 7fe5b8b56640 1 --2- 172.21.15.135:0/801724679 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe5b40cc270 0x7fe5b41532e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe5a800c3f0 tx=0x7fe5a800c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:22.970 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.966+0000 7fe5a5ffb640 1 -- 172.21.15.135:0/801724679 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5a8011790 con 0x7fe5b40cc270 2024-09-16T15:37:22.970 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.966+0000 7fe5a5ffb640 1 -- 172.21.15.135:0/801724679 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe5a8017070 con 0x7fe5b40cc270 2024-09-16T15:37:22.970 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.966+0000 7fe5bb5bb640 1 -- 172.21.15.135:0/801724679 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5b41f4700 con 0x7fe5b40cc270 2024-09-16T15:37:22.970 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.966+0000 7fe5a5ffb640 1 -- 172.21.15.135:0/801724679 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5a8011ce0 con 0x7fe5b40cc270 2024-09-16T15:37:22.970 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.967+0000 7fe5a5ffb640 1 -- 172.21.15.135:0/801724679 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe5a801c460 con 0x7fe5b40cc270 2024-09-16T15:37:22.970 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.967+0000 7fe5bb5bb640 1 -- 172.21.15.135:0/801724679 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5b40c9380 con 0x7fe5b40cc270 2024-09-16T15:37:22.970 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.967+0000 7fe5a5ffb640 1 -- 172.21.15.135:0/801724679 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7fe5a8012e00 con 0x7fe5b40cc270 2024-09-16T15:37:22.971 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.968+0000 7fe5bb5bb640 1 -- 172.21.15.135:0/801724679 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5b4156650 con 0x7fe5b40cc270 2024-09-16T15:37:22.971 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:22.970+0000 7fe5a5ffb640 1 -- 172.21.15.135:0/801724679 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fe5a8022060 con 0x7fe5b40cc270 2024-09-16T15:37:23.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.041+0000 7fe5bb5bb640 1 -- 172.21.15.135:0/801724679 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd new", "uuid": "35805e02-484a-4404-a78f-aa44f4daa41f", "id": 5} v 0) -- 0x7fe5b40739a0 con 0x7fe5b40cc270 2024-09-16T15:37:23.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.044+0000 7fe5a5ffb640 1 -- 172.21.15.135:0/801724679 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "35805e02-484a-4404-a78f-aa44f4daa41f", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7fe5a8012420 con 0x7fe5b40cc270 2024-09-16T15:37:23.046 INFO:teuthology.orchestra.run.smithi135.stdout:5 2024-09-16T15:37:23.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.045+0000 7fe5bb5bb640 1 -- 172.21.15.135:0/801724679 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe5b40cc270 msgr2=0x7fe5b41532e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:23.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.045+0000 7fe5bb5bb640 1 --2- 172.21.15.135:0/801724679 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe5b40cc270 0x7fe5b41532e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe5a800c3f0 tx=0x7fe5a800c8b0 comp rx=0 tx=0).stop 2024-09-16T15:37:23.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.045+0000 7fe5bb5bb640 1 -- 172.21.15.135:0/801724679 shutdown_connections 2024-09-16T15:37:23.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.045+0000 7fe5bb5bb640 1 --2- 172.21.15.135:0/801724679 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe5b40cc650 0x7fe5b40c8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:23.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.045+0000 7fe5bb5bb640 1 --2- 172.21.15.135:0/801724679 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe5b40cc270 0x7fe5b41532e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:23.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.045+0000 7fe5bb5bb640 1 --2- 172.21.15.135:0/801724679 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5b406d280 0x7fe5b41f51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:23.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.045+0000 7fe5bb5bb640 1 -- 172.21.15.135:0/801724679 >> 172.21.15.135:0/801724679 conn(0x7fe5b40d0d40 msgr2=0x7fe5b40b41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:23.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.046+0000 7fe5bb5bb640 1 -- 172.21.15.135:0/801724679 shutdown_connections 2024-09-16T15:37:23.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.046+0000 7fe5bb5bb640 1 -- 172.21.15.135:0/801724679 wait complete. 2024-09-16T15:37:23.057 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new 6327ba84-aaeb-41fa-9717-188988ff2c4e 6 2024-09-16T15:37:23.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.157+0000 7f8a53ab0640 1 -- 172.21.15.135:0/2848517957 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a4c0ccce0 msgr2=0x7f8a4c073ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:23.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.157+0000 7f8a53ab0640 1 --2- 172.21.15.135:0/2848517957 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a4c0ccce0 0x7f8a4c073ec0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8a48009860 tx=0x7f8a4802a5a0 comp rx=0 tx=0).stop 2024-09-16T15:37:23.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.157+0000 7f8a53ab0640 1 -- 172.21.15.135:0/2848517957 shutdown_connections 2024-09-16T15:37:23.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.157+0000 7f8a53ab0640 1 --2- 172.21.15.135:0/2848517957 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a4c0ccce0 0x7f8a4c073ec0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:23.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.157+0000 7f8a53ab0640 1 -- 172.21.15.135:0/2848517957 >> 172.21.15.135:0/2848517957 conn(0x7f8a4c0d0d40 msgr2=0x7f8a4c0d1150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:23.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.157+0000 7f8a53ab0640 1 -- 172.21.15.135:0/2848517957 shutdown_connections 2024-09-16T15:37:23.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.158+0000 7f8a53ab0640 1 -- 172.21.15.135:0/2848517957 wait complete. 2024-09-16T15:37:23.160 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.159+0000 7f8a53ab0640 1 Processor -- start 2024-09-16T15:37:23.160 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.159+0000 7f8a53ab0640 1 -- start start 2024-09-16T15:37:23.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.159+0000 7f8a53ab0640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8a4c0cba70 0x7f8a4c0b3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:23.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.159+0000 7f8a53ab0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a4c0ccce0 0x7f8a4c151400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:23.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.159+0000 7f8a53ab0640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a4c15b1c0 0x7f8a4c0c9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:23.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.159+0000 7f8a53ab0640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8a4c0d09f0 con 0x7f8a4c0cba70 2024-09-16T15:37:23.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.159+0000 7f8a53ab0640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8a4c0d0870 con 0x7f8a4c0ccce0 2024-09-16T15:37:23.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.159+0000 7f8a53ab0640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f8a4c0cbec0 con 0x7f8a4c15b1c0 2024-09-16T15:37:23.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.160+0000 7f8a5104b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a4c0ccce0 0x7f8a4c151400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:23.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.160+0000 7f8a5204d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a4c15b1c0 0x7f8a4c0c9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:23.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.160+0000 7f8a5104b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a4c0ccce0 0x7f8a4c151400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42302/0 (socket says 172.21.15.135:42302) 2024-09-16T15:37:23.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.160+0000 7f8a5204d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a4c15b1c0 0x7f8a4c0c9f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.135:45790/0 (socket says 172.21.15.135:45790) 2024-09-16T15:37:23.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.160+0000 7f8a5104b640 1 -- 172.21.15.135:0/2407908094 learned_addr learned my addr 172.21.15.135:0/2407908094 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-09-16T15:37:23.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.160+0000 7f8a5184c640 1 --2- 172.21.15.135:0/2407908094 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8a4c0cba70 0x7f8a4c0b3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:23.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.160+0000 7f8a5104b640 1 -- 172.21.15.135:0/2407908094 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a4c15b1c0 msgr2=0x7f8a4c0c9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:23.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.160+0000 7f8a5104b640 1 --2- 172.21.15.135:0/2407908094 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a4c15b1c0 0x7f8a4c0c9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:23.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.160+0000 7f8a5104b640 1 -- 172.21.15.135:0/2407908094 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8a4c0cba70 msgr2=0x7f8a4c0b3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:23.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.160+0000 7f8a5104b640 1 --2- 172.21.15.135:0/2407908094 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8a4c0cba70 0x7f8a4c0b3b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:23.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.160+0000 7f8a5104b640 1 -- 172.21.15.135:0/2407908094 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a4c0c8cb0 con 0x7f8a4c0ccce0 2024-09-16T15:37:23.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.160+0000 7f8a5104b640 1 --2- 172.21.15.135:0/2407908094 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a4c0ccce0 0x7f8a4c151400 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8a40001220 tx=0x7f8a4000c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:23.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.160+0000 7f8a3e7fc640 1 -- 172.21.15.135:0/2407908094 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a40011790 con 0x7f8a4c0ccce0 2024-09-16T15:37:23.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.160+0000 7f8a3e7fc640 1 -- 172.21.15.135:0/2407908094 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8a40017070 con 0x7f8a4c0ccce0 2024-09-16T15:37:23.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.160+0000 7f8a53ab0640 1 -- 172.21.15.135:0/2407908094 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a4c0c8f90 con 0x7f8a4c0ccce0 2024-09-16T15:37:23.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.160+0000 7f8a3e7fc640 1 -- 172.21.15.135:0/2407908094 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a40011cc0 con 0x7f8a4c0ccce0 2024-09-16T15:37:23.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.160+0000 7f8a53ab0640 1 -- 172.21.15.135:0/2407908094 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a4c0c6050 con 0x7f8a4c0ccce0 2024-09-16T15:37:23.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.160+0000 7f8a3e7fc640 1 -- 172.21.15.135:0/2407908094 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8a4001c460 con 0x7f8a4c0ccce0 2024-09-16T15:37:23.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.160+0000 7f8a3e7fc640 1 -- 172.21.15.135:0/2407908094 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f8a40012dd0 con 0x7f8a4c0ccce0 2024-09-16T15:37:23.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.161+0000 7f8a53ab0640 1 -- 172.21.15.135:0/2407908094 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a4c073ec0 con 0x7f8a4c0ccce0 2024-09-16T15:37:23.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.163+0000 7f8a3e7fc640 1 -- 172.21.15.135:0/2407908094 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f8a400127e0 con 0x7f8a4c0ccce0 2024-09-16T15:37:23.235 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.234+0000 7f8a53ab0640 1 -- 172.21.15.135:0/2407908094 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd new", "uuid": "6327ba84-aaeb-41fa-9717-188988ff2c4e", "id": 6} v 0) -- 0x7f8a4c0d1990 con 0x7f8a4c0ccce0 2024-09-16T15:37:23.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.238+0000 7f8a3e7fc640 1 -- 172.21.15.135:0/2407908094 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6327ba84-aaeb-41fa-9717-188988ff2c4e", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f8a400129c0 con 0x7f8a4c0ccce0 2024-09-16T15:37:23.239 INFO:teuthology.orchestra.run.smithi135.stdout:6 2024-09-16T15:37:23.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.239+0000 7f8a53ab0640 1 -- 172.21.15.135:0/2407908094 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a4c0ccce0 msgr2=0x7f8a4c151400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:23.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.239+0000 7f8a53ab0640 1 --2- 172.21.15.135:0/2407908094 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a4c0ccce0 0x7f8a4c151400 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8a40001220 tx=0x7f8a4000c890 comp rx=0 tx=0).stop 2024-09-16T15:37:23.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.239+0000 7f8a53ab0640 1 -- 172.21.15.135:0/2407908094 shutdown_connections 2024-09-16T15:37:23.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.239+0000 7f8a53ab0640 1 --2- 172.21.15.135:0/2407908094 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8a4c15b1c0 0x7f8a4c0c9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:23.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.239+0000 7f8a53ab0640 1 --2- 172.21.15.135:0/2407908094 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a4c0ccce0 0x7f8a4c151400 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:23.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.239+0000 7f8a53ab0640 1 --2- 172.21.15.135:0/2407908094 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8a4c0cba70 0x7f8a4c0b3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:23.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.239+0000 7f8a53ab0640 1 -- 172.21.15.135:0/2407908094 >> 172.21.15.135:0/2407908094 conn(0x7f8a4c0d0d40 msgr2=0x7f8a4c15cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:23.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.239+0000 7f8a53ab0640 1 -- 172.21.15.135:0/2407908094 shutdown_connections 2024-09-16T15:37:23.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.239+0000 7f8a53ab0640 1 -- 172.21.15.135:0/2407908094 wait complete. 2024-09-16T15:37:23.251 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new 392d0958-dff9-4248-b3d8-a1201c10f354 7 2024-09-16T15:37:23.351 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.350+0000 7f5933dc6640 1 -- 172.21.15.135:0/1553617957 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f592c0a1b90 msgr2=0x7f592c073b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:23.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.350+0000 7f5933dc6640 1 --2- 172.21.15.135:0/1553617957 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f592c0a1b90 0x7f592c073b90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f5924005fd0 tx=0x7f592402aa10 comp rx=0 tx=0).stop 2024-09-16T15:37:23.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.350+0000 7f5933dc6640 1 -- 172.21.15.135:0/1553617957 shutdown_connections 2024-09-16T15:37:23.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.350+0000 7f5933dc6640 1 --2- 172.21.15.135:0/1553617957 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f592c0a1b90 0x7f592c073b90 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:23.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.350+0000 7f5933dc6640 1 --2- 172.21.15.135:0/1553617957 >> v2:172.21.15.135:3300/0 conn(0x7f592c06d280 0x7f592c073650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:23.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.350+0000 7f5933dc6640 1 -- 172.21.15.135:0/1553617957 >> 172.21.15.135:0/1553617957 conn(0x7f592c0cd6f0 msgr2=0x7f592c0cdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:23.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.350+0000 7f5933dc6640 1 -- 172.21.15.135:0/1553617957 shutdown_connections 2024-09-16T15:37:23.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.350+0000 7f5933dc6640 1 -- 172.21.15.135:0/1553617957 wait complete. 2024-09-16T15:37:23.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.351+0000 7f5933dc6640 1 Processor -- start 2024-09-16T15:37:23.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.351+0000 7f5933dc6640 1 -- start start 2024-09-16T15:37:23.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.352+0000 7f5933dc6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f592c06d280 0x7f592c0b06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:23.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.352+0000 7f5933dc6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f592c0a1b90 0x7f592c157b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:23.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.352+0000 7f5933dc6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f592c15f450 0x7f592c0b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:23.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.352+0000 7f5933dc6640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f592c0c4520 con 0x7f592c15f450 2024-09-16T15:37:23.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.352+0000 7f5933dc6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f592c0ce420 con 0x7f592c06d280 2024-09-16T15:37:23.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.352+0000 7f5933dc6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f592c0740d0 con 0x7f592c0a1b90 2024-09-16T15:37:23.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.352+0000 7f5931b62640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f592c06d280 0x7f592c0b06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:23.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.352+0000 7f5931361640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f592c0a1b90 0x7f592c157b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:23.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.352+0000 7f5931b62640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f592c06d280 0x7f592c0b06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42316/0 (socket says 172.21.15.135:42316) 2024-09-16T15:37:23.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.352+0000 7f5931b62640 1 -- 172.21.15.135:0/3029929901 learned_addr learned my addr 172.21.15.135:0/3029929901 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-09-16T15:37:23.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.352+0000 7f5932363640 1 --2- 172.21.15.135:0/3029929901 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f592c15f450 0x7f592c0b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:23.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.352+0000 7f5931b62640 1 -- 172.21.15.135:0/3029929901 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f592c0a1b90 msgr2=0x7f592c157b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:23.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.352+0000 7f5931b62640 1 --2- 172.21.15.135:0/3029929901 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f592c0a1b90 0x7f592c157b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:23.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.352+0000 7f5931b62640 1 -- 172.21.15.135:0/3029929901 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f592c15f450 msgr2=0x7f592c0b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:23.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.352+0000 7f5931b62640 1 --2- 172.21.15.135:0/3029929901 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f592c15f450 0x7f592c0b3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:23.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.352+0000 7f5931b62640 1 -- 172.21.15.135:0/3029929901 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f592c0c6080 con 0x7f592c06d280 2024-09-16T15:37:23.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.353+0000 7f5931b62640 1 --2- 172.21.15.135:0/3029929901 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f592c06d280 0x7f592c0b06d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f592000c3d0 tx=0x7f592000c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:23.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.353+0000 7f591e7fc640 1 -- 172.21.15.135:0/3029929901 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5920017070 con 0x7f592c06d280 2024-09-16T15:37:23.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.353+0000 7f591e7fc640 1 -- 172.21.15.135:0/3029929901 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f59200053c0 con 0x7f592c06d280 2024-09-16T15:37:23.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.353+0000 7f5933dc6640 1 -- 172.21.15.135:0/3029929901 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f592c0c71f0 con 0x7f592c06d280 2024-09-16T15:37:23.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.353+0000 7f591e7fc640 1 -- 172.21.15.135:0/3029929901 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5920003850 con 0x7f592c06d280 2024-09-16T15:37:23.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.353+0000 7f5933dc6640 1 -- 172.21.15.135:0/3029929901 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f592c0c65f0 con 0x7f592c06d280 2024-09-16T15:37:23.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.353+0000 7f591e7fc640 1 -- 172.21.15.135:0/3029929901 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f592001a070 con 0x7f592c06d280 2024-09-16T15:37:23.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.353+0000 7f591e7fc640 1 -- 172.21.15.135:0/3029929901 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f5920011c20 con 0x7f592c06d280 2024-09-16T15:37:23.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.354+0000 7f5933dc6640 1 -- 172.21.15.135:0/3029929901 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f592c074580 con 0x7f592c06d280 2024-09-16T15:37:23.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.357+0000 7f591e7fc640 1 -- 172.21.15.135:0/3029929901 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f5920021020 con 0x7f592c06d280 2024-09-16T15:37:23.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.428+0000 7f5933dc6640 1 -- 172.21.15.135:0/3029929901 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd new", "uuid": "392d0958-dff9-4248-b3d8-a1201c10f354", "id": 7} v 0) -- 0x7f592c0b6bf0 con 0x7f592c06d280 2024-09-16T15:37:23.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.432+0000 7f591e7fc640 1 -- 172.21.15.135:0/3029929901 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "392d0958-dff9-4248-b3d8-a1201c10f354", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f592c0cc2d0 con 0x7f592c06d280 2024-09-16T15:37:23.433 INFO:teuthology.orchestra.run.smithi135.stdout:7 2024-09-16T15:37:23.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.433+0000 7f5933dc6640 1 -- 172.21.15.135:0/3029929901 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f592c06d280 msgr2=0x7f592c0b06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:23.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.433+0000 7f5933dc6640 1 --2- 172.21.15.135:0/3029929901 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f592c06d280 0x7f592c0b06d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f592000c3d0 tx=0x7f592000c890 comp rx=0 tx=0).stop 2024-09-16T15:37:23.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.433+0000 7f5933dc6640 1 -- 172.21.15.135:0/3029929901 shutdown_connections 2024-09-16T15:37:23.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.433+0000 7f5933dc6640 1 --2- 172.21.15.135:0/3029929901 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f592c15f450 0x7f592c0b3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:23.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.433+0000 7f5933dc6640 1 --2- 172.21.15.135:0/3029929901 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f592c0a1b90 0x7f592c157b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:23.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.433+0000 7f5933dc6640 1 --2- 172.21.15.135:0/3029929901 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f592c06d280 0x7f592c0b06d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:23.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.433+0000 7f5933dc6640 1 -- 172.21.15.135:0/3029929901 >> 172.21.15.135:0/3029929901 conn(0x7f592c0cd6f0 msgr2=0x7f592c070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:23.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.433+0000 7f5933dc6640 1 -- 172.21.15.135:0/3029929901 shutdown_connections 2024-09-16T15:37:23.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:37:23.433+0000 7f5933dc6640 1 -- 172.21.15.135:0/3029929901 wait complete. 2024-09-16T15:37:23.445 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-16T15:37:23.445 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-16T15:37:23.447 INFO:tasks.ceph.osd.0:Started 2024-09-16T15:37:23.448 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-16T15:37:23.448 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-16T15:37:23.450 INFO:tasks.ceph.osd.1:Started 2024-09-16T15:37:23.450 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-16T15:37:23.450 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-16T15:37:23.452 INFO:tasks.ceph.osd.2:Started 2024-09-16T15:37:23.452 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-16T15:37:23.452 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-16T15:37:23.454 INFO:tasks.ceph.osd.3:Started 2024-09-16T15:37:23.454 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-16T15:37:23.454 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-16T15:37:23.457 INFO:tasks.ceph.osd.4:Started 2024-09-16T15:37:23.457 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-16T15:37:23.457 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-16T15:37:23.459 INFO:tasks.ceph.osd.5:Started 2024-09-16T15:37:23.459 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-16T15:37:23.460 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-16T15:37:23.462 INFO:tasks.ceph.osd.6:Started 2024-09-16T15:37:23.462 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-16T15:37:23.462 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-16T15:37:23.464 INFO:tasks.ceph.osd.7:Started 2024-09-16T15:37:23.465 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T15:37:23.596 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:23.593+0000 7f23e1cbd640 1 -- 172.21.15.98:0/3437510089 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23dc0d1610 msgr2=0x7f23dc0cecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:23.596 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:23.593+0000 7f23e1cbd640 1 --2- 172.21.15.98:0/3437510089 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23dc0d1610 0x7f23dc0cecc0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f23d4005fd0 tx=0x7f23d402aa90 comp rx=0 tx=0).stop 2024-09-16T15:37:23.596 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:23.593+0000 7f23e1cbd640 1 -- 172.21.15.98:0/3437510089 shutdown_connections 2024-09-16T15:37:23.596 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:23.593+0000 7f23e1cbd640 1 --2- 172.21.15.98:0/3437510089 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23dc0d1610 0x7f23dc0cecc0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:23.596 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:23.593+0000 7f23e1cbd640 1 --2- 172.21.15.98:0/3437510089 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f23dc0d2050 0x7f23dc0d10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:23.596 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:23.593+0000 7f23e1cbd640 1 -- 172.21.15.98:0/3437510089 >> 172.21.15.98:0/3437510089 conn(0x7f23dc0d3fe0 msgr2=0x7f23dc0d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:23.596 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:23.593+0000 7f23e1cbd640 1 -- 172.21.15.98:0/3437510089 shutdown_connections 2024-09-16T15:37:23.596 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:23.593+0000 7f23e1cbd640 1 -- 172.21.15.98:0/3437510089 wait complete. 2024-09-16T15:37:23.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:23.595+0000 7f23e1cbd640 1 Processor -- start 2024-09-16T15:37:23.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:23.595+0000 7f23e1cbd640 1 -- start start 2024-09-16T15:37:23.599 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:23.596+0000 7f23e1cbd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f23dc0d1610 0x7f23dc14f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:23.599 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:23.596+0000 7f23e1cbd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f23dc0d2050 0x7f23dc0cc310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:23.599 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:23.596+0000 7f23e1cbd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23dc15e0d0 0x7f23dc0c7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:23.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:23.596+0000 7f23e1cbd640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f23dc0cf590 con 0x7f23dc15e0d0 2024-09-16T15:37:23.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:23.596+0000 7f23e1cbd640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f23dc0cf410 con 0x7f23dc0d2050 2024-09-16T15:37:23.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:23.596+0000 7f23e1cbd640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f23dc0cf710 con 0x7f23dc0d1610 2024-09-16T15:37:23.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:23.596+0000 7f23db7fe640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f23dc0d1610 0x7f23dc14f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:23.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:23.596+0000 7f23dbfff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23dc15e0d0 0x7f23dc0c7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:23.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:23.596+0000 7f23daffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f23dc0d2050 0x7f23dc0cc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:23.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:23.596+0000 7f23dbfff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23dc15e0d0 0x7f23dc0c7ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60940/0 (socket says 172.21.15.98:60940) 2024-09-16T15:37:23.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:23.596+0000 7f23dbfff640 1 -- 172.21.15.98:0/3213465594 learned_addr learned my addr 172.21.15.98:0/3213465594 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:37:23.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:23.596+0000 7f23dbfff640 1 -- 172.21.15.98:0/3213465594 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f23dc0d1610 msgr2=0x7f23dc14f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:23.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:23.596+0000 7f23dbfff640 1 --2- 172.21.15.98:0/3213465594 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f23dc0d1610 0x7f23dc14f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:23.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:23.596+0000 7f23dbfff640 1 -- 172.21.15.98:0/3213465594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f23dc0d2050 msgr2=0x7f23dc0cc310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:23.601 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:23.596+0000 7f23dbfff640 1 --2- 172.21.15.98:0/3213465594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f23dc0d2050 0x7f23dc0cc310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:23.601 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:23.596+0000 7f23dbfff640 1 -- 172.21.15.98:0/3213465594 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23dc0cb270 con 0x7f23dc15e0d0 2024-09-16T15:37:23.601 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:23.596+0000 7f23daffd640 1 --2- 172.21.15.98:0/3213465594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f23dc0d2050 0x7f23dc0cc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T15:37:23.601 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:23.596+0000 7f23dbfff640 1 --2- 172.21.15.98:0/3213465594 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23dc15e0d0 0x7f23dc0c7ac0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f23d4009bf0 tx=0x7f23d4003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:23.601 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:23.596+0000 7f23d3fff640 1 -- 172.21.15.98:0/3213465594 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d4046070 con 0x7f23dc15e0d0 2024-09-16T15:37:23.601 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:23.596+0000 7f23d3fff640 1 -- 172.21.15.98:0/3213465594 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f23d4004040 con 0x7f23dc15e0d0 2024-09-16T15:37:23.601 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:23.597+0000 7f23d3fff640 1 -- 172.21.15.98:0/3213465594 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d4004450 con 0x7f23dc15e0d0 2024-09-16T15:37:23.601 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:23.597+0000 7f23e1cbd640 1 -- 172.21.15.98:0/3213465594 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23dc0cb550 con 0x7f23dc15e0d0 2024-09-16T15:37:23.601 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:23.597+0000 7f23e1cbd640 1 -- 172.21.15.98:0/3213465594 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23dc0cbb10 con 0x7f23dc15e0d0 2024-09-16T15:37:23.601 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:23.597+0000 7f23d3fff640 1 -- 172.21.15.98:0/3213465594 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f23d4049070 con 0x7f23dc15e0d0 2024-09-16T15:37:23.601 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:23.597+0000 7f23d3fff640 1 -- 172.21.15.98:0/3213465594 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f23d40045f0 con 0x7f23dc15e0d0 2024-09-16T15:37:23.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:23.598+0000 7f23e1cbd640 1 -- 172.21.15.98:0/3213465594 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23dc0ceca0 con 0x7f23dc15e0d0 2024-09-16T15:37:23.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:23.600+0000 7f23d3fff640 1 -- 172.21.15.98:0/3213465594 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f23d4050080 con 0x7f23dc15e0d0 2024-09-16T15:37:23.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:23.673+0000 7f23e1cbd640 1 -- 172.21.15.98:0/3213465594 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f23dc14f900 con 0x7f23dc15e0d0 2024-09-16T15:37:23.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:23.674+0000 7f23d3fff640 1 -- 172.21.15.98:0/3213465594 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f23d4032030 con 0x7f23dc15e0d0 2024-09-16T15:37:23.676 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:37:23.676 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":10,"fsid":"52a38a45-21d2-4cb0-bb3a-4fb8be3a08df","created":"2024-09-16T15:37:20.387654+0000","modified":"2024-09-16T15:37:23.430578+0000","last_up_change":"0.000000","last_in_change":"2024-09-16T15:37:23.430578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a2d61df4-2577-47e6-a4ac-c36bbb85ab8a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"bb3a68a5-c22f-442b-b292-7c272fe01ff2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c8429195-a480-409b-8e5f-8dc4c6abc0a1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"0e800d7b-096f-4f65-b3cc-c7cda3870de4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c7822e9b-8e29-48d9-b92a-e8f9c7bc5247","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"35805e02-484a-4404-a78f-aa44f4daa41f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"6327ba84-aaeb-41fa-9717-188988ff2c4e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"392d0958-dff9-4248-b3d8-a1201c10f354","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T15:37:23.677 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:23.675+0000 7f23e1cbd640 1 -- 172.21.15.98:0/3213465594 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23dc15e0d0 msgr2=0x7f23dc0c7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:23.678 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:23.675+0000 7f23e1cbd640 1 --2- 172.21.15.98:0/3213465594 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23dc15e0d0 0x7f23dc0c7ac0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f23d4009bf0 tx=0x7f23d4003ba0 comp rx=0 tx=0).stop 2024-09-16T15:37:23.678 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:23.675+0000 7f23e1cbd640 1 -- 172.21.15.98:0/3213465594 shutdown_connections 2024-09-16T15:37:23.678 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:23.675+0000 7f23e1cbd640 1 --2- 172.21.15.98:0/3213465594 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f23dc15e0d0 0x7f23dc0c7ac0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:23.678 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:23.675+0000 7f23e1cbd640 1 --2- 172.21.15.98:0/3213465594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f23dc0d2050 0x7f23dc0cc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:23.678 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:23.675+0000 7f23e1cbd640 1 --2- 172.21.15.98:0/3213465594 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f23dc0d1610 0x7f23dc14f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:23.678 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:23.675+0000 7f23e1cbd640 1 -- 172.21.15.98:0/3213465594 >> 172.21.15.98:0/3213465594 conn(0x7f23dc0d3fe0 msgr2=0x7f23dc15f650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:23.678 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:23.675+0000 7f23e1cbd640 1 -- 172.21.15.98:0/3213465594 shutdown_connections 2024-09-16T15:37:23.678 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:23.675+0000 7f23e1cbd640 1 -- 172.21.15.98:0/3213465594 wait complete. 2024-09-16T15:37:23.687 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-16T15:37:23.688 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-16T15:37:24.494 DEBUG:teuthology.orchestra.run.smithi098:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-16T15:37:24.588 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:24.585+0000 7fea30b0e640 1 -- 172.21.15.98:0/1832881607 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fea2c0cf050 msgr2=0x7fea2c0cd5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:24.588 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:24.585+0000 7fea30b0e640 1 --2- 172.21.15.98:0/1832881607 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fea2c0cf050 0x7fea2c0cd5e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fea14009860 tx=0x7fea1402a5a0 comp rx=0 tx=0).stop 2024-09-16T15:37:24.588 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:24.585+0000 7fea30b0e640 1 -- 172.21.15.98:0/1832881607 shutdown_connections 2024-09-16T15:37:24.588 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:24.586+0000 7fea30b0e640 1 --2- 172.21.15.98:0/1832881607 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fea2c0cf050 0x7fea2c0cd5e0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:24.588 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:24.586+0000 7fea30b0e640 1 -- 172.21.15.98:0/1832881607 >> 172.21.15.98:0/1832881607 conn(0x7fea2c0d1f30 msgr2=0x7fea2c0d2340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:24.588 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:24.586+0000 7fea30b0e640 1 -- 172.21.15.98:0/1832881607 shutdown_connections 2024-09-16T15:37:24.588 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:24.586+0000 7fea30b0e640 1 -- 172.21.15.98:0/1832881607 wait complete. 2024-09-16T15:37:24.589 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:24.587+0000 7fea30b0e640 1 Processor -- start 2024-09-16T15:37:24.589 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:24.587+0000 7fea30b0e640 1 -- start start 2024-09-16T15:37:24.591 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:24.588+0000 7fea30b0e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fea2c0cf050 0x7fea2c15b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:24.591 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:24.588+0000 7fea30b0e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fea2c0d2a50 0x7fea2c09bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:24.591 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:24.588+0000 7fea30b0e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea2c15c020 0x7fea2c0c8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:24.591 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:24.588+0000 7fea30b0e640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fea2c0b6740 con 0x7fea2c0d2a50 2024-09-16T15:37:24.591 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:24.588+0000 7fea30b0e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fea2c0b65c0 con 0x7fea2c15c020 2024-09-16T15:37:24.591 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:24.588+0000 7fea30b0e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fea2c0b68c0 con 0x7fea2c0cf050 2024-09-16T15:37:24.592 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:24.588+0000 7fea23fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fea2c0d2a50 0x7fea2c09bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:24.592 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:24.588+0000 7fea23fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fea2c0d2a50 0x7fea2c09bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60946/0 (socket says 172.21.15.98:60946) 2024-09-16T15:37:24.592 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:24.588+0000 7fea23fff640 1 -- 172.21.15.98:0/1961399929 learned_addr learned my addr 172.21.15.98:0/1961399929 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:37:24.592 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:24.588+0000 7fea2ad9d640 1 --2- 172.21.15.98:0/1961399929 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea2c15c020 0x7fea2c0c8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:24.592 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:24.588+0000 7fea2a59c640 1 --2- 172.21.15.98:0/1961399929 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fea2c0cf050 0x7fea2c15b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:24.592 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:24.588+0000 7fea23fff640 1 -- 172.21.15.98:0/1961399929 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fea2c0cf050 msgr2=0x7fea2c15b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:24.592 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:24.588+0000 7fea23fff640 1 --2- 172.21.15.98:0/1961399929 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fea2c0cf050 0x7fea2c15b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:24.592 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:24.588+0000 7fea23fff640 1 -- 172.21.15.98:0/1961399929 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea2c15c020 msgr2=0x7fea2c0c8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:24.592 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:24.588+0000 7fea23fff640 1 --2- 172.21.15.98:0/1961399929 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea2c15c020 0x7fea2c0c8440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:24.592 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:24.588+0000 7fea23fff640 1 -- 172.21.15.98:0/1961399929 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea2c09ccc0 con 0x7fea2c0d2a50 2024-09-16T15:37:24.592 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:24.588+0000 7fea23fff640 1 --2- 172.21.15.98:0/1961399929 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fea2c0d2a50 0x7fea2c09bbf0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fea1402ab90 tx=0x7fea14032b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:24.592 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:24.588+0000 7fea22ffd640 1 -- 172.21.15.98:0/1961399929 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea14040070 con 0x7fea2c0d2a50 2024-09-16T15:37:24.592 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:24.588+0000 7fea22ffd640 1 -- 172.21.15.98:0/1961399929 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fea140038e0 con 0x7fea2c0d2a50 2024-09-16T15:37:24.593 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:24.588+0000 7fea22ffd640 1 -- 172.21.15.98:0/1961399929 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea14003cf0 con 0x7fea2c0d2a50 2024-09-16T15:37:24.593 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:24.588+0000 7fea30b0e640 1 -- 172.21.15.98:0/1961399929 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea2c09c420 con 0x7fea2c0d2a50 2024-09-16T15:37:24.593 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:24.589+0000 7fea30b0e640 1 -- 172.21.15.98:0/1961399929 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea2c09c9e0 con 0x7fea2c0d2a50 2024-09-16T15:37:24.593 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:24.589+0000 7fea22ffd640 1 -- 172.21.15.98:0/1961399929 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fea14039040 con 0x7fea2c0d2a50 2024-09-16T15:37:24.593 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:24.589+0000 7fea22ffd640 1 -- 172.21.15.98:0/1961399929 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fea14045c80 con 0x7fea2c0d2a50 2024-09-16T15:37:24.593 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:24.589+0000 7fea30b0e640 1 -- 172.21.15.98:0/1961399929 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea2c0ce720 con 0x7fea2c0d2a50 2024-09-16T15:37:24.593 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:24.591+0000 7fea22ffd640 1 -- 172.21.15.98:0/1961399929 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fea14045460 con 0x7fea2c0d2a50 2024-09-16T15:37:24.652 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:24.650+0000 7fea30b0e640 1 -- 172.21.15.98:0/1961399929 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fea2c0b7c10 con 0x7fea2c0d2a50 2024-09-16T15:37:24.653 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:24.651+0000 7fea22ffd640 1 -- 172.21.15.98:0/1961399929 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fea14045640 con 0x7fea2c0d2a50 2024-09-16T15:37:24.653 INFO:teuthology.misc.health.smithi098.stdout: 2024-09-16T15:37:24.653 INFO:teuthology.misc.health.smithi098.stdout:{"epoch":10,"fsid":"52a38a45-21d2-4cb0-bb3a-4fb8be3a08df","created":"2024-09-16T15:37:20.387654+0000","modified":"2024-09-16T15:37:23.430578+0000","last_up_change":"0.000000","last_in_change":"2024-09-16T15:37:23.430578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a2d61df4-2577-47e6-a4ac-c36bbb85ab8a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"bb3a68a5-c22f-442b-b292-7c272fe01ff2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c8429195-a480-409b-8e5f-8dc4c6abc0a1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"0e800d7b-096f-4f65-b3cc-c7cda3870de4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c7822e9b-8e29-48d9-b92a-e8f9c7bc5247","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"35805e02-484a-4404-a78f-aa44f4daa41f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"6327ba84-aaeb-41fa-9717-188988ff2c4e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"392d0958-dff9-4248-b3d8-a1201c10f354","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T15:37:24.654 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:24.652+0000 7fea30b0e640 1 -- 172.21.15.98:0/1961399929 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fea2c0d2a50 msgr2=0x7fea2c09bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:24.654 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:24.652+0000 7fea30b0e640 1 --2- 172.21.15.98:0/1961399929 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fea2c0d2a50 0x7fea2c09bbf0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fea1402ab90 tx=0x7fea14032b90 comp rx=0 tx=0).stop 2024-09-16T15:37:24.654 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:24.652+0000 7fea30b0e640 1 -- 172.21.15.98:0/1961399929 shutdown_connections 2024-09-16T15:37:24.654 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:24.652+0000 7fea30b0e640 1 --2- 172.21.15.98:0/1961399929 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea2c15c020 0x7fea2c0c8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:24.654 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:24.652+0000 7fea30b0e640 1 --2- 172.21.15.98:0/1961399929 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fea2c0d2a50 0x7fea2c09bbf0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:24.654 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:24.652+0000 7fea30b0e640 1 --2- 172.21.15.98:0/1961399929 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fea2c0cf050 0x7fea2c15b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:24.654 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:24.652+0000 7fea30b0e640 1 -- 172.21.15.98:0/1961399929 >> 172.21.15.98:0/1961399929 conn(0x7fea2c0d1f30 msgr2=0x7fea2c15d630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:24.654 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:24.652+0000 7fea30b0e640 1 -- 172.21.15.98:0/1961399929 shutdown_connections 2024-09-16T15:37:24.654 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:24.652+0000 7fea30b0e640 1 -- 172.21.15.98:0/1961399929 wait complete. 2024-09-16T15:37:24.663 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-16T15:37:24.919 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-16T15:37:24.916+0000 7f57145b2640 -1 Falling back to public interface 2024-09-16T15:37:24.922 INFO:tasks.ceph.osd.2.smithi098.stderr:2024-09-16T15:37:24.920+0000 7f10976b0640 -1 Falling back to public interface 2024-09-16T15:37:24.933 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-16T15:37:24.931+0000 7f104021a640 -1 Falling back to public interface 2024-09-16T15:37:24.936 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-16T15:37:24.934+0000 7fe709f1e640 -1 Falling back to public interface 2024-09-16T15:37:25.165 INFO:tasks.ceph.osd.3.smithi098.stderr:2024-09-16T15:37:25.163+0000 7f1b6420d640 -1 Falling back to public interface 2024-09-16T15:37:25.174 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-16T15:37:25.171+0000 7f2868a12640 -1 Falling back to public interface 2024-09-16T15:37:25.186 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-09-16T15:37:25.184+0000 7f2a78c0d640 -1 Falling back to public interface 2024-09-16T15:37:25.415 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-16T15:37:25.412+0000 7f5e6da15640 -1 Falling back to public interface 2024-09-16T15:37:25.714 INFO:tasks.ceph.mgr.x.smithi135.stderr:2024-09-16T15:37:25.712+0000 7fae8ae17640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-16T15:37:25.716 INFO:tasks.ceph.mgr.x.smithi135.stderr:2024-09-16T15:37:25.714+0000 7fae8ae17640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-16T15:37:28.690 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-16T15:37:28.688+0000 7f2868a12640 -1 osd.6 0 log_to_monitors true 2024-09-16T15:37:28.739 INFO:tasks.ceph.osd.2.smithi098.stderr:2024-09-16T15:37:28.737+0000 7f10976b0640 -1 osd.2 0 log_to_monitors true 2024-09-16T15:37:28.746 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-16T15:37:28.745+0000 7fe709f1e640 -1 osd.1 0 log_to_monitors true 2024-09-16T15:37:28.953 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-09-16T15:37:28.951+0000 7f2a78c0d640 -1 osd.0 0 log_to_monitors true 2024-09-16T15:37:29.016 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-16T15:37:29.014+0000 7f104021a640 -1 osd.4 0 log_to_monitors true 2024-09-16T15:37:29.166 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-16T15:37:29.163+0000 7f5e6da15640 -1 osd.7 0 log_to_monitors true 2024-09-16T15:37:29.167 INFO:tasks.ceph.osd.3.smithi098.stderr:2024-09-16T15:37:29.166+0000 7f1b6420d640 -1 osd.3 0 log_to_monitors true 2024-09-16T15:37:29.243 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-16T15:37:29.241+0000 7f57145b2640 -1 osd.5 0 log_to_monitors true 2024-09-16T15:37:30.544 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-16T15:37:30.542+0000 7f286429e640 -1 osd.6 0 waiting for initial osdmap 2024-09-16T15:37:30.559 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-16T15:37:30.557+0000 7f285c0bd640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T15:37:31.468 DEBUG:teuthology.orchestra.run.smithi098:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-16T15:37:31.576 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:31.574+0000 7fab881b4640 1 -- 172.21.15.98:0/958268269 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fab800b0b50 msgr2=0x7fab800b2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:31.577 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:31.574+0000 7fab881b4640 1 --2- 172.21.15.98:0/958268269 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fab800b0b50 0x7fab800b2a70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fab80073d70 tx=0x7fab7c02a4d0 comp rx=0 tx=0).stop 2024-09-16T15:37:31.577 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:31.574+0000 7fab881b4640 1 -- 172.21.15.98:0/958268269 shutdown_connections 2024-09-16T15:37:31.577 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:31.574+0000 7fab881b4640 1 --2- 172.21.15.98:0/958268269 >> v2:172.21.15.135:3300/0 conn(0x7fab800afb80 0x7fab800b2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:31.577 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:31.574+0000 7fab881b4640 1 --2- 172.21.15.98:0/958268269 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fab800b0b50 0x7fab800b2a70 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:31.577 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:31.574+0000 7fab881b4640 1 -- 172.21.15.98:0/958268269 >> 172.21.15.98:0/958268269 conn(0x7fab800d1df0 msgr2=0x7fab800d2200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:31.577 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:31.574+0000 7fab881b4640 1 -- 172.21.15.98:0/958268269 shutdown_connections 2024-09-16T15:37:31.577 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:31.574+0000 7fab881b4640 1 -- 172.21.15.98:0/958268269 wait complete. 2024-09-16T15:37:31.577 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:31.576+0000 7fab881b4640 1 Processor -- start 2024-09-16T15:37:31.578 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:31.576+0000 7fab881b4640 1 -- start start 2024-09-16T15:37:31.580 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:31.576+0000 7fab881b4640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fab800afb80 0x7fab801536c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:31.580 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:31.577+0000 7fab881b4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fab800b0b50 0x7fab800c8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:31.580 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:31.577+0000 7fab881b4640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fab800cfcf0 0x7fab800b5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:31.580 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:31.577+0000 7fab881b4640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fab800d2a90 con 0x7fab800cfcf0 2024-09-16T15:37:31.580 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:31.577+0000 7fab881b4640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fab800d2910 con 0x7fab800b0b50 2024-09-16T15:37:31.580 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:31.577+0000 7fab881b4640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fab80160370 con 0x7fab800afb80 2024-09-16T15:37:31.580 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:31.577+0000 7fab86751640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fab800cfcf0 0x7fab800b5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:31.580 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:31.577+0000 7fab86751640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fab800cfcf0 0x7fab800b5260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48802/0 (socket says 172.21.15.98:48802) 2024-09-16T15:37:31.580 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:31.577+0000 7fab86751640 1 -- 172.21.15.98:0/1793928880 learned_addr learned my addr 172.21.15.98:0/1793928880 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:37:31.580 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:31.577+0000 7fab8574f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fab800b0b50 0x7fab800c8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:31.580 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:31.577+0000 7fab85f50640 1 --2- 172.21.15.98:0/1793928880 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fab800afb80 0x7fab801536c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:31.581 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:31.577+0000 7fab86751640 1 -- 172.21.15.98:0/1793928880 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fab800afb80 msgr2=0x7fab801536c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:31.581 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:31.577+0000 7fab86751640 1 --2- 172.21.15.98:0/1793928880 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fab800afb80 0x7fab801536c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:31.581 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:31.577+0000 7fab86751640 1 -- 172.21.15.98:0/1793928880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fab800b0b50 msgr2=0x7fab800c8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:31.581 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:31.577+0000 7fab86751640 1 --2- 172.21.15.98:0/1793928880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fab800b0b50 0x7fab800c8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:31.581 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:31.577+0000 7fab86751640 1 -- 172.21.15.98:0/1793928880 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab8006de00 con 0x7fab800cfcf0 2024-09-16T15:37:31.581 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:31.577+0000 7fab8574f640 1 --2- 172.21.15.98:0/1793928880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fab800b0b50 0x7fab800c8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T15:37:31.581 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:31.577+0000 7fab86751640 1 --2- 172.21.15.98:0/1793928880 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fab800cfcf0 0x7fab800b5260 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fab7800eb40 tx=0x7fab7800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:31.581 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:31.577+0000 7fab767fc640 1 -- 172.21.15.98:0/1793928880 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab78004b20 con 0x7fab800cfcf0 2024-09-16T15:37:31.581 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:31.577+0000 7fab767fc640 1 -- 172.21.15.98:0/1793928880 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fab78004ce0 con 0x7fab800cfcf0 2024-09-16T15:37:31.581 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:31.577+0000 7fab881b4640 1 -- 172.21.15.98:0/1793928880 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab8006e0e0 con 0x7fab800cfcf0 2024-09-16T15:37:31.581 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:31.577+0000 7fab767fc640 1 -- 172.21.15.98:0/1793928880 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab78005280 con 0x7fab800cfcf0 2024-09-16T15:37:31.581 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:31.578+0000 7fab881b4640 1 -- 172.21.15.98:0/1793928880 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab8006e6a0 con 0x7fab800cfcf0 2024-09-16T15:37:31.582 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:31.579+0000 7fab881b4640 1 -- 172.21.15.98:0/1793928880 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab80160810 con 0x7fab800cfcf0 2024-09-16T15:37:31.582 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:31.579+0000 7fab767fc640 1 -- 172.21.15.98:0/1793928880 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) ==== 101231+0+0 (secure 0 0 0) 0x7fab78005420 con 0x7fab800cfcf0 2024-09-16T15:37:31.582 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:31.580+0000 7fab767fc640 1 --2- 172.21.15.98:0/1793928880 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fab640787c0 0x7fab6407ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:31.582 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:31.580+0000 7fab767fc640 1 -- 172.21.15.98:0/1793928880 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2511+0+0 (secure 0 0 0) 0x7fab7809a6d0 con 0x7fab800cfcf0 2024-09-16T15:37:31.582 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:31.580+0000 7fab85f50640 1 --2- 172.21.15.98:0/1793928880 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fab640787c0 0x7fab6407ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:31.583 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:31.581+0000 7fab85f50640 1 --2- 172.21.15.98:0/1793928880 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fab640787c0 0x7fab6407ac80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fab7c033000 tx=0x7fab7c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:31.586 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:31.584+0000 7fab767fc640 1 -- 172.21.15.98:0/1793928880 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7fab780634e0 con 0x7fab800cfcf0 2024-09-16T15:37:31.811 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:31.809+0000 7fab881b4640 1 -- 172.21.15.98:0/1793928880 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fab800b1530 con 0x7fab800cfcf0 2024-09-16T15:37:31.811 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:31.809+0000 7fab767fc640 1 -- 172.21.15.98:0/1793928880 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+7567 (secure 0 0 0) 0x7fab78067f10 con 0x7fab800cfcf0 2024-09-16T15:37:31.812 INFO:teuthology.misc.health.smithi098.stdout: 2024-09-16T15:37:31.812 INFO:teuthology.misc.health.smithi098.stdout:{"epoch":13,"fsid":"52a38a45-21d2-4cb0-bb3a-4fb8be3a08df","created":"2024-09-16T15:37:20.387654+0000","modified":"2024-09-16T15:37:30.718673+0000","last_up_change":"2024-09-16T15:37:30.718673+0000","last_in_change":"2024-09-16T15:37:23.430578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a2d61df4-2577-47e6-a4ac-c36bbb85ab8a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"bb3a68a5-c22f-442b-b292-7c272fe01ff2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c8429195-a480-409b-8e5f-8dc4c6abc0a1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"0e800d7b-096f-4f65-b3cc-c7cda3870de4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c7822e9b-8e29-48d9-b92a-e8f9c7bc5247","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"35805e02-484a-4404-a78f-aa44f4daa41f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"6327ba84-aaeb-41fa-9717-188988ff2c4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3376376340},{"type":"v1","addr":"172.21.15.135:6819","nonce":3376376340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3376376340},{"type":"v1","addr":"172.21.15.135:6821","nonce":3376376340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":3376376340},{"type":"v1","addr":"172.21.15.135:6825","nonce":3376376340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3376376340},{"type":"v1","addr":"172.21.15.135:6823","nonce":3376376340}]},"public_addr":"172.21.15.135:6819/3376376340","cluster_addr":"172.21.15.135:6821/3376376340","heartbeat_back_addr":"172.21.15.135:6825/3376376340","heartbeat_front_addr":"172.21.15.135:6823/3376376340","state":["exists","up"]},{"osd":7,"uuid":"392d0958-dff9-4248-b3d8-a1201c10f354","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T15:37:31.814 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:31.812+0000 7fab881b4640 1 -- 172.21.15.98:0/1793928880 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fab640787c0 msgr2=0x7fab6407ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:31.814 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:31.812+0000 7fab881b4640 1 --2- 172.21.15.98:0/1793928880 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fab640787c0 0x7fab6407ac80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fab7c033000 tx=0x7fab7c004730 comp rx=0 tx=0).stop 2024-09-16T15:37:31.814 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:31.812+0000 7fab881b4640 1 -- 172.21.15.98:0/1793928880 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fab800cfcf0 msgr2=0x7fab800b5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:31.814 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:31.812+0000 7fab881b4640 1 --2- 172.21.15.98:0/1793928880 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fab800cfcf0 0x7fab800b5260 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fab7800eb40 tx=0x7fab7800c2d0 comp rx=0 tx=0).stop 2024-09-16T15:37:31.815 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:31.812+0000 7fab881b4640 1 -- 172.21.15.98:0/1793928880 shutdown_connections 2024-09-16T15:37:31.815 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:31.812+0000 7fab881b4640 1 --2- 172.21.15.98:0/1793928880 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fab800cfcf0 0x7fab800b5260 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:31.815 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:31.812+0000 7fab881b4640 1 --2- 172.21.15.98:0/1793928880 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fab640787c0 0x7fab6407ac80 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:31.815 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:31.812+0000 7fab881b4640 1 --2- 172.21.15.98:0/1793928880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fab800b0b50 0x7fab800c8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:31.815 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:31.812+0000 7fab881b4640 1 --2- 172.21.15.98:0/1793928880 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fab800afb80 0x7fab801536c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:31.815 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:31.812+0000 7fab881b4640 1 -- 172.21.15.98:0/1793928880 >> 172.21.15.98:0/1793928880 conn(0x7fab800d1df0 msgr2=0x7fab800b38e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:31.815 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:31.812+0000 7fab881b4640 1 -- 172.21.15.98:0/1793928880 shutdown_connections 2024-09-16T15:37:31.815 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:31.812+0000 7fab881b4640 1 -- 172.21.15.98:0/1793928880 wait complete. 2024-09-16T15:37:31.824 DEBUG:teuthology.misc:1 of 8 OSDs are up 2024-09-16T15:37:32.409 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-16T15:37:32.407+0000 7f5e692f5640 -1 osd.7 0 waiting for initial osdmap 2024-09-16T15:37:32.416 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-16T15:37:32.414+0000 7f103bbe8640 -1 osd.4 0 waiting for initial osdmap 2024-09-16T15:37:32.419 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-16T15:37:32.417+0000 7f5e61114640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T15:37:32.425 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-16T15:37:32.423+0000 7f1033a07640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T15:37:32.439 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-16T15:37:32.437+0000 7f5710541640 -1 osd.5 0 waiting for initial osdmap 2024-09-16T15:37:32.449 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-16T15:37:32.447+0000 7f5708360640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T15:37:32.774 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-09-16T15:37:32.772+0000 7f2a7464b640 -1 osd.0 0 waiting for initial osdmap 2024-09-16T15:37:32.778 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-16T15:37:32.777+0000 7fe705ead640 -1 osd.1 0 waiting for initial osdmap 2024-09-16T15:37:32.789 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-09-16T15:37:32.787+0000 7f2a6c46a640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T15:37:32.791 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-16T15:37:32.790+0000 7fe6fdccc640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T15:37:32.834 INFO:tasks.ceph.osd.3.smithi098.stderr:2024-09-16T15:37:32.833+0000 7f1b5faed640 -1 osd.3 0 waiting for initial osdmap 2024-09-16T15:37:32.843 INFO:tasks.ceph.osd.2.smithi098.stderr:2024-09-16T15:37:32.841+0000 7f109363f640 -1 osd.2 0 waiting for initial osdmap 2024-09-16T15:37:32.847 INFO:tasks.ceph.osd.3.smithi098.stderr:2024-09-16T15:37:32.845+0000 7f1b5790c640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T15:37:32.863 INFO:tasks.ceph.osd.2.smithi098.stderr:2024-09-16T15:37:32.862+0000 7f108b45e640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T15:37:38.631 DEBUG:teuthology.orchestra.run.smithi098:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-16T15:37:38.729 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:38.727+0000 7f391c4e6640 1 -- 172.21.15.98:0/1625068992 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f391415e6a0 msgr2=0x7f39140b0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:38.730 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:38.727+0000 7f391c4e6640 1 --2- 172.21.15.98:0/1625068992 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f391415e6a0 0x7f39140b0400 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3910005fd0 tx=0x7f391002a5f0 comp rx=0 tx=0).stop 2024-09-16T15:37:38.730 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:38.727+0000 7f391c4e6640 1 -- 172.21.15.98:0/1625068992 shutdown_connections 2024-09-16T15:37:38.730 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:38.727+0000 7f391c4e6640 1 --2- 172.21.15.98:0/1625068992 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f391415e6a0 0x7f39140b0400 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:38.730 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:38.727+0000 7f391c4e6640 1 -- 172.21.15.98:0/1625068992 >> 172.21.15.98:0/1625068992 conn(0x7f39140b1f00 msgr2=0x7f39140b2310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:38.730 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:38.728+0000 7f391c4e6640 1 -- 172.21.15.98:0/1625068992 shutdown_connections 2024-09-16T15:37:38.730 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:38.728+0000 7f391c4e6640 1 -- 172.21.15.98:0/1625068992 wait complete. 2024-09-16T15:37:38.731 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:38.729+0000 7f391c4e6640 1 Processor -- start 2024-09-16T15:37:38.731 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:38.729+0000 7f391c4e6640 1 -- start start 2024-09-16T15:37:38.733 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:38.730+0000 7f391c4e6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f39140af4a0 0x7f39141f3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:38.733 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:38.730+0000 7f391c4e6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39140ceff0 0x7f39141f58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:38.733 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:38.730+0000 7f391c4e6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f391415e6a0 0x7f39140c5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:38.733 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:38.730+0000 7f391c4e6640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3914068830 con 0x7f391415e6a0 2024-09-16T15:37:38.733 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:38.730+0000 7f391c4e6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f39140cbc10 con 0x7f39140ceff0 2024-09-16T15:37:38.733 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:38.730+0000 7f391c4e6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f39140689b0 con 0x7f39140af4a0 2024-09-16T15:37:38.734 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:38.730+0000 7f391aa83640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f391415e6a0 0x7f39140c5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:38.734 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:38.730+0000 7f391aa83640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f391415e6a0 0x7f39140c5640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:33180/0 (socket says 172.21.15.98:33180) 2024-09-16T15:37:38.734 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:38.730+0000 7f391aa83640 1 -- 172.21.15.98:0/309980997 learned_addr learned my addr 172.21.15.98:0/309980997 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:37:38.734 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:38.730+0000 7f391a282640 1 --2- 172.21.15.98:0/309980997 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f39140af4a0 0x7f39141f3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:38.734 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:38.730+0000 7f3919a81640 1 --2- 172.21.15.98:0/309980997 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39140ceff0 0x7f39141f58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:38.734 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:38.730+0000 7f391aa83640 1 -- 172.21.15.98:0/309980997 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f39140af4a0 msgr2=0x7f39141f3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:38.734 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:38.730+0000 7f391aa83640 1 --2- 172.21.15.98:0/309980997 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f39140af4a0 0x7f39141f3b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:38.734 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:38.730+0000 7f391aa83640 1 -- 172.21.15.98:0/309980997 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39140ceff0 msgr2=0x7f39141f58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:38.734 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:38.730+0000 7f391aa83640 1 --2- 172.21.15.98:0/309980997 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39140ceff0 0x7f39141f58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:38.734 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:38.730+0000 7f391aa83640 1 -- 172.21.15.98:0/309980997 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39141f5e10 con 0x7f391415e6a0 2024-09-16T15:37:38.734 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:38.730+0000 7f391a282640 1 --2- 172.21.15.98:0/309980997 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f39140af4a0 0x7f39141f3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T15:37:38.734 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:38.730+0000 7f3919a81640 1 --2- 172.21.15.98:0/309980997 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39140ceff0 0x7f39141f58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T15:37:38.734 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:38.730+0000 7f391aa83640 1 --2- 172.21.15.98:0/309980997 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f391415e6a0 0x7f39140c5640 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f390c00c7a0 tx=0x7f390c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:38.735 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:38.730+0000 7f3906ffd640 1 -- 172.21.15.98:0/309980997 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f390c003b70 con 0x7f391415e6a0 2024-09-16T15:37:38.735 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:38.730+0000 7f3906ffd640 1 -- 172.21.15.98:0/309980997 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f390c003d10 con 0x7f391415e6a0 2024-09-16T15:37:38.735 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:38.730+0000 7f391c4e6640 1 -- 172.21.15.98:0/309980997 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39140c74e0 con 0x7f391415e6a0 2024-09-16T15:37:38.735 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:38.730+0000 7f3906ffd640 1 -- 172.21.15.98:0/309980997 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f390c00aab0 con 0x7f391415e6a0 2024-09-16T15:37:38.735 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:38.730+0000 7f391c4e6640 1 -- 172.21.15.98:0/309980997 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39140c7a80 con 0x7f391415e6a0 2024-09-16T15:37:38.735 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:38.731+0000 7f391c4e6640 1 -- 172.21.15.98:0/309980997 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39140cc350 con 0x7f391415e6a0 2024-09-16T15:37:38.736 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:38.732+0000 7f3906ffd640 1 -- 172.21.15.98:0/309980997 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) ==== 101231+0+0 (secure 0 0 0) 0x7f390c00ac50 con 0x7f391415e6a0 2024-09-16T15:37:38.736 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:38.732+0000 7f3906ffd640 1 --2- 172.21.15.98:0/309980997 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f38f80787c0 0x7f38f807ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:38.736 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:38.732+0000 7f3906ffd640 1 -- 172.21.15.98:0/309980997 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f390c09a380 con 0x7f391415e6a0 2024-09-16T15:37:38.736 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:38.733+0000 7f391a282640 1 --2- 172.21.15.98:0/309980997 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f38f80787c0 0x7f38f807ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:38.736 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:38.733+0000 7f391a282640 1 --2- 172.21.15.98:0/309980997 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f38f80787c0 0x7f38f807ac80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3910033000 tx=0x7f3910004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:38.738 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:38.737+0000 7f3906ffd640 1 -- 172.21.15.98:0/309980997 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7f39141f5e10 con 0x7f391415e6a0 2024-09-16T15:37:38.917 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:38.915+0000 7f391c4e6640 1 -- 172.21.15.98:0/309980997 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f39140ca820 con 0x7f391415e6a0 2024-09-16T15:37:38.918 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:38.916+0000 7f3906ffd640 1 -- 172.21.15.98:0/309980997 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+12908 (secure 0 0 0) 0x7f390c062e20 con 0x7f391415e6a0 2024-09-16T15:37:38.918 INFO:teuthology.misc.health.smithi098.stdout: 2024-09-16T15:37:38.918 INFO:teuthology.misc.health.smithi098.stdout:{"epoch":19,"fsid":"52a38a45-21d2-4cb0-bb3a-4fb8be3a08df","created":"2024-09-16T15:37:20.387654+0000","modified":"2024-09-16T15:37:37.463448+0000","last_up_change":"2024-09-16T15:37:33.417470+0000","last_in_change":"2024-09-16T15:37:23.430578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T15:37:34.725090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a2d61df4-2577-47e6-a4ac-c36bbb85ab8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1967099790},{"type":"v1","addr":"172.21.15.98:6825","nonce":1967099790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1967099790},{"type":"v1","addr":"172.21.15.98:6827","nonce":1967099790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":1967099790},{"type":"v1","addr":"172.21.15.98:6831","nonce":1967099790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1967099790},{"type":"v1","addr":"172.21.15.98:6829","nonce":1967099790}]},"public_addr":"172.21.15.98:6825/1967099790","cluster_addr":"172.21.15.98:6827/1967099790","heartbeat_back_addr":"172.21.15.98:6831/1967099790","heartbeat_front_addr":"172.21.15.98:6829/1967099790","state":["exists","up"]},{"osd":1,"uuid":"bb3a68a5-c22f-442b-b292-7c272fe01ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":3571460482},{"type":"v1","addr":"172.21.15.98:6809","nonce":3571460482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":3571460482},{"type":"v1","addr":"172.21.15.98:6811","nonce":3571460482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":3571460482},{"type":"v1","addr":"172.21.15.98:6815","nonce":3571460482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":3571460482},{"type":"v1","addr":"172.21.15.98:6813","nonce":3571460482}]},"public_addr":"172.21.15.98:6809/3571460482","cluster_addr":"172.21.15.98:6811/3571460482","heartbeat_back_addr":"172.21.15.98:6815/3571460482","heartbeat_front_addr":"172.21.15.98:6813/3571460482","state":["exists","up"]},{"osd":2,"uuid":"c8429195-a480-409b-8e5f-8dc4c6abc0a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":2573210695},{"type":"v1","addr":"172.21.15.98:6801","nonce":2573210695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":2573210695},{"type":"v1","addr":"172.21.15.98:6803","nonce":2573210695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":2573210695},{"type":"v1","addr":"172.21.15.98:6807","nonce":2573210695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":2573210695},{"type":"v1","addr":"172.21.15.98:6805","nonce":2573210695}]},"public_addr":"172.21.15.98:6801/2573210695","cluster_addr":"172.21.15.98:6803/2573210695","heartbeat_back_addr":"172.21.15.98:6807/2573210695","heartbeat_front_addr":"172.21.15.98:6805/2573210695","state":["exists","up"]},{"osd":3,"uuid":"0e800d7b-096f-4f65-b3cc-c7cda3870de4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":3951374837},{"type":"v1","addr":"172.21.15.98:6817","nonce":3951374837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":3951374837},{"type":"v1","addr":"172.21.15.98:6819","nonce":3951374837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":3951374837},{"type":"v1","addr":"172.21.15.98:6823","nonce":3951374837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":3951374837},{"type":"v1","addr":"172.21.15.98:6821","nonce":3951374837}]},"public_addr":"172.21.15.98:6817/3951374837","cluster_addr":"172.21.15.98:6819/3951374837","heartbeat_back_addr":"172.21.15.98:6823/3951374837","heartbeat_front_addr":"172.21.15.98:6821/3951374837","state":["exists","up"]},{"osd":4,"uuid":"c7822e9b-8e29-48d9-b92a-e8f9c7bc5247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":724302036},{"type":"v1","addr":"172.21.15.135:6811","nonce":724302036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":724302036},{"type":"v1","addr":"172.21.15.135:6813","nonce":724302036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":724302036},{"type":"v1","addr":"172.21.15.135:6817","nonce":724302036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":724302036},{"type":"v1","addr":"172.21.15.135:6815","nonce":724302036}]},"public_addr":"172.21.15.135:6811/724302036","cluster_addr":"172.21.15.135:6813/724302036","heartbeat_back_addr":"172.21.15.135:6817/724302036","heartbeat_front_addr":"172.21.15.135:6815/724302036","state":["exists","up"]},{"osd":5,"uuid":"35805e02-484a-4404-a78f-aa44f4daa41f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3083482635},{"type":"v1","addr":"172.21.15.135:6803","nonce":3083482635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3083482635},{"type":"v1","addr":"172.21.15.135:6805","nonce":3083482635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3083482635},{"type":"v1","addr":"172.21.15.135:6809","nonce":3083482635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3083482635},{"type":"v1","addr":"172.21.15.135:6807","nonce":3083482635}]},"public_addr":"172.21.15.135:6803/3083482635","cluster_addr":"172.21.15.135:6805/3083482635","heartbeat_back_addr":"172.21.15.135:6809/3083482635","heartbeat_front_addr":"172.21.15.135:6807/3083482635","state":["exists","up"]},{"osd":6,"uuid":"6327ba84-aaeb-41fa-9717-188988ff2c4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3376376340},{"type":"v1","addr":"172.21.15.135:6819","nonce":3376376340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3376376340},{"type":"v1","addr":"172.21.15.135:6821","nonce":3376376340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":3376376340},{"type":"v1","addr":"172.21.15.135:6825","nonce":3376376340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3376376340},{"type":"v1","addr":"172.21.15.135:6823","nonce":3376376340}]},"public_addr":"172.21.15.135:6819/3376376340","cluster_addr":"172.21.15.135:6821/3376376340","heartbeat_back_addr":"172.21.15.135:6825/3376376340","heartbeat_front_addr":"172.21.15.135:6823/3376376340","state":["exists","up"]},{"osd":7,"uuid":"392d0958-dff9-4248-b3d8-a1201c10f354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2559837727},{"type":"v1","addr":"172.21.15.135:6827","nonce":2559837727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2559837727},{"type":"v1","addr":"172.21.15.135:6829","nonce":2559837727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":2559837727},{"type":"v1","addr":"172.21.15.135:6833","nonce":2559837727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2559837727},{"type":"v1","addr":"172.21.15.135:6831","nonce":2559837727}]},"public_addr":"172.21.15.135:6827/2559837727","cluster_addr":"172.21.15.135:6829/2559837727","heartbeat_back_addr":"172.21.15.135:6833/2559837727","heartbeat_front_addr":"172.21.15.135:6831/2559837727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.939904+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.717296+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.785817+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:30.211718+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.973359+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:30.250109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.699327+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:30.173063+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T15:37:38.921 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:38.918+0000 7f391c4e6640 1 -- 172.21.15.98:0/309980997 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f38f80787c0 msgr2=0x7f38f807ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:38.921 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:38.918+0000 7f391c4e6640 1 --2- 172.21.15.98:0/309980997 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f38f80787c0 0x7f38f807ac80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3910033000 tx=0x7f3910004730 comp rx=0 tx=0).stop 2024-09-16T15:37:38.921 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:38.918+0000 7f391c4e6640 1 -- 172.21.15.98:0/309980997 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f391415e6a0 msgr2=0x7f39140c5640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:38.921 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:38.918+0000 7f391c4e6640 1 --2- 172.21.15.98:0/309980997 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f391415e6a0 0x7f39140c5640 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f390c00c7a0 tx=0x7f390c00cc60 comp rx=0 tx=0).stop 2024-09-16T15:37:38.921 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:38.918+0000 7f391c4e6640 1 -- 172.21.15.98:0/309980997 shutdown_connections 2024-09-16T15:37:38.921 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:38.918+0000 7f391c4e6640 1 --2- 172.21.15.98:0/309980997 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f391415e6a0 0x7f39140c5640 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:38.921 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:38.918+0000 7f391c4e6640 1 --2- 172.21.15.98:0/309980997 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f38f80787c0 0x7f38f807ac80 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:38.921 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:38.918+0000 7f391c4e6640 1 --2- 172.21.15.98:0/309980997 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39140ceff0 0x7f39141f58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:38.921 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:38.918+0000 7f391c4e6640 1 --2- 172.21.15.98:0/309980997 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f39140af4a0 0x7f39141f3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:38.921 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:38.918+0000 7f391c4e6640 1 -- 172.21.15.98:0/309980997 >> 172.21.15.98:0/309980997 conn(0x7f39140b1f00 msgr2=0x7f39140cadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:38.921 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:38.918+0000 7f391c4e6640 1 -- 172.21.15.98:0/309980997 shutdown_connections 2024-09-16T15:37:38.921 INFO:teuthology.misc.health.smithi098.stderr:2024-09-16T15:37:38.918+0000 7f391c4e6640 1 -- 172.21.15.98:0/309980997 wait complete. 2024-09-16T15:37:38.930 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-16T15:37:38.930 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-16T15:37:38.930 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-16T15:37:38.930 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-16T15:37:38.933 INFO:tasks.ceph.mds.a:Started 2024-09-16T15:37:38.933 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-16T15:37:38.933 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-16T15:37:38.935 INFO:tasks.ceph.mds.c:Started 2024-09-16T15:37:38.935 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-16T15:37:38.935 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-16T15:37:38.938 INFO:tasks.ceph.mds.b:Started 2024-09-16T15:37:38.938 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-16T15:37:38.938 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-16T15:37:38.941 INFO:tasks.ceph.mds.d:Started 2024-09-16T15:37:38.941 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-16T15:37:38.941 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T15:37:39.006 INFO:tasks.ceph.mds.a.smithi098.stdout:starting mds.a at 2024-09-16T15:37:39.007 INFO:tasks.ceph.mds.c.smithi098.stdout:starting mds.c at 2024-09-16T15:37:39.023 INFO:tasks.ceph.mds.b.smithi135.stdout:starting mds.b at 2024-09-16T15:37:39.023 INFO:tasks.ceph.mds.d.smithi135.stdout:starting mds.d at 2024-09-16T15:37:39.047 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:39.045+0000 7fbaa0093640 1 -- 172.21.15.98:0/1768855352 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fba9815ac00 msgr2=0x7fba980cf830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:39.047 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:39.045+0000 7fbaa0093640 1 --2- 172.21.15.98:0/1768855352 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fba9815ac00 0x7fba980cf830 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fba94005fd0 tx=0x7fba9402a5d0 comp rx=0 tx=0).stop 2024-09-16T15:37:39.047 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:39.045+0000 7fbaa0093640 1 -- 172.21.15.98:0/1768855352 shutdown_connections 2024-09-16T15:37:39.047 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:39.045+0000 7fbaa0093640 1 --2- 172.21.15.98:0/1768855352 >> v2:172.21.15.135:3300/0 conn(0x7fba98073ea0 0x7fba980cb390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:39.047 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:39.045+0000 7fbaa0093640 1 --2- 172.21.15.98:0/1768855352 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fba9815ac00 0x7fba980cf830 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:39.047 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:39.045+0000 7fbaa0093640 1 -- 172.21.15.98:0/1768855352 >> 172.21.15.98:0/1768855352 conn(0x7fba980d0d40 msgr2=0x7fba980d1120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:39.047 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:39.045+0000 7fbaa0093640 1 -- 172.21.15.98:0/1768855352 shutdown_connections 2024-09-16T15:37:39.047 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:39.045+0000 7fbaa0093640 1 -- 172.21.15.98:0/1768855352 wait complete. 2024-09-16T15:37:39.048 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:39.046+0000 7fbaa0093640 1 Processor -- start 2024-09-16T15:37:39.048 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:39.046+0000 7fbaa0093640 1 -- start start 2024-09-16T15:37:39.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:39.047+0000 7fbaa0093640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fba98073ea0 0x7fba981519d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:39.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:39.047+0000 7fbaa0093640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba980ce910 0x7fba9815de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:39.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:39.047+0000 7fbaa0093640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fba9815ac00 0x7fba980c5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:39.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:39.047+0000 7fbaa0093640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fba980cba50 con 0x7fba98073ea0 2024-09-16T15:37:39.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:39.047+0000 7fbaa0093640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fba980cb8d0 con 0x7fba980ce910 2024-09-16T15:37:39.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:39.047+0000 7fbaa0093640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fba980cbbd0 con 0x7fba9815ac00 2024-09-16T15:37:39.051 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:39.047+0000 7fba9de2f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fba98073ea0 0x7fba981519d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:39.051 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:39.047+0000 7fba9de2f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fba98073ea0 0x7fba981519d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:33240/0 (socket says 172.21.15.98:33240) 2024-09-16T15:37:39.051 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:39.047+0000 7fba9de2f640 1 -- 172.21.15.98:0/1402646700 learned_addr learned my addr 172.21.15.98:0/1402646700 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:37:39.051 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:39.047+0000 7fba9e630640 1 --2- 172.21.15.98:0/1402646700 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fba9815ac00 0x7fba980c5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:39.051 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:39.047+0000 7fba9d62e640 1 --2- 172.21.15.98:0/1402646700 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba980ce910 0x7fba9815de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:39.051 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:39.047+0000 7fba9de2f640 1 -- 172.21.15.98:0/1402646700 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fba9815ac00 msgr2=0x7fba980c5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:39.051 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:39.047+0000 7fba9de2f640 1 --2- 172.21.15.98:0/1402646700 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fba9815ac00 0x7fba980c5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:39.051 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:39.047+0000 7fba9de2f640 1 -- 172.21.15.98:0/1402646700 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba980ce910 msgr2=0x7fba9815de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:39.051 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:39.047+0000 7fba9de2f640 1 --2- 172.21.15.98:0/1402646700 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba980ce910 0x7fba9815de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:39.051 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:39.047+0000 7fba9de2f640 1 -- 172.21.15.98:0/1402646700 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba98151f10 con 0x7fba98073ea0 2024-09-16T15:37:39.051 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:39.048+0000 7fba9de2f640 1 --2- 172.21.15.98:0/1402646700 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fba98073ea0 0x7fba981519d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fba94006010 tx=0x7fba940035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:39.051 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:39.048+0000 7fba8e7fc640 1 -- 172.21.15.98:0/1402646700 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba9403e030 con 0x7fba98073ea0 2024-09-16T15:37:39.051 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:39.048+0000 7fba8e7fc640 1 -- 172.21.15.98:0/1402646700 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fba94003ae0 con 0x7fba98073ea0 2024-09-16T15:37:39.052 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:39.048+0000 7fbaa0093640 1 -- 172.21.15.98:0/1402646700 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba980c8f90 con 0x7fba98073ea0 2024-09-16T15:37:39.052 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:39.048+0000 7fba8e7fc640 1 -- 172.21.15.98:0/1402646700 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba94035040 con 0x7fba98073ea0 2024-09-16T15:37:39.053 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:39.049+0000 7fbaa0093640 1 -- 172.21.15.98:0/1402646700 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba980c9550 con 0x7fba98073ea0 2024-09-16T15:37:39.053 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:39.049+0000 7fba8e7fc640 1 -- 172.21.15.98:0/1402646700 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) ==== 101231+0+0 (secure 0 0 0) 0x7fba94041030 con 0x7fba98073ea0 2024-09-16T15:37:39.053 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:39.050+0000 7fbaa0093640 1 -- 172.21.15.98:0/1402646700 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba980cc0f0 con 0x7fba98073ea0 2024-09-16T15:37:39.053 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:39.050+0000 7fba8e7fc640 1 --2- 172.21.15.98:0/1402646700 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fba7c0787c0 0x7fba7c07ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:39.053 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:39.050+0000 7fba8e7fc640 1 -- 172.21.15.98:0/1402646700 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7fba940be170 con 0x7fba98073ea0 2024-09-16T15:37:39.053 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:39.050+0000 7fba9d62e640 1 --2- 172.21.15.98:0/1402646700 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fba7c0787c0 0x7fba7c07ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:39.053 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:39.051+0000 7fba9d62e640 1 --2- 172.21.15.98:0/1402646700 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fba7c0787c0 0x7fba7c07ac80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fba981f6e20 tx=0x7fba88009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:39.056 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:39.054+0000 7fba8e7fc640 1 -- 172.21.15.98:0/1402646700 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7fba940820b0 con 0x7fba98073ea0 2024-09-16T15:37:39.270 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:39.268+0000 7fbaa0093640 1 -- 172.21.15.98:0/1402646700 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fba980b6cc0 con 0x7fba98073ea0 2024-09-16T15:37:39.271 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:39.269+0000 7fba8e7fc640 1 -- 172.21.15.98:0/1402646700 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1434 (secure 0 0 0) 0x7fba94086ae0 con 0x7fba98073ea0 2024-09-16T15:37:39.271 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:37:39.271 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":2,"btime":"2024-09-16T15:37:39:010446+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4353,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6834/3679859923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":3679859923},{"type":"v1","addr":"172.21.15.98:6834","nonce":3679859923}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-16T15:37:39.271 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 2 2024-09-16T15:37:39.273 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:39.271+0000 7fbaa0093640 1 -- 172.21.15.98:0/1402646700 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fba7c0787c0 msgr2=0x7fba7c07ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:39.273 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:39.271+0000 7fbaa0093640 1 --2- 172.21.15.98:0/1402646700 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fba7c0787c0 0x7fba7c07ac80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fba981f6e20 tx=0x7fba88009040 comp rx=0 tx=0).stop 2024-09-16T15:37:39.273 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:39.271+0000 7fbaa0093640 1 -- 172.21.15.98:0/1402646700 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fba98073ea0 msgr2=0x7fba981519d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:39.274 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:39.271+0000 7fbaa0093640 1 --2- 172.21.15.98:0/1402646700 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fba98073ea0 0x7fba981519d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fba94006010 tx=0x7fba940035f0 comp rx=0 tx=0).stop 2024-09-16T15:37:39.274 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:39.271+0000 7fbaa0093640 1 -- 172.21.15.98:0/1402646700 shutdown_connections 2024-09-16T15:37:39.274 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:39.271+0000 7fbaa0093640 1 --2- 172.21.15.98:0/1402646700 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fba9815ac00 0x7fba980c5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:39.274 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:39.271+0000 7fbaa0093640 1 --2- 172.21.15.98:0/1402646700 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fba7c0787c0 0x7fba7c07ac80 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:39.274 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:39.271+0000 7fbaa0093640 1 --2- 172.21.15.98:0/1402646700 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba980ce910 0x7fba9815de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:39.274 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:39.271+0000 7fbaa0093640 1 --2- 172.21.15.98:0/1402646700 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fba98073ea0 0x7fba981519d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:39.274 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:39.271+0000 7fbaa0093640 1 -- 172.21.15.98:0/1402646700 >> 172.21.15.98:0/1402646700 conn(0x7fba980d0d40 msgr2=0x7fba980b5e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:39.274 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:39.271+0000 7fbaa0093640 1 -- 172.21.15.98:0/1402646700 shutdown_connections 2024-09-16T15:37:39.274 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:39.271+0000 7fbaa0093640 1 -- 172.21.15.98:0/1402646700 wait complete. 2024-09-16T15:37:41.284 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T15:37:41.398 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.396+0000 7f4381047640 1 -- 172.21.15.98:0/2743235675 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4364004d40 msgr2=0x7f43640051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:41.398 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.396+0000 7f4381047640 1 --2- 172.21.15.98:0/2743235675 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4364004d40 0x7f43640051c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4374009ed0 tx=0x7f4364005830 comp rx=0 tx=0).stop 2024-09-16T15:37:41.398 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.396+0000 7f437b59e640 1 -- 172.21.15.98:0/2743235675 reap_dead start 2024-09-16T15:37:41.398 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.396+0000 7f4381047640 1 -- 172.21.15.98:0/2743235675 shutdown_connections 2024-09-16T15:37:41.398 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.396+0000 7f4381047640 1 -- 172.21.15.98:0/2743235675 >> 172.21.15.98:0/2743235675 conn(0x7f437c0b1950 msgr2=0x7f437c0b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:41.399 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.396+0000 7f4381047640 1 -- 172.21.15.98:0/2743235675 shutdown_connections 2024-09-16T15:37:41.399 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.396+0000 7f4381047640 1 -- 172.21.15.98:0/2743235675 wait complete. 2024-09-16T15:37:41.399 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.398+0000 7f4381047640 1 Processor -- start 2024-09-16T15:37:41.399 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.398+0000 7f4381047640 1 -- start start 2024-09-16T15:37:41.402 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.398+0000 7f4381047640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4364004d40 0x7f437c0cb980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:41.402 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.398+0000 7f4381047640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f437c1e4a50 0x7f437c1491a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:41.402 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.398+0000 7f4381047640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f437c145190 0x7f437c145640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:41.402 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.398+0000 7f4381047640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f437c0746a0 con 0x7f437c1e4a50 2024-09-16T15:37:41.402 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.398+0000 7f4381047640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f437c15dd20 con 0x7f4364004d40 2024-09-16T15:37:41.402 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.398+0000 7f4381047640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f437c074820 con 0x7f437c145190 2024-09-16T15:37:41.402 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.398+0000 7f437a59c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f437c1e4a50 0x7f437c1491a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:41.402 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.398+0000 7f437a59c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f437c1e4a50 0x7f437c1491a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:33254/0 (socket says 172.21.15.98:33254) 2024-09-16T15:37:41.402 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.399+0000 7f437a59c640 1 -- 172.21.15.98:0/3241049403 learned_addr learned my addr 172.21.15.98:0/3241049403 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:37:41.402 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.399+0000 7f437b59e640 1 --2- 172.21.15.98:0/3241049403 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f437c145190 0x7f437c145640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:41.403 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.399+0000 7f437ad9d640 1 --2- 172.21.15.98:0/3241049403 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4364004d40 0x7f437c0cb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:41.403 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.399+0000 7f437a59c640 1 -- 172.21.15.98:0/3241049403 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f437c145190 msgr2=0x7f437c145640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:41.403 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.399+0000 7f437a59c640 1 --2- 172.21.15.98:0/3241049403 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f437c145190 0x7f437c145640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:41.403 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.399+0000 7f437a59c640 1 -- 172.21.15.98:0/3241049403 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4364004d40 msgr2=0x7f437c0cb980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:41.403 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.399+0000 7f437a59c640 1 --2- 172.21.15.98:0/3241049403 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4364004d40 0x7f437c0cb980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:41.403 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.399+0000 7f437a59c640 1 -- 172.21.15.98:0/3241049403 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f437c1e4f10 con 0x7f437c1e4a50 2024-09-16T15:37:41.403 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.399+0000 7f437b59e640 1 --2- 172.21.15.98:0/3241049403 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f437c145190 0x7f437c145640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T15:37:41.403 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.399+0000 7f437ad9d640 1 --2- 172.21.15.98:0/3241049403 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4364004d40 0x7f437c0cb980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T15:37:41.403 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.399+0000 7f437a59c640 1 --2- 172.21.15.98:0/3241049403 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f437c1e4a50 0x7f437c1491a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f43700066a0 tx=0x7f4370003a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:41.403 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.399+0000 7f43637fe640 1 -- 172.21.15.98:0/3241049403 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f437000f7e0 con 0x7f437c1e4a50 2024-09-16T15:37:41.403 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.399+0000 7f43637fe640 1 -- 172.21.15.98:0/3241049403 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4370016020 con 0x7f437c1e4a50 2024-09-16T15:37:41.403 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.399+0000 7f43637fe640 1 -- 172.21.15.98:0/3241049403 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f437000fc60 con 0x7f437c1e4a50 2024-09-16T15:37:41.403 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.399+0000 7f4381047640 1 -- 172.21.15.98:0/3241049403 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f437c1e51f0 con 0x7f437c1e4a50 2024-09-16T15:37:41.403 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.399+0000 7f4381047640 1 -- 172.21.15.98:0/3241049403 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f437c1e57b0 con 0x7f437c1e4a50 2024-09-16T15:37:41.404 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.400+0000 7f4381047640 1 -- 172.21.15.98:0/3241049403 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f437c0b3910 con 0x7f437c1e4a50 2024-09-16T15:37:41.404 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.401+0000 7f43637fe640 1 -- 172.21.15.98:0/3241049403 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7f4370011430 con 0x7f437c1e4a50 2024-09-16T15:37:41.404 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.401+0000 7f43637fe640 1 --2- 172.21.15.98:0/3241049403 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f4368078850 0x7f436807ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:41.404 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.401+0000 7f43637fe640 1 -- 172.21.15.98:0/3241049403 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f437009aea0 con 0x7f437c1e4a50 2024-09-16T15:37:41.404 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.402+0000 7f437ad9d640 1 --2- 172.21.15.98:0/3241049403 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f4368078850 0x7f436807ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:41.405 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.402+0000 7f437ad9d640 1 --2- 172.21.15.98:0/3241049403 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f4368078850 0x7f436807ad10 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f436c00abc0 tx=0x7f436c011040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:41.407 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.406+0000 7f43637fe640 1 -- 172.21.15.98:0/3241049403 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7f437c0b3910 con 0x7f437c1e4a50 2024-09-16T15:37:41.618 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.616+0000 7f4381047640 1 -- 172.21.15.98:0/3241049403 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f437c0aed40 con 0x7f437c1e4a50 2024-09-16T15:37:41.619 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.617+0000 7f43637fe640 1 -- 172.21.15.98:0/3241049403 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3909 (secure 0 0 0) 0x7f4370020030 con 0x7f437c1e4a50 2024-09-16T15:37:41.619 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:37:41.619 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":3,"btime":"2024-09-16T15:37:40:011452+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4348,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/808747266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":808747266},{"type":"v1","addr":"172.21.15.135:6836","nonce":808747266}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4351,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/1940037746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":1940037746},{"type":"v1","addr":"172.21.15.135:6837","nonce":1940037746}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4353,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6834/3679859923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":3679859923},{"type":"v1","addr":"172.21.15.98:6834","nonce":3679859923}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4356,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/1824614871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6833","nonce":1824614871},{"type":"v1","addr":"172.21.15.98:6835","nonce":1824614871}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-16T15:37:41.619 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 3 2024-09-16T15:37:41.621 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.619+0000 7f4381047640 1 -- 172.21.15.98:0/3241049403 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f4368078850 msgr2=0x7f436807ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:41.621 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.619+0000 7f4381047640 1 --2- 172.21.15.98:0/3241049403 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f4368078850 0x7f436807ad10 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f436c00abc0 tx=0x7f436c011040 comp rx=0 tx=0).stop 2024-09-16T15:37:41.621 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.619+0000 7f4381047640 1 -- 172.21.15.98:0/3241049403 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f437c1e4a50 msgr2=0x7f437c1491a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:41.621 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.619+0000 7f4381047640 1 --2- 172.21.15.98:0/3241049403 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f437c1e4a50 0x7f437c1491a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f43700066a0 tx=0x7f4370003a80 comp rx=0 tx=0).stop 2024-09-16T15:37:41.621 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.619+0000 7f4381047640 1 -- 172.21.15.98:0/3241049403 shutdown_connections 2024-09-16T15:37:41.622 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.619+0000 7f4381047640 1 --2- 172.21.15.98:0/3241049403 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f437c145190 0x7f437c145640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:41.622 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.619+0000 7f4381047640 1 --2- 172.21.15.98:0/3241049403 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f437c1e4a50 0x7f437c1491a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:41.622 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.619+0000 7f4381047640 1 --2- 172.21.15.98:0/3241049403 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f4368078850 0x7f436807ad10 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:41.622 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.619+0000 7f4381047640 1 --2- 172.21.15.98:0/3241049403 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4364004d40 0x7f437c0cb980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:41.622 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.619+0000 7f4381047640 1 -- 172.21.15.98:0/3241049403 >> 172.21.15.98:0/3241049403 conn(0x7f437c0b1950 msgr2=0x7f437c0afe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:41.622 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.619+0000 7f4381047640 1 -- 172.21.15.98:0/3241049403 shutdown_connections 2024-09-16T15:37:41.622 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.619+0000 7f4381047640 1 -- 172.21.15.98:0/3241049403 wait complete. 2024-09-16T15:37:41.632 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-16T15:37:41.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.730+0000 7f7d7bedd640 1 -- 172.21.15.98:0/249395901 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7d740cefa0 msgr2=0x7f7d740d1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:41.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.730+0000 7f7d7bedd640 1 --2- 172.21.15.98:0/249395901 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7d740cefa0 0x7f7d740d1c40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7d74069640 tx=0x7f7d6c02a980 comp rx=0 tx=0).stop 2024-09-16T15:37:41.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.730+0000 7f7d7bedd640 1 -- 172.21.15.98:0/249395901 shutdown_connections 2024-09-16T15:37:41.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.730+0000 7f7d7bedd640 1 --2- 172.21.15.98:0/249395901 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7d740cefa0 0x7f7d740d1c40 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:41.733 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.730+0000 7f7d7bedd640 1 --2- 172.21.15.98:0/249395901 >> v2:172.21.15.135:3300/0 conn(0x7f7d74071260 0x7f7d740cea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:41.733 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.730+0000 7f7d7bedd640 1 --2- 172.21.15.98:0/249395901 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d740b73c0 0x7f7d74071bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:41.733 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.730+0000 7f7d7bedd640 1 -- 172.21.15.98:0/249395901 >> 172.21.15.98:0/249395901 conn(0x7f7d7406d230 msgr2=0x7f7d740688b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:41.733 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.730+0000 7f7d7bedd640 1 -- 172.21.15.98:0/249395901 shutdown_connections 2024-09-16T15:37:41.733 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.730+0000 7f7d7bedd640 1 -- 172.21.15.98:0/249395901 wait complete. 2024-09-16T15:37:41.733 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.731+0000 7f7d7bedd640 1 Processor -- start 2024-09-16T15:37:41.733 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.731+0000 7f7d7bedd640 1 -- start start 2024-09-16T15:37:41.735 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.732+0000 7f7d7bedd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d74071260 0x7f7d7414fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:41.735 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.732+0000 7f7d7bedd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d740b73c0 0x7f7d7415e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:41.735 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.732+0000 7f7d7bedd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7d740cefa0 0x7f7d7415ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:41.736 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.732+0000 7f7d7bedd640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7d740b7920 con 0x7f7d740cefa0 2024-09-16T15:37:41.736 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.732+0000 7f7d7bedd640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7d740b77a0 con 0x7f7d740b73c0 2024-09-16T15:37:41.736 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.732+0000 7f7d7bedd640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f7d740d2180 con 0x7f7d74071260 2024-09-16T15:37:41.736 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.732+0000 7f7d7a47a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7d740cefa0 0x7f7d7415ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:41.736 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.732+0000 7f7d7a47a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7d740cefa0 0x7f7d7415ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:33268/0 (socket says 172.21.15.98:33268) 2024-09-16T15:37:41.736 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.732+0000 7f7d7a47a640 1 -- 172.21.15.98:0/1279027687 learned_addr learned my addr 172.21.15.98:0/1279027687 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:37:41.736 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.732+0000 7f7d79c79640 1 --2- 172.21.15.98:0/1279027687 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d74071260 0x7f7d7414fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:41.736 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.732+0000 7f7d79478640 1 --2- 172.21.15.98:0/1279027687 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d740b73c0 0x7f7d7415e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:41.736 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.732+0000 7f7d7a47a640 1 -- 172.21.15.98:0/1279027687 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d74071260 msgr2=0x7f7d7414fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:41.736 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.732+0000 7f7d7a47a640 1 --2- 172.21.15.98:0/1279027687 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d74071260 0x7f7d7414fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:41.736 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.732+0000 7f7d7a47a640 1 -- 172.21.15.98:0/1279027687 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d740b73c0 msgr2=0x7f7d7415e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:41.736 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.732+0000 7f7d7a47a640 1 --2- 172.21.15.98:0/1279027687 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d740b73c0 0x7f7d7415e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:41.736 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.732+0000 7f7d7a47a640 1 -- 172.21.15.98:0/1279027687 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d740c94e0 con 0x7f7d740cefa0 2024-09-16T15:37:41.736 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.732+0000 7f7d79c79640 1 --2- 172.21.15.98:0/1279027687 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d74071260 0x7f7d7414fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T15:37:41.737 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.732+0000 7f7d7a47a640 1 --2- 172.21.15.98:0/1279027687 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7d740cefa0 0x7f7d7415ebe0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c009d60 tx=0x7f7d6c003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:41.737 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.733+0000 7f7d6a7fc640 1 -- 172.21.15.98:0/1279027687 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d6c034040 con 0x7f7d740cefa0 2024-09-16T15:37:41.737 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.733+0000 7f7d6a7fc640 1 -- 172.21.15.98:0/1279027687 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7d6c004540 con 0x7f7d740cefa0 2024-09-16T15:37:41.737 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.733+0000 7f7d6a7fc640 1 -- 172.21.15.98:0/1279027687 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d6c045480 con 0x7f7d740cefa0 2024-09-16T15:37:41.737 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.733+0000 7f7d7bedd640 1 -- 172.21.15.98:0/1279027687 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d740c97c0 con 0x7f7d740cefa0 2024-09-16T15:37:41.737 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.733+0000 7f7d7bedd640 1 -- 172.21.15.98:0/1279027687 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d740c9d80 con 0x7f7d740cefa0 2024-09-16T15:37:41.737 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.734+0000 7f7d7bedd640 1 -- 172.21.15.98:0/1279027687 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d741607a0 con 0x7f7d740cefa0 2024-09-16T15:37:41.738 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.734+0000 7f7d6a7fc640 1 -- 172.21.15.98:0/1279027687 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7f7d6c037020 con 0x7f7d740cefa0 2024-09-16T15:37:41.738 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.735+0000 7f7d6a7fc640 1 --2- 172.21.15.98:0/1279027687 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f7d58078880 0x7f7d5807ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:41.738 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.735+0000 7f7d6a7fc640 1 -- 172.21.15.98:0/1279027687 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f7d6c0bbd20 con 0x7f7d740cefa0 2024-09-16T15:37:41.738 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.735+0000 7f7d79c79640 1 --2- 172.21.15.98:0/1279027687 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f7d58078880 0x7f7d5807ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:41.738 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.735+0000 7f7d79c79640 1 --2- 172.21.15.98:0/1279027687 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f7d58078880 0x7f7d5807ad40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7d700058c0 tx=0x7f7d70005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:41.741 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.739+0000 7f7d6a7fc640 1 -- 172.21.15.98:0/1279027687 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7f7d6c0846f0 con 0x7f7d740cefa0 2024-09-16T15:37:41.918 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.916+0000 7f7d7bedd640 1 -- 172.21.15.98:0/1279027687 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f7d7415aa50 con 0x7f7d740cefa0 2024-09-16T15:37:41.919 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.917+0000 7f7d6a7fc640 1 -- 172.21.15.98:0/1279027687 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) ==== 84+0+65 (secure 0 0 0) 0x7f7d6c083ff0 con 0x7f7d740cefa0 2024-09-16T15:37:41.919 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:37:41.919 INFO:teuthology.orchestra.run.smithi098.stdout:[ 2024-09-16T15:37:41.919 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:37:41.919 INFO:teuthology.orchestra.run.smithi098.stdout: "poolnum": 1, 2024-09-16T15:37:41.919 INFO:teuthology.orchestra.run.smithi098.stdout: "poolname": ".mgr" 2024-09-16T15:37:41.919 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:37:41.919 INFO:teuthology.orchestra.run.smithi098.stdout:] 2024-09-16T15:37:41.921 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.919+0000 7f7d7bedd640 1 -- 172.21.15.98:0/1279027687 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f7d58078880 msgr2=0x7f7d5807ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:41.921 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.919+0000 7f7d7bedd640 1 --2- 172.21.15.98:0/1279027687 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f7d58078880 0x7f7d5807ad40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7d700058c0 tx=0x7f7d70005850 comp rx=0 tx=0).stop 2024-09-16T15:37:41.921 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.919+0000 7f7d7bedd640 1 -- 172.21.15.98:0/1279027687 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7d740cefa0 msgr2=0x7f7d7415ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:41.922 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.919+0000 7f7d7bedd640 1 --2- 172.21.15.98:0/1279027687 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7d740cefa0 0x7f7d7415ebe0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c009d60 tx=0x7f7d6c003f90 comp rx=0 tx=0).stop 2024-09-16T15:37:41.922 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.919+0000 7f7d7bedd640 1 -- 172.21.15.98:0/1279027687 shutdown_connections 2024-09-16T15:37:41.922 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.919+0000 7f7d7bedd640 1 --2- 172.21.15.98:0/1279027687 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7d740cefa0 0x7f7d7415ebe0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:41.922 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.919+0000 7f7d7bedd640 1 --2- 172.21.15.98:0/1279027687 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f7d58078880 0x7f7d5807ad40 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:41.922 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.919+0000 7f7d7bedd640 1 --2- 172.21.15.98:0/1279027687 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d740b73c0 0x7f7d7415e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:41.922 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.919+0000 7f7d7bedd640 1 --2- 172.21.15.98:0/1279027687 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7d74071260 0x7f7d7414fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:41.922 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.919+0000 7f7d7bedd640 1 -- 172.21.15.98:0/1279027687 >> 172.21.15.98:0/1279027687 conn(0x7f7d7406d230 msgr2=0x7f7d7415b530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:41.922 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.919+0000 7f7d7bedd640 1 -- 172.21.15.98:0/1279027687 shutdown_connections 2024-09-16T15:37:41.922 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:41.919+0000 7f7d7bedd640 1 -- 172.21.15.98:0/1279027687 wait complete. 2024-09-16T15:37:41.931 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-16T15:37:41.931 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-16T15:37:42.036 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.034+0000 7f33d0872640 1 -- 172.21.15.98:0/2871609902 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33cc15e090 msgr2=0x7f33cc0d23e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:42.036 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.034+0000 7f33d0872640 1 --2- 172.21.15.98:0/2871609902 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33cc15e090 0x7f33cc0d23e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f33cc1619f0 tx=0x7f33bc02aa30 comp rx=0 tx=0).stop 2024-09-16T15:37:42.036 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.034+0000 7f33d0872640 1 -- 172.21.15.98:0/2871609902 shutdown_connections 2024-09-16T15:37:42.036 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.034+0000 7f33d0872640 1 --2- 172.21.15.98:0/2871609902 >> v2:172.21.15.135:3300/0 conn(0x7f33cc0d0940 0x7f33cc0d0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:42.037 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.034+0000 7f33d0872640 1 --2- 172.21.15.98:0/2871609902 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f33cc0d4ac0 0x7f33cc0b38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:42.037 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.034+0000 7f33d0872640 1 --2- 172.21.15.98:0/2871609902 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33cc15e090 0x7f33cc0d23e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:42.037 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.034+0000 7f33d0872640 1 -- 172.21.15.98:0/2871609902 >> 172.21.15.98:0/2871609902 conn(0x7f33cc0d3fa0 msgr2=0x7f33cc0d43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:42.037 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.034+0000 7f33d0872640 1 -- 172.21.15.98:0/2871609902 shutdown_connections 2024-09-16T15:37:42.037 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.034+0000 7f33d0872640 1 -- 172.21.15.98:0/2871609902 wait complete. 2024-09-16T15:37:42.037 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.035+0000 7f33d0872640 1 Processor -- start 2024-09-16T15:37:42.037 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.035+0000 7f33d0872640 1 -- start start 2024-09-16T15:37:42.039 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.036+0000 7f33d0872640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f33cc0d0940 0x7f33cc0b9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:42.039 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.036+0000 7f33d0872640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33cc0d4ac0 0x7f33cc1f4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:42.040 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.036+0000 7f33d0872640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33cc15e090 0x7f33cc160e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:42.040 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.036+0000 7f33d0872640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f33cc0cf700 con 0x7f33cc0d4ac0 2024-09-16T15:37:42.040 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.036+0000 7f33d0872640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f33cc0ceca0 con 0x7f33cc15e090 2024-09-16T15:37:42.040 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.036+0000 7f33d0872640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f33cc0cf880 con 0x7f33cc0d0940 2024-09-16T15:37:42.040 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.036+0000 7f33c9d9b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33cc0d4ac0 0x7f33cc1f4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:42.040 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.036+0000 7f33c9d9b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33cc0d4ac0 0x7f33cc1f4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:33292/0 (socket says 172.21.15.98:33292) 2024-09-16T15:37:42.040 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.036+0000 7f33c9d9b640 1 -- 172.21.15.98:0/1188697441 learned_addr learned my addr 172.21.15.98:0/1188697441 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:37:42.040 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.036+0000 7f33cad9d640 1 --2- 172.21.15.98:0/1188697441 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33cc15e090 0x7f33cc160e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:42.040 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.036+0000 7f33ca59c640 1 --2- 172.21.15.98:0/1188697441 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f33cc0d0940 0x7f33cc0b9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:42.040 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.036+0000 7f33c9d9b640 1 -- 172.21.15.98:0/1188697441 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f33cc0d0940 msgr2=0x7f33cc0b9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:42.040 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.036+0000 7f33c9d9b640 1 --2- 172.21.15.98:0/1188697441 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f33cc0d0940 0x7f33cc0b9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:42.040 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.036+0000 7f33c9d9b640 1 -- 172.21.15.98:0/1188697441 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33cc15e090 msgr2=0x7f33cc160e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:42.040 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.036+0000 7f33c9d9b640 1 --2- 172.21.15.98:0/1188697441 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33cc15e090 0x7f33cc160e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:42.040 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.036+0000 7f33c9d9b640 1 -- 172.21.15.98:0/1188697441 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33cc1f4ea0 con 0x7f33cc0d4ac0 2024-09-16T15:37:42.041 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.037+0000 7f33cad9d640 1 --2- 172.21.15.98:0/1188697441 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33cc15e090 0x7f33cc160e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T15:37:42.041 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.037+0000 7f33c9d9b640 1 --2- 172.21.15.98:0/1188697441 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33cc0d4ac0 0x7f33cc1f4760 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f33c000e9c0 tx=0x7f33c000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:42.041 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.037+0000 7f33baffd640 1 -- 172.21.15.98:0/1188697441 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33c000cd80 con 0x7f33cc0d4ac0 2024-09-16T15:37:42.041 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.037+0000 7f33baffd640 1 -- 172.21.15.98:0/1188697441 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f33c0004030 con 0x7f33cc0d4ac0 2024-09-16T15:37:42.041 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.037+0000 7f33baffd640 1 -- 172.21.15.98:0/1188697441 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33c0004480 con 0x7f33cc0d4ac0 2024-09-16T15:37:42.041 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.037+0000 7f33d0872640 1 -- 172.21.15.98:0/1188697441 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33cc1f5180 con 0x7f33cc0d4ac0 2024-09-16T15:37:42.041 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.037+0000 7f33d0872640 1 -- 172.21.15.98:0/1188697441 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33cc0b7f70 con 0x7f33cc0d4ac0 2024-09-16T15:37:42.041 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.038+0000 7f33d0872640 1 -- 172.21.15.98:0/1188697441 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33cc0d0dd0 con 0x7f33cc0d4ac0 2024-09-16T15:37:42.042 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.038+0000 7f33baffd640 1 -- 172.21.15.98:0/1188697441 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7f33c00035f0 con 0x7f33cc0d4ac0 2024-09-16T15:37:42.042 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.039+0000 7f33baffd640 1 --2- 172.21.15.98:0/1188697441 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f33ac078850 0x7f33ac07ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:42.042 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.039+0000 7f33baffd640 1 -- 172.21.15.98:0/1188697441 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f33c009afc0 con 0x7f33cc0d4ac0 2024-09-16T15:37:42.042 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.039+0000 7f33ca59c640 1 --2- 172.21.15.98:0/1188697441 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f33ac078850 0x7f33ac07ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:42.042 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.039+0000 7f33ca59c640 1 --2- 172.21.15.98:0/1188697441 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f33ac078850 0x7f33ac07ad10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f33bc035000 tx=0x7f33bc004ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:42.045 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.043+0000 7f33baffd640 1 -- 172.21.15.98:0/1188697441 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7f33cc0d0dd0 con 0x7f33cc0d4ac0 2024-09-16T15:37:42.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.219+0000 7f33d0872640 1 -- 172.21.15.98:0/1188697441 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f33cc0b38d0 con 0x7f33cc0d4ac0 2024-09-16T15:37:42.489 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.487+0000 7f33baffd640 1 -- 172.21.15.98:0/1188697441 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v20) ==== 138+0+0 (secure 0 0 0) 0x7f33c0063a10 con 0x7f33cc0d4ac0 2024-09-16T15:37:42.490 INFO:teuthology.orchestra.run.smithi098.stderr:pool 'cephfs_metadata' created 2024-09-16T15:37:42.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.490+0000 7f33d0872640 1 -- 172.21.15.98:0/1188697441 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f33ac078850 msgr2=0x7f33ac07ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:42.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.490+0000 7f33d0872640 1 --2- 172.21.15.98:0/1188697441 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f33ac078850 0x7f33ac07ad10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f33bc035000 tx=0x7f33bc004ab0 comp rx=0 tx=0).stop 2024-09-16T15:37:42.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.490+0000 7f33d0872640 1 -- 172.21.15.98:0/1188697441 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33cc0d4ac0 msgr2=0x7f33cc1f4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:42.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.490+0000 7f33d0872640 1 --2- 172.21.15.98:0/1188697441 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33cc0d4ac0 0x7f33cc1f4760 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f33c000e9c0 tx=0x7f33c000ee80 comp rx=0 tx=0).stop 2024-09-16T15:37:42.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.490+0000 7f33d0872640 1 -- 172.21.15.98:0/1188697441 shutdown_connections 2024-09-16T15:37:42.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.490+0000 7f33d0872640 1 --2- 172.21.15.98:0/1188697441 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f33ac078850 0x7f33ac07ad10 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:42.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.490+0000 7f33d0872640 1 --2- 172.21.15.98:0/1188697441 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33cc15e090 0x7f33cc160e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:42.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.490+0000 7f33d0872640 1 --2- 172.21.15.98:0/1188697441 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33cc0d4ac0 0x7f33cc1f4760 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:42.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.490+0000 7f33d0872640 1 --2- 172.21.15.98:0/1188697441 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f33cc0d0940 0x7f33cc0b9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:42.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.490+0000 7f33d0872640 1 -- 172.21.15.98:0/1188697441 >> 172.21.15.98:0/1188697441 conn(0x7f33cc0d3fa0 msgr2=0x7f33cc0d4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:42.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.490+0000 7f33d0872640 1 -- 172.21.15.98:0/1188697441 shutdown_connections 2024-09-16T15:37:42.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.490+0000 7f33d0872640 1 -- 172.21.15.98:0/1188697441 wait complete. 2024-09-16T15:37:42.507 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-16T15:37:42.559 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T15:37:42.562 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T15:37:42.619 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.616+0000 7ff73cb75640 1 -- 172.21.15.98:0/2552503749 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff720004800 msgr2=0x7ff720004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:42.619 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.616+0000 7ff73cb75640 1 --2- 172.21.15.98:0/2552503749 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff720004800 0x7ff720004c80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff72c006f70 tx=0x7ff720005830 comp rx=0 tx=0).stop 2024-09-16T15:37:42.619 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.617+0000 7ff73cb75640 1 -- 172.21.15.98:0/2552503749 shutdown_connections 2024-09-16T15:37:42.619 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.617+0000 7ff73cb75640 1 --2- 172.21.15.98:0/2552503749 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff720004800 0x7ff720004c80 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:42.619 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.617+0000 7ff73cb75640 1 -- 172.21.15.98:0/2552503749 >> 172.21.15.98:0/2552503749 conn(0x7ff7380d3fb0 msgr2=0x7ff7380d43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:42.619 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.617+0000 7ff73cb75640 1 -- 172.21.15.98:0/2552503749 shutdown_connections 2024-09-16T15:37:42.619 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.617+0000 7ff73cb75640 1 -- 172.21.15.98:0/2552503749 wait complete. 2024-09-16T15:37:42.620 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.618+0000 7ff73cb75640 1 Processor -- start 2024-09-16T15:37:42.620 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.618+0000 7ff73cb75640 1 -- start start 2024-09-16T15:37:42.622 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.619+0000 7ff73cb75640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff720004800 0x7ff7380cd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:42.622 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.619+0000 7ff73cb75640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff73815eeb0 0x7ff7381f8670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:42.622 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.619+0000 7ff73cb75640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff7381f8bb0 0x7ff7381f9030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:42.622 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.619+0000 7ff73cb75640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff7380b72a0 con 0x7ff73815eeb0 2024-09-16T15:37:42.622 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.619+0000 7ff73cb75640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff7380b7120 con 0x7ff720004800 2024-09-16T15:37:42.622 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.619+0000 7ff73cb75640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff7380b7420 con 0x7ff7381f8bb0 2024-09-16T15:37:42.622 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.619+0000 7ff735d9b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff73815eeb0 0x7ff7381f8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:42.622 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.619+0000 7ff73659c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff720004800 0x7ff7380cd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:42.622 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.619+0000 7ff735d9b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff73815eeb0 0x7ff7381f8670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:33302/0 (socket says 172.21.15.98:33302) 2024-09-16T15:37:42.622 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.619+0000 7ff735d9b640 1 -- 172.21.15.98:0/2963943350 learned_addr learned my addr 172.21.15.98:0/2963943350 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:37:42.623 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.619+0000 7ff736d9d640 1 --2- 172.21.15.98:0/2963943350 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff7381f8bb0 0x7ff7381f9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:42.623 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.619+0000 7ff735d9b640 1 -- 172.21.15.98:0/2963943350 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff7381f8bb0 msgr2=0x7ff7381f9030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:42.623 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.619+0000 7ff735d9b640 1 --2- 172.21.15.98:0/2963943350 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff7381f8bb0 0x7ff7381f9030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:42.623 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.619+0000 7ff735d9b640 1 -- 172.21.15.98:0/2963943350 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff720004800 msgr2=0x7ff7380cd7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:42.623 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.619+0000 7ff735d9b640 1 --2- 172.21.15.98:0/2963943350 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff720004800 0x7ff7380cd7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:42.623 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.619+0000 7ff735d9b640 1 -- 172.21.15.98:0/2963943350 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff738154f40 con 0x7ff73815eeb0 2024-09-16T15:37:42.623 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.619+0000 7ff73659c640 1 --2- 172.21.15.98:0/2963943350 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff720004800 0x7ff7380cd7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T15:37:42.623 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.619+0000 7ff735d9b640 1 --2- 172.21.15.98:0/2963943350 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff73815eeb0 0x7ff7381f8670 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff72c00c350 tx=0x7ff72c0064a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:42.623 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.619+0000 7ff726ffd640 1 -- 172.21.15.98:0/2963943350 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff72c032030 con 0x7ff73815eeb0 2024-09-16T15:37:42.623 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.619+0000 7ff726ffd640 1 -- 172.21.15.98:0/2963943350 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff72c0036e0 con 0x7ff73815eeb0 2024-09-16T15:37:42.623 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.619+0000 7ff73cb75640 1 -- 172.21.15.98:0/2963943350 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff738155220 con 0x7ff73815eeb0 2024-09-16T15:37:42.623 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.619+0000 7ff726ffd640 1 -- 172.21.15.98:0/2963943350 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff72c003b30 con 0x7ff73815eeb0 2024-09-16T15:37:42.623 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.619+0000 7ff73cb75640 1 -- 172.21.15.98:0/2963943350 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7381557e0 con 0x7ff73815eeb0 2024-09-16T15:37:42.624 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.620+0000 7ff73cb75640 1 -- 172.21.15.98:0/2963943350 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7380d4ac0 con 0x7ff73815eeb0 2024-09-16T15:37:42.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.621+0000 7ff726ffd640 1 -- 172.21.15.98:0/2963943350 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7ff72c035020 con 0x7ff73815eeb0 2024-09-16T15:37:42.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.621+0000 7ff726ffd640 1 --2- 172.21.15.98:0/2963943350 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7ff718078850 0x7ff71807ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:42.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.622+0000 7ff726ffd640 1 -- 172.21.15.98:0/2963943350 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5227+0+0 (secure 0 0 0) 0x7ff72c0b9a30 con 0x7ff73815eeb0 2024-09-16T15:37:42.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.622+0000 7ff73659c640 1 --2- 172.21.15.98:0/2963943350 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7ff718078850 0x7ff71807ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:42.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.622+0000 7ff73659c640 1 --2- 172.21.15.98:0/2963943350 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7ff718078850 0x7ff71807ad10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff728006650 tx=0x7ff728006b10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:42.628 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.626+0000 7ff726ffd640 1 -- 172.21.15.98:0/2963943350 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7ff72c081c30 con 0x7ff73815eeb0 2024-09-16T15:37:42.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:42.803+0000 7ff73cb75640 1 -- 172.21.15.98:0/2963943350 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7ff73806e7c0 con 0x7ff73815eeb0 2024-09-16T15:37:43.497 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:43.495+0000 7ff726ffd640 1 -- 172.21.15.98:0/2963943350 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v21) ==== 170+0+0 (secure 0 0 0) 0x7ff72c086660 con 0x7ff73815eeb0 2024-09-16T15:37:43.497 INFO:teuthology.orchestra.run.smithi098.stderr:pool 'cephfs_data' created 2024-09-16T15:37:43.499 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:43.497+0000 7ff73cb75640 1 -- 172.21.15.98:0/2963943350 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7ff718078850 msgr2=0x7ff71807ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:43.500 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:43.497+0000 7ff73cb75640 1 --2- 172.21.15.98:0/2963943350 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7ff718078850 0x7ff71807ad10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff728006650 tx=0x7ff728006b10 comp rx=0 tx=0).stop 2024-09-16T15:37:43.500 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:43.497+0000 7ff73cb75640 1 -- 172.21.15.98:0/2963943350 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff73815eeb0 msgr2=0x7ff7381f8670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:43.500 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:43.497+0000 7ff73cb75640 1 --2- 172.21.15.98:0/2963943350 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff73815eeb0 0x7ff7381f8670 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff72c00c350 tx=0x7ff72c0064a0 comp rx=0 tx=0).stop 2024-09-16T15:37:43.500 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:43.497+0000 7ff73cb75640 1 -- 172.21.15.98:0/2963943350 shutdown_connections 2024-09-16T15:37:43.500 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:43.497+0000 7ff73cb75640 1 --2- 172.21.15.98:0/2963943350 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff7381f8bb0 0x7ff7381f9030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:43.500 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:43.497+0000 7ff73cb75640 1 --2- 172.21.15.98:0/2963943350 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff73815eeb0 0x7ff7381f8670 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:43.500 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:43.497+0000 7ff73cb75640 1 --2- 172.21.15.98:0/2963943350 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7ff718078850 0x7ff71807ad10 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:43.500 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:43.497+0000 7ff73cb75640 1 --2- 172.21.15.98:0/2963943350 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff720004800 0x7ff7380cd7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:43.500 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:43.497+0000 7ff73cb75640 1 -- 172.21.15.98:0/2963943350 >> 172.21.15.98:0/2963943350 conn(0x7ff7380d3fb0 msgr2=0x7ff73815f920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:43.501 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:43.498+0000 7ff73cb75640 1 -- 172.21.15.98:0/2963943350 shutdown_connections 2024-09-16T15:37:43.501 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:43.498+0000 7ff73cb75640 1 -- 172.21.15.98:0/2963943350 wait complete. 2024-09-16T15:37:43.524 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-16T15:37:43.671 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:43.669+0000 7f41c7460640 1 -- 172.21.15.98:0/929475152 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f41c0073800 msgr2=0x7f41c0073c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:43.671 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:43.669+0000 7f41c7460640 1 --2- 172.21.15.98:0/929475152 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f41c0073800 0x7f41c0073c70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f41c00cd460 tx=0x7f41b802aa30 comp rx=0 tx=0).stop 2024-09-16T15:37:43.671 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:43.669+0000 7f41c7460640 1 -- 172.21.15.98:0/929475152 shutdown_connections 2024-09-16T15:37:43.671 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:43.669+0000 7f41c7460640 1 --2- 172.21.15.98:0/929475152 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f41c0073800 0x7f41c0073c70 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:43.671 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:43.669+0000 7f41c7460640 1 --2- 172.21.15.98:0/929475152 >> v2:172.21.15.135:3300/0 conn(0x7f41c00cd490 0x7f41c00732c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:43.671 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:43.669+0000 7f41c7460640 1 --2- 172.21.15.98:0/929475152 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41c01517a0 0x7f41c00cdad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:43.671 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:43.669+0000 7f41c7460640 1 -- 172.21.15.98:0/929475152 >> 172.21.15.98:0/929475152 conn(0x7f41c00b1840 msgr2=0x7f41c00b1c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:43.671 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:43.669+0000 7f41c7460640 1 -- 172.21.15.98:0/929475152 shutdown_connections 2024-09-16T15:37:43.671 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:43.669+0000 7f41c7460640 1 -- 172.21.15.98:0/929475152 wait complete. 2024-09-16T15:37:43.672 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:43.670+0000 7f41c7460640 1 Processor -- start 2024-09-16T15:37:43.672 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:43.670+0000 7f41c7460640 1 -- start start 2024-09-16T15:37:43.674 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:43.671+0000 7f41c7460640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f41c0073800 0x7f41c01e4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:43.674 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:43.671+0000 7f41c7460640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41c00cd490 0x7f41c01f87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:43.674 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:43.671+0000 7f41c7460640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41c01517a0 0x7f41c01f8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:43.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:43.671+0000 7f41c7460640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f41c00ccb70 con 0x7f41c0073800 2024-09-16T15:37:43.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:43.671+0000 7f41c7460640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f41c00cc9f0 con 0x7f41c00cd490 2024-09-16T15:37:43.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:43.671+0000 7f41c7460640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f41c00cccf0 con 0x7f41c01517a0 2024-09-16T15:37:43.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:43.671+0000 7f41c51fc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f41c0073800 0x7f41c01e4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:43.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:43.671+0000 7f41c51fc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f41c0073800 0x7f41c01e4fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:33322/0 (socket says 172.21.15.98:33322) 2024-09-16T15:37:43.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:43.671+0000 7f41c51fc640 1 -- 172.21.15.98:0/307485860 learned_addr learned my addr 172.21.15.98:0/307485860 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:37:43.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:43.671+0000 7f41c59fd640 1 --2- 172.21.15.98:0/307485860 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41c01517a0 0x7f41c01f8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:43.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:43.671+0000 7f41c51fc640 1 -- 172.21.15.98:0/307485860 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41c01517a0 msgr2=0x7f41c01f8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:43.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:43.671+0000 7f41c51fc640 1 --2- 172.21.15.98:0/307485860 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41c01517a0 0x7f41c01f8d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:43.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:43.671+0000 7f41c49fb640 1 --2- 172.21.15.98:0/307485860 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41c00cd490 0x7f41c01f87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:43.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:43.671+0000 7f41c51fc640 1 -- 172.21.15.98:0/307485860 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41c00cd490 msgr2=0x7f41c01f87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:43.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:43.671+0000 7f41c51fc640 1 --2- 172.21.15.98:0/307485860 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41c00cd490 0x7f41c01f87c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:43.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:43.671+0000 7f41c51fc640 1 -- 172.21.15.98:0/307485860 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41c00ad910 con 0x7f41c0073800 2024-09-16T15:37:43.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:43.671+0000 7f41c59fd640 1 --2- 172.21.15.98:0/307485860 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41c01517a0 0x7f41c01f8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T15:37:43.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:43.671+0000 7f41c51fc640 1 --2- 172.21.15.98:0/307485860 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f41c0073800 0x7f41c01e4fc0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f41bc00d7a0 tx=0x7f41bc00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:43.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:43.671+0000 7f41b5ffb640 1 -- 172.21.15.98:0/307485860 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41bc017070 con 0x7f41c0073800 2024-09-16T15:37:43.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:43.671+0000 7f41b5ffb640 1 -- 172.21.15.98:0/307485860 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f41bc009d20 con 0x7f41c0073800 2024-09-16T15:37:43.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:43.671+0000 7f41b5ffb640 1 -- 172.21.15.98:0/307485860 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41bc004280 con 0x7f41c0073800 2024-09-16T15:37:43.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:43.671+0000 7f41c7460640 1 -- 172.21.15.98:0/307485860 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41c00adbb0 con 0x7f41c0073800 2024-09-16T15:37:43.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:43.672+0000 7f41c7460640 1 -- 172.21.15.98:0/307485860 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41c01e5500 con 0x7f41c0073800 2024-09-16T15:37:43.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:43.672+0000 7f41c7460640 1 -- 172.21.15.98:0/307485860 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41c00adfa0 con 0x7f41c0073800 2024-09-16T15:37:43.677 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:43.673+0000 7f41b5ffb640 1 -- 172.21.15.98:0/307485860 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7f41bc005020 con 0x7f41c0073800 2024-09-16T15:37:43.677 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:43.673+0000 7f41b5ffb640 1 --2- 172.21.15.98:0/307485860 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f41a4078850 0x7f41a407ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:43.677 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:43.674+0000 7f41b5ffb640 1 -- 172.21.15.98:0/307485860 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5609+0+0 (secure 0 0 0) 0x7f41bc09ac30 con 0x7f41c0073800 2024-09-16T15:37:43.677 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:43.674+0000 7f41c49fb640 1 --2- 172.21.15.98:0/307485860 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f41a4078850 0x7f41a407ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:43.677 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:43.674+0000 7f41c49fb640 1 --2- 172.21.15.98:0/307485860 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f41a4078850 0x7f41a407ad10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f41b0005d80 tx=0x7f41b0005c90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:43.680 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:43.678+0000 7f41b5ffb640 1 -- 172.21.15.98:0/307485860 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7f41bc020020 con 0x7f41c0073800 2024-09-16T15:37:43.891 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:43.889+0000 7f41c7460640 1 -- 172.21.15.98:0/307485860 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f41c00add80 con 0x7f41c0073800 2024-09-16T15:37:44.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.496+0000 7f41b5ffb640 1 -- 172.21.15.98:0/307485860 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f41bc063390 con 0x7f41c0073800 2024-09-16T15:37:44.499 INFO:teuthology.orchestra.run.smithi098.stderr:new fs with metadata pool 2 and data pool 3 2024-09-16T15:37:44.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.502+0000 7f41c7460640 1 -- 172.21.15.98:0/307485860 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f41a4078850 msgr2=0x7f41a407ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:44.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.502+0000 7f41c7460640 1 --2- 172.21.15.98:0/307485860 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f41a4078850 0x7f41a407ad10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f41b0005d80 tx=0x7f41b0005c90 comp rx=0 tx=0).stop 2024-09-16T15:37:44.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.502+0000 7f41c7460640 1 -- 172.21.15.98:0/307485860 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f41c0073800 msgr2=0x7f41c01e4fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:44.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.502+0000 7f41c7460640 1 --2- 172.21.15.98:0/307485860 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f41c0073800 0x7f41c01e4fc0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f41bc00d7a0 tx=0x7f41bc00dc60 comp rx=0 tx=0).stop 2024-09-16T15:37:44.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.504+0000 7f41c7460640 1 -- 172.21.15.98:0/307485860 shutdown_connections 2024-09-16T15:37:44.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.504+0000 7f41c7460640 1 --2- 172.21.15.98:0/307485860 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41c01517a0 0x7f41c01f8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:44.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.504+0000 7f41c7460640 1 --2- 172.21.15.98:0/307485860 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f41a4078850 0x7f41a407ad10 secure :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f41b0005d80 tx=0x7f41b0005c90 comp rx=0 tx=0).stop 2024-09-16T15:37:44.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.504+0000 7f41c7460640 1 --2- 172.21.15.98:0/307485860 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41c00cd490 0x7f41c01f87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:44.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.504+0000 7f41c7460640 1 --2- 172.21.15.98:0/307485860 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f41c0073800 0x7f41c01e4fc0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:44.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.504+0000 7f41c7460640 1 -- 172.21.15.98:0/307485860 >> 172.21.15.98:0/307485860 conn(0x7f41c00b1840 msgr2=0x7f41c00b45b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:44.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.506+0000 7f41c7460640 1 -- 172.21.15.98:0/307485860 shutdown_connections 2024-09-16T15:37:44.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.512+0000 7f41c7460640 1 -- 172.21.15.98:0/307485860 wait complete. 2024-09-16T15:37:44.536 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T15:37:44.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.636+0000 7f9403f2b640 1 -- 172.21.15.98:0/3607330958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93fc154ea0 msgr2=0x7f93fc0cfc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:44.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.636+0000 7f9403f2b640 1 --2- 172.21.15.98:0/3607330958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93fc154ea0 0x7f93fc0cfc20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f93f8009830 tx=0x7f93f802a500 comp rx=0 tx=0).stop 2024-09-16T15:37:44.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.636+0000 7f9403f2b640 1 -- 172.21.15.98:0/3607330958 shutdown_connections 2024-09-16T15:37:44.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.636+0000 7f9403f2b640 1 --2- 172.21.15.98:0/3607330958 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93fc0cddc0 0x7f93fc161bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:44.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.636+0000 7f9403f2b640 1 --2- 172.21.15.98:0/3607330958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93fc154ea0 0x7f93fc0cfc20 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:44.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.636+0000 7f9403f2b640 1 -- 172.21.15.98:0/3607330958 >> 172.21.15.98:0/3607330958 conn(0x7f93fc06d230 msgr2=0x7f93fc0688b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:44.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.636+0000 7f9403f2b640 1 -- 172.21.15.98:0/3607330958 shutdown_connections 2024-09-16T15:37:44.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.636+0000 7f9403f2b640 1 -- 172.21.15.98:0/3607330958 wait complete. 2024-09-16T15:37:44.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.637+0000 7f9403f2b640 1 Processor -- start 2024-09-16T15:37:44.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.637+0000 7f9403f2b640 1 -- start start 2024-09-16T15:37:44.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.638+0000 7f9403f2b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93fc0cddc0 0x7f93fc158250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:44.642 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.638+0000 7f9403f2b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93fc154ea0 0x7f93fc1f77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:44.642 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.638+0000 7f9403f2b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f93fc155280 0x7f93fc0cc430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:44.642 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.638+0000 7f9403f2b640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f93fc1622b0 con 0x7f93fc155280 2024-09-16T15:37:44.642 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.638+0000 7f9403f2b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f93fc162130 con 0x7f93fc0cddc0 2024-09-16T15:37:44.642 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.638+0000 7f9403f2b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f93fc162430 con 0x7f93fc154ea0 2024-09-16T15:37:44.642 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.638+0000 7f94024c8640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f93fc155280 0x7f93fc0cc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:44.642 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.638+0000 7f9401cc7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93fc0cddc0 0x7f93fc158250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:44.642 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.638+0000 7f94024c8640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f93fc155280 0x7f93fc0cc430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:33326/0 (socket says 172.21.15.98:33326) 2024-09-16T15:37:44.642 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.638+0000 7f9401cc7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93fc0cddc0 0x7f93fc158250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.98:36440/0 (socket says 172.21.15.98:36440) 2024-09-16T15:37:44.642 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.638+0000 7f94024c8640 1 -- 172.21.15.98:0/3782334154 learned_addr learned my addr 172.21.15.98:0/3782334154 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:37:44.642 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.638+0000 7f94014c6640 1 --2- 172.21.15.98:0/3782334154 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93fc154ea0 0x7f93fc1f77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:44.642 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.638+0000 7f9401cc7640 1 -- 172.21.15.98:0/3782334154 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93fc154ea0 msgr2=0x7f93fc1f77e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:44.642 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.638+0000 7f9401cc7640 1 --2- 172.21.15.98:0/3782334154 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93fc154ea0 0x7f93fc1f77e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:44.643 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.638+0000 7f9401cc7640 1 -- 172.21.15.98:0/3782334154 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f93fc155280 msgr2=0x7f93fc0cc430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:44.643 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.638+0000 7f9401cc7640 1 --2- 172.21.15.98:0/3782334154 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f93fc155280 0x7f93fc0cc430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:44.643 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.639+0000 7f9401cc7640 1 -- 172.21.15.98:0/3782334154 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93fc0c92e0 con 0x7f93fc0cddc0 2024-09-16T15:37:44.643 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.639+0000 7f94024c8640 1 --2- 172.21.15.98:0/3782334154 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f93fc155280 0x7f93fc0cc430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T15:37:44.643 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.639+0000 7f9401cc7640 1 --2- 172.21.15.98:0/3782334154 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93fc0cddc0 0x7f93fc158250 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f93fc06fe60 tx=0x7f93f8032b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:44.643 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.639+0000 7f93f27fc640 1 -- 172.21.15.98:0/3782334154 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f8040070 con 0x7f93fc0cddc0 2024-09-16T15:37:44.643 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.639+0000 7f93f27fc640 1 -- 172.21.15.98:0/3782334154 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f93f8003900 con 0x7f93fc0cddc0 2024-09-16T15:37:44.643 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.639+0000 7f93f27fc640 1 -- 172.21.15.98:0/3782334154 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f8003d50 con 0x7f93fc0cddc0 2024-09-16T15:37:44.643 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.639+0000 7f9403f2b640 1 -- 172.21.15.98:0/3782334154 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93fc0c9620 con 0x7f93fc0cddc0 2024-09-16T15:37:44.643 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.639+0000 7f9403f2b640 1 -- 172.21.15.98:0/3782334154 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93fc0c9e60 con 0x7f93fc0cddc0 2024-09-16T15:37:44.644 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.640+0000 7f9403f2b640 1 -- 172.21.15.98:0/3782334154 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93fc162950 con 0x7f93fc0cddc0 2024-09-16T15:37:44.644 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.640+0000 7f93f27fc640 1 -- 172.21.15.98:0/3782334154 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7f93f8039040 con 0x7f93fc0cddc0 2024-09-16T15:37:44.644 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.641+0000 7f93f27fc640 1 --2- 172.21.15.98:0/3782334154 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f93e0078850 0x7f93e007ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:44.644 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.641+0000 7f93f27fc640 1 -- 172.21.15.98:0/3782334154 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f93f80bbcf0 con 0x7f93fc0cddc0 2024-09-16T15:37:44.644 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.641+0000 7f94014c6640 1 --2- 172.21.15.98:0/3782334154 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f93e0078850 0x7f93e007ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:44.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.641+0000 7f94014c6640 1 --2- 172.21.15.98:0/3782334154 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f93e0078850 0x7f93e007ad10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f93fc0b53d0 tx=0x7f93ec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:44.647 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.646+0000 7f93f27fc640 1 -- 172.21.15.98:0/3782334154 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7f93f80c0070 con 0x7f93fc0cddc0 2024-09-16T15:37:44.824 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.822+0000 7f9403f2b640 1 -- 172.21.15.98:0/3782334154 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f93fc0c9800 con 0x7f93fc0cddc0 2024-09-16T15:37:44.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.824+0000 7f93f27fc640 1 -- 172.21.15.98:0/3782334154 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16694 (secure 0 0 0) 0x7f93fc0c9620 con 0x7f93fc0cddc0 2024-09-16T15:37:44.826 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:37:44.826 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":22,"fsid":"52a38a45-21d2-4cb0-bb3a-4fb8be3a08df","created":"2024-09-16T15:37:20.387654+0000","modified":"2024-09-16T15:37:43.891651+0000","last_up_change":"2024-09-16T15:37:33.417470+0000","last_in_change":"2024-09-16T15:37:23.430578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T15:37:34.725090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-16T15:37:42.223874+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-16T15:37:42.808291+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a2d61df4-2577-47e6-a4ac-c36bbb85ab8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1967099790},{"type":"v1","addr":"172.21.15.98:6825","nonce":1967099790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1967099790},{"type":"v1","addr":"172.21.15.98:6827","nonce":1967099790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":1967099790},{"type":"v1","addr":"172.21.15.98:6831","nonce":1967099790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1967099790},{"type":"v1","addr":"172.21.15.98:6829","nonce":1967099790}]},"public_addr":"172.21.15.98:6825/1967099790","cluster_addr":"172.21.15.98:6827/1967099790","heartbeat_back_addr":"172.21.15.98:6831/1967099790","heartbeat_front_addr":"172.21.15.98:6829/1967099790","state":["exists","up"]},{"osd":1,"uuid":"bb3a68a5-c22f-442b-b292-7c272fe01ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":3571460482},{"type":"v1","addr":"172.21.15.98:6809","nonce":3571460482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":3571460482},{"type":"v1","addr":"172.21.15.98:6811","nonce":3571460482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":3571460482},{"type":"v1","addr":"172.21.15.98:6815","nonce":3571460482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":3571460482},{"type":"v1","addr":"172.21.15.98:6813","nonce":3571460482}]},"public_addr":"172.21.15.98:6809/3571460482","cluster_addr":"172.21.15.98:6811/3571460482","heartbeat_back_addr":"172.21.15.98:6815/3571460482","heartbeat_front_addr":"172.21.15.98:6813/3571460482","state":["exists","up"]},{"osd":2,"uuid":"c8429195-a480-409b-8e5f-8dc4c6abc0a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":2573210695},{"type":"v1","addr":"172.21.15.98:6801","nonce":2573210695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":2573210695},{"type":"v1","addr":"172.21.15.98:6803","nonce":2573210695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":2573210695},{"type":"v1","addr":"172.21.15.98:6807","nonce":2573210695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":2573210695},{"type":"v1","addr":"172.21.15.98:6805","nonce":2573210695}]},"public_addr":"172.21.15.98:6801/2573210695","cluster_addr":"172.21.15.98:6803/2573210695","heartbeat_back_addr":"172.21.15.98:6807/2573210695","heartbeat_front_addr":"172.21.15.98:6805/2573210695","state":["exists","up"]},{"osd":3,"uuid":"0e800d7b-096f-4f65-b3cc-c7cda3870de4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":3951374837},{"type":"v1","addr":"172.21.15.98:6817","nonce":3951374837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":3951374837},{"type":"v1","addr":"172.21.15.98:6819","nonce":3951374837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":3951374837},{"type":"v1","addr":"172.21.15.98:6823","nonce":3951374837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":3951374837},{"type":"v1","addr":"172.21.15.98:6821","nonce":3951374837}]},"public_addr":"172.21.15.98:6817/3951374837","cluster_addr":"172.21.15.98:6819/3951374837","heartbeat_back_addr":"172.21.15.98:6823/3951374837","heartbeat_front_addr":"172.21.15.98:6821/3951374837","state":["exists","up"]},{"osd":4,"uuid":"c7822e9b-8e29-48d9-b92a-e8f9c7bc5247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":724302036},{"type":"v1","addr":"172.21.15.135:6811","nonce":724302036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":724302036},{"type":"v1","addr":"172.21.15.135:6813","nonce":724302036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":724302036},{"type":"v1","addr":"172.21.15.135:6817","nonce":724302036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":724302036},{"type":"v1","addr":"172.21.15.135:6815","nonce":724302036}]},"public_addr":"172.21.15.135:6811/724302036","cluster_addr":"172.21.15.135:6813/724302036","heartbeat_back_addr":"172.21.15.135:6817/724302036","heartbeat_front_addr":"172.21.15.135:6815/724302036","state":["exists","up"]},{"osd":5,"uuid":"35805e02-484a-4404-a78f-aa44f4daa41f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3083482635},{"type":"v1","addr":"172.21.15.135:6803","nonce":3083482635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3083482635},{"type":"v1","addr":"172.21.15.135:6805","nonce":3083482635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3083482635},{"type":"v1","addr":"172.21.15.135:6809","nonce":3083482635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3083482635},{"type":"v1","addr":"172.21.15.135:6807","nonce":3083482635}]},"public_addr":"172.21.15.135:6803/3083482635","cluster_addr":"172.21.15.135:6805/3083482635","heartbeat_back_addr":"172.21.15.135:6809/3083482635","heartbeat_front_addr":"172.21.15.135:6807/3083482635","state":["exists","up"]},{"osd":6,"uuid":"6327ba84-aaeb-41fa-9717-188988ff2c4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3376376340},{"type":"v1","addr":"172.21.15.135:6819","nonce":3376376340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3376376340},{"type":"v1","addr":"172.21.15.135:6821","nonce":3376376340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":3376376340},{"type":"v1","addr":"172.21.15.135:6825","nonce":3376376340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3376376340},{"type":"v1","addr":"172.21.15.135:6823","nonce":3376376340}]},"public_addr":"172.21.15.135:6819/3376376340","cluster_addr":"172.21.15.135:6821/3376376340","heartbeat_back_addr":"172.21.15.135:6825/3376376340","heartbeat_front_addr":"172.21.15.135:6823/3376376340","state":["exists","up"]},{"osd":7,"uuid":"392d0958-dff9-4248-b3d8-a1201c10f354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2559837727},{"type":"v1","addr":"172.21.15.135:6827","nonce":2559837727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2559837727},{"type":"v1","addr":"172.21.15.135:6829","nonce":2559837727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":2559837727},{"type":"v1","addr":"172.21.15.135:6833","nonce":2559837727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2559837727},{"type":"v1","addr":"172.21.15.135:6831","nonce":2559837727}]},"public_addr":"172.21.15.135:6827/2559837727","cluster_addr":"172.21.15.135:6829/2559837727","heartbeat_back_addr":"172.21.15.135:6833/2559837727","heartbeat_front_addr":"172.21.15.135:6831/2559837727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.939904+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.717296+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.785817+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:30.211718+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.973359+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:30.250109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.699327+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:30.173063+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T15:37:44.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.826+0000 7f9403f2b640 1 -- 172.21.15.98:0/3782334154 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f93e0078850 msgr2=0x7f93e007ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:44.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.826+0000 7f9403f2b640 1 --2- 172.21.15.98:0/3782334154 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f93e0078850 0x7f93e007ad10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f93fc0b53d0 tx=0x7f93ec009040 comp rx=0 tx=0).stop 2024-09-16T15:37:44.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.826+0000 7f9403f2b640 1 -- 172.21.15.98:0/3782334154 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93fc0cddc0 msgr2=0x7f93fc158250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:44.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.826+0000 7f9403f2b640 1 --2- 172.21.15.98:0/3782334154 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93fc0cddc0 0x7f93fc158250 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f93fc06fe60 tx=0x7f93f8032b90 comp rx=0 tx=0).stop 2024-09-16T15:37:44.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.826+0000 7f9403f2b640 1 -- 172.21.15.98:0/3782334154 shutdown_connections 2024-09-16T15:37:44.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.826+0000 7f9403f2b640 1 --2- 172.21.15.98:0/3782334154 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f93fc155280 0x7f93fc0cc430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:44.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.826+0000 7f9403f2b640 1 --2- 172.21.15.98:0/3782334154 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f93fc154ea0 0x7f93fc1f77e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:44.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.826+0000 7f9403f2b640 1 --2- 172.21.15.98:0/3782334154 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f93e0078850 0x7f93e007ad10 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:44.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.826+0000 7f9403f2b640 1 --2- 172.21.15.98:0/3782334154 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93fc0cddc0 0x7f93fc158250 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:44.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.826+0000 7f9403f2b640 1 -- 172.21.15.98:0/3782334154 >> 172.21.15.98:0/3782334154 conn(0x7f93fc06d230 msgr2=0x7f93fc0ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:44.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.826+0000 7f9403f2b640 1 -- 172.21.15.98:0/3782334154 shutdown_connections 2024-09-16T15:37:44.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.826+0000 7f9403f2b640 1 -- 172.21.15.98:0/3782334154 wait complete. 2024-09-16T15:37:44.839 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T15:37:44.939 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.936+0000 7fd59952b640 1 -- 172.21.15.98:0/3910413235 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd59415e0d0 msgr2=0x7fd5940d09c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:44.939 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.936+0000 7fd59952b640 1 --2- 172.21.15.98:0/3910413235 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd59415e0d0 0x7fd5940d09c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd5940d4f60 tx=0x7fd58402a560 comp rx=0 tx=0).stop 2024-09-16T15:37:44.939 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.936+0000 7fd59952b640 1 -- 172.21.15.98:0/3910413235 shutdown_connections 2024-09-16T15:37:44.939 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.936+0000 7fd59952b640 1 --2- 172.21.15.98:0/3910413235 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd5940d1440 0x7fd59415e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:44.939 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.936+0000 7fd59952b640 1 --2- 172.21.15.98:0/3910413235 >> v2:172.21.15.135:3300/0 conn(0x7fd5940d2050 0x7fd5940d0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:44.939 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.936+0000 7fd59952b640 1 --2- 172.21.15.98:0/3910413235 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd59415e0d0 0x7fd5940d09c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:44.939 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.936+0000 7fd59952b640 1 -- 172.21.15.98:0/3910413235 >> 172.21.15.98:0/3910413235 conn(0x7fd5940d3fe0 msgr2=0x7fd5940d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:44.939 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.937+0000 7fd59952b640 1 -- 172.21.15.98:0/3910413235 shutdown_connections 2024-09-16T15:37:44.939 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.937+0000 7fd59952b640 1 -- 172.21.15.98:0/3910413235 wait complete. 2024-09-16T15:37:44.940 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.938+0000 7fd59952b640 1 Processor -- start 2024-09-16T15:37:44.940 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.938+0000 7fd59952b640 1 -- start start 2024-09-16T15:37:44.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.938+0000 7fd59952b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd5940d1440 0x7fd5940b99b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:44.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.939+0000 7fd59952b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd5940d2050 0x7fd5940ccef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:44.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.939+0000 7fd59952b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd59415e0d0 0x7fd5941f81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:44.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.939+0000 7fd59952b640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd59415ed80 con 0x7fd5940d2050 2024-09-16T15:37:44.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.939+0000 7fd59952b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd59415ec00 con 0x7fd59415e0d0 2024-09-16T15:37:44.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.939+0000 7fd59952b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fd59415ef00 con 0x7fd5940d1440 2024-09-16T15:37:44.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.939+0000 7fd58a7fc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd5940d2050 0x7fd5940ccef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:44.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.939+0000 7fd58a7fc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd5940d2050 0x7fd5940ccef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:33344/0 (socket says 172.21.15.98:33344) 2024-09-16T15:37:44.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.939+0000 7fd58a7fc640 1 -- 172.21.15.98:0/77821893 learned_addr learned my addr 172.21.15.98:0/77821893 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:37:44.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.939+0000 7fd592ffd640 1 --2- 172.21.15.98:0/77821893 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd5940d1440 0x7fd5940b99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:44.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.939+0000 7fd5937fe640 1 --2- 172.21.15.98:0/77821893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd59415e0d0 0x7fd5941f81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:44.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.939+0000 7fd58a7fc640 1 -- 172.21.15.98:0/77821893 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd5940d1440 msgr2=0x7fd5940b99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:44.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.939+0000 7fd58a7fc640 1 --2- 172.21.15.98:0/77821893 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd5940d1440 0x7fd5940b99b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:44.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.939+0000 7fd58a7fc640 1 -- 172.21.15.98:0/77821893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd59415e0d0 msgr2=0x7fd5941f81b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:44.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.939+0000 7fd58a7fc640 1 --2- 172.21.15.98:0/77821893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd59415e0d0 0x7fd5941f81b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:44.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.939+0000 7fd58a7fc640 1 -- 172.21.15.98:0/77821893 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5940cb250 con 0x7fd5940d2050 2024-09-16T15:37:44.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.939+0000 7fd58a7fc640 1 --2- 172.21.15.98:0/77821893 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd5940d2050 0x7fd5940ccef0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd57c00d950 tx=0x7fd57c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:44.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.939+0000 7fd58bfff640 1 -- 172.21.15.98:0/77821893 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd57c017070 con 0x7fd5940d2050 2024-09-16T15:37:44.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.939+0000 7fd58bfff640 1 -- 172.21.15.98:0/77821893 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd57c009cc0 con 0x7fd5940d2050 2024-09-16T15:37:44.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.939+0000 7fd58bfff640 1 -- 172.21.15.98:0/77821893 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd57c0106c0 con 0x7fd5940d2050 2024-09-16T15:37:44.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.939+0000 7fd59952b640 1 -- 172.21.15.98:0/77821893 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5940cb530 con 0x7fd5940d2050 2024-09-16T15:37:44.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.939+0000 7fd59952b640 1 -- 172.21.15.98:0/77821893 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5940ce120 con 0x7fd5940d2050 2024-09-16T15:37:44.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.940+0000 7fd59952b640 1 -- 172.21.15.98:0/77821893 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd59415f3d0 con 0x7fd5940d2050 2024-09-16T15:37:44.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.941+0000 7fd58bfff640 1 -- 172.21.15.98:0/77821893 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7fd57c010860 con 0x7fd5940d2050 2024-09-16T15:37:44.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.941+0000 7fd58bfff640 1 --2- 172.21.15.98:0/77821893 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fd574078850 0x7fd57407ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:44.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.942+0000 7fd592ffd640 1 --2- 172.21.15.98:0/77821893 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fd574078850 0x7fd57407ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:44.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.942+0000 7fd58bfff640 1 -- 172.21.15.98:0/77821893 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fd57c09ac00 con 0x7fd5940d2050 2024-09-16T15:37:44.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.942+0000 7fd592ffd640 1 --2- 172.21.15.98:0/77821893 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fd574078850 0x7fd57407ad10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd584033000 tx=0x7fd584004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:44.948 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:44.946+0000 7fd58bfff640 1 -- 172.21.15.98:0/77821893 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7fd57c0a1080 con 0x7fd5940d2050 2024-09-16T15:37:45.123 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:45.122+0000 7fd59952b640 1 -- 172.21.15.98:0/77821893 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd594074670 con 0x7fd5940d2050 2024-09-16T15:37:45.124 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:45.123+0000 7fd58bfff640 1 -- 172.21.15.98:0/77821893 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16694 (secure 0 0 0) 0x7fd57c062c20 con 0x7fd5940d2050 2024-09-16T15:37:45.125 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:37:45.125 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":22,"fsid":"52a38a45-21d2-4cb0-bb3a-4fb8be3a08df","created":"2024-09-16T15:37:20.387654+0000","modified":"2024-09-16T15:37:43.891651+0000","last_up_change":"2024-09-16T15:37:33.417470+0000","last_in_change":"2024-09-16T15:37:23.430578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T15:37:34.725090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-16T15:37:42.223874+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-16T15:37:42.808291+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a2d61df4-2577-47e6-a4ac-c36bbb85ab8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1967099790},{"type":"v1","addr":"172.21.15.98:6825","nonce":1967099790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1967099790},{"type":"v1","addr":"172.21.15.98:6827","nonce":1967099790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":1967099790},{"type":"v1","addr":"172.21.15.98:6831","nonce":1967099790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1967099790},{"type":"v1","addr":"172.21.15.98:6829","nonce":1967099790}]},"public_addr":"172.21.15.98:6825/1967099790","cluster_addr":"172.21.15.98:6827/1967099790","heartbeat_back_addr":"172.21.15.98:6831/1967099790","heartbeat_front_addr":"172.21.15.98:6829/1967099790","state":["exists","up"]},{"osd":1,"uuid":"bb3a68a5-c22f-442b-b292-7c272fe01ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":3571460482},{"type":"v1","addr":"172.21.15.98:6809","nonce":3571460482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":3571460482},{"type":"v1","addr":"172.21.15.98:6811","nonce":3571460482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":3571460482},{"type":"v1","addr":"172.21.15.98:6815","nonce":3571460482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":3571460482},{"type":"v1","addr":"172.21.15.98:6813","nonce":3571460482}]},"public_addr":"172.21.15.98:6809/3571460482","cluster_addr":"172.21.15.98:6811/3571460482","heartbeat_back_addr":"172.21.15.98:6815/3571460482","heartbeat_front_addr":"172.21.15.98:6813/3571460482","state":["exists","up"]},{"osd":2,"uuid":"c8429195-a480-409b-8e5f-8dc4c6abc0a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":2573210695},{"type":"v1","addr":"172.21.15.98:6801","nonce":2573210695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":2573210695},{"type":"v1","addr":"172.21.15.98:6803","nonce":2573210695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":2573210695},{"type":"v1","addr":"172.21.15.98:6807","nonce":2573210695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":2573210695},{"type":"v1","addr":"172.21.15.98:6805","nonce":2573210695}]},"public_addr":"172.21.15.98:6801/2573210695","cluster_addr":"172.21.15.98:6803/2573210695","heartbeat_back_addr":"172.21.15.98:6807/2573210695","heartbeat_front_addr":"172.21.15.98:6805/2573210695","state":["exists","up"]},{"osd":3,"uuid":"0e800d7b-096f-4f65-b3cc-c7cda3870de4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":3951374837},{"type":"v1","addr":"172.21.15.98:6817","nonce":3951374837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":3951374837},{"type":"v1","addr":"172.21.15.98:6819","nonce":3951374837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":3951374837},{"type":"v1","addr":"172.21.15.98:6823","nonce":3951374837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":3951374837},{"type":"v1","addr":"172.21.15.98:6821","nonce":3951374837}]},"public_addr":"172.21.15.98:6817/3951374837","cluster_addr":"172.21.15.98:6819/3951374837","heartbeat_back_addr":"172.21.15.98:6823/3951374837","heartbeat_front_addr":"172.21.15.98:6821/3951374837","state":["exists","up"]},{"osd":4,"uuid":"c7822e9b-8e29-48d9-b92a-e8f9c7bc5247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":724302036},{"type":"v1","addr":"172.21.15.135:6811","nonce":724302036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":724302036},{"type":"v1","addr":"172.21.15.135:6813","nonce":724302036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":724302036},{"type":"v1","addr":"172.21.15.135:6817","nonce":724302036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":724302036},{"type":"v1","addr":"172.21.15.135:6815","nonce":724302036}]},"public_addr":"172.21.15.135:6811/724302036","cluster_addr":"172.21.15.135:6813/724302036","heartbeat_back_addr":"172.21.15.135:6817/724302036","heartbeat_front_addr":"172.21.15.135:6815/724302036","state":["exists","up"]},{"osd":5,"uuid":"35805e02-484a-4404-a78f-aa44f4daa41f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3083482635},{"type":"v1","addr":"172.21.15.135:6803","nonce":3083482635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3083482635},{"type":"v1","addr":"172.21.15.135:6805","nonce":3083482635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3083482635},{"type":"v1","addr":"172.21.15.135:6809","nonce":3083482635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3083482635},{"type":"v1","addr":"172.21.15.135:6807","nonce":3083482635}]},"public_addr":"172.21.15.135:6803/3083482635","cluster_addr":"172.21.15.135:6805/3083482635","heartbeat_back_addr":"172.21.15.135:6809/3083482635","heartbeat_front_addr":"172.21.15.135:6807/3083482635","state":["exists","up"]},{"osd":6,"uuid":"6327ba84-aaeb-41fa-9717-188988ff2c4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3376376340},{"type":"v1","addr":"172.21.15.135:6819","nonce":3376376340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3376376340},{"type":"v1","addr":"172.21.15.135:6821","nonce":3376376340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":3376376340},{"type":"v1","addr":"172.21.15.135:6825","nonce":3376376340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3376376340},{"type":"v1","addr":"172.21.15.135:6823","nonce":3376376340}]},"public_addr":"172.21.15.135:6819/3376376340","cluster_addr":"172.21.15.135:6821/3376376340","heartbeat_back_addr":"172.21.15.135:6825/3376376340","heartbeat_front_addr":"172.21.15.135:6823/3376376340","state":["exists","up"]},{"osd":7,"uuid":"392d0958-dff9-4248-b3d8-a1201c10f354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2559837727},{"type":"v1","addr":"172.21.15.135:6827","nonce":2559837727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2559837727},{"type":"v1","addr":"172.21.15.135:6829","nonce":2559837727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":2559837727},{"type":"v1","addr":"172.21.15.135:6833","nonce":2559837727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2559837727},{"type":"v1","addr":"172.21.15.135:6831","nonce":2559837727}]},"public_addr":"172.21.15.135:6827/2559837727","cluster_addr":"172.21.15.135:6829/2559837727","heartbeat_back_addr":"172.21.15.135:6833/2559837727","heartbeat_front_addr":"172.21.15.135:6831/2559837727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.939904+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.717296+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.785817+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:30.211718+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.973359+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:30.250109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.699327+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:30.173063+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T15:37:45.127 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:45.125+0000 7fd59952b640 1 -- 172.21.15.98:0/77821893 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fd574078850 msgr2=0x7fd57407ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:45.127 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:45.125+0000 7fd59952b640 1 --2- 172.21.15.98:0/77821893 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fd574078850 0x7fd57407ad10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd584033000 tx=0x7fd584004730 comp rx=0 tx=0).stop 2024-09-16T15:37:45.127 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:45.125+0000 7fd59952b640 1 -- 172.21.15.98:0/77821893 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd5940d2050 msgr2=0x7fd5940ccef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:45.127 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:45.125+0000 7fd59952b640 1 --2- 172.21.15.98:0/77821893 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd5940d2050 0x7fd5940ccef0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd57c00d950 tx=0x7fd57c00de10 comp rx=0 tx=0).stop 2024-09-16T15:37:45.127 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:45.125+0000 7fd59952b640 1 -- 172.21.15.98:0/77821893 shutdown_connections 2024-09-16T15:37:45.127 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:45.125+0000 7fd59952b640 1 --2- 172.21.15.98:0/77821893 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fd574078850 0x7fd57407ad10 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:45.128 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:45.125+0000 7fd59952b640 1 --2- 172.21.15.98:0/77821893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd59415e0d0 0x7fd5941f81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:45.128 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:45.125+0000 7fd59952b640 1 --2- 172.21.15.98:0/77821893 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd5940d2050 0x7fd5940ccef0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:45.128 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:45.125+0000 7fd59952b640 1 --2- 172.21.15.98:0/77821893 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd5940d1440 0x7fd5940b99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:45.128 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:45.125+0000 7fd59952b640 1 -- 172.21.15.98:0/77821893 >> 172.21.15.98:0/77821893 conn(0x7fd5940d3fe0 msgr2=0x7fd59415f5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:45.128 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:45.125+0000 7fd59952b640 1 -- 172.21.15.98:0/77821893 shutdown_connections 2024-09-16T15:37:45.128 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:45.125+0000 7fd59952b640 1 -- 172.21.15.98:0/77821893 wait complete. 2024-09-16T15:37:45.138 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-16T15:37:45.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:45.240+0000 7f19f359e640 1 -- 172.21.15.98:0/884760615 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19f415de10 msgr2=0x7f19f40afab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:45.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:45.240+0000 7f19f359e640 1 --2- 172.21.15.98:0/884760615 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19f415de10 0x7f19f40afab0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f19e4009830 tx=0x7f19e402a480 comp rx=0 tx=0).stop 2024-09-16T15:37:45.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:45.240+0000 7f19f359e640 1 -- 172.21.15.98:0/884760615 shutdown_connections 2024-09-16T15:37:45.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:45.240+0000 7f19f359e640 1 --2- 172.21.15.98:0/884760615 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19f40afff0 0x7f19f406cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:45.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:45.240+0000 7f19f359e640 1 --2- 172.21.15.98:0/884760615 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19f415de10 0x7f19f40afab0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:45.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:45.240+0000 7f19f359e640 1 -- 172.21.15.98:0/884760615 >> 172.21.15.98:0/884760615 conn(0x7f19f40d0b40 msgr2=0x7f19f40d0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:45.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:45.240+0000 7f19f359e640 1 -- 172.21.15.98:0/884760615 shutdown_connections 2024-09-16T15:37:45.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:45.240+0000 7f19f359e640 1 -- 172.21.15.98:0/884760615 wait complete. 2024-09-16T15:37:45.247 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:45.241+0000 7f19f359e640 1 Processor -- start 2024-09-16T15:37:45.247 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:45.241+0000 7f19f359e640 1 -- start start 2024-09-16T15:37:45.247 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:45.242+0000 7f19f359e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f19f40afff0 0x7f19f415c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:45.247 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:45.242+0000 7f19f359e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19f415de10 0x7f19f40c7c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:45.247 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:45.242+0000 7f19f359e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19f415e1f0 0x7f19f40ae8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:45.247 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:45.242+0000 7f19f359e640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f19f406d440 con 0x7f19f40afff0 2024-09-16T15:37:45.247 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:45.242+0000 7f19f359e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f19f406d2c0 con 0x7f19f415de10 2024-09-16T15:37:45.247 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:45.242+0000 7f19f359e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f19f4162090 con 0x7f19f415e1f0 2024-09-16T15:37:45.247 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:45.242+0000 7f19f259c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f19f40afff0 0x7f19f415c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:45.247 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:45.242+0000 7f19f259c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f19f40afff0 0x7f19f415c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59416/0 (socket says 172.21.15.98:59416) 2024-09-16T15:37:45.247 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:45.242+0000 7f19f259c640 1 -- 172.21.15.98:0/2113287630 learned_addr learned my addr 172.21.15.98:0/2113287630 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:37:45.247 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:45.242+0000 7f19f2d9d640 1 --2- 172.21.15.98:0/2113287630 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19f415e1f0 0x7f19f40ae8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:45.247 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:45.242+0000 7f19ebfff640 1 --2- 172.21.15.98:0/2113287630 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19f415de10 0x7f19f40c7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:45.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:45.242+0000 7f19f259c640 1 -- 172.21.15.98:0/2113287630 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19f415e1f0 msgr2=0x7f19f40ae8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:45.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:45.242+0000 7f19f259c640 1 --2- 172.21.15.98:0/2113287630 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19f415e1f0 0x7f19f40ae8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:45.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:45.242+0000 7f19f259c640 1 -- 172.21.15.98:0/2113287630 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19f415de10 msgr2=0x7f19f40c7c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:45.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:45.242+0000 7f19f259c640 1 --2- 172.21.15.98:0/2113287630 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19f415de10 0x7f19f40c7c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:45.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:45.242+0000 7f19f259c640 1 -- 172.21.15.98:0/2113287630 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19f415c9f0 con 0x7f19f40afff0 2024-09-16T15:37:45.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:45.242+0000 7f19f259c640 1 --2- 172.21.15.98:0/2113287630 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f19f40afff0 0x7f19f415c4b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f19e4009950 tx=0x7f19e4032c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:45.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:45.242+0000 7f19eaffd640 1 -- 172.21.15.98:0/2113287630 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19e4040070 con 0x7f19f40afff0 2024-09-16T15:37:45.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:45.243+0000 7f19f359e640 1 -- 172.21.15.98:0/2113287630 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19f40c8a40 con 0x7f19f40afff0 2024-09-16T15:37:45.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:45.243+0000 7f19eaffd640 1 -- 172.21.15.98:0/2113287630 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f19e4005310 con 0x7f19f40afff0 2024-09-16T15:37:45.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:45.243+0000 7f19eaffd640 1 -- 172.21.15.98:0/2113287630 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19e40047a0 con 0x7f19f40afff0 2024-09-16T15:37:45.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:45.243+0000 7f19f359e640 1 -- 172.21.15.98:0/2113287630 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19f41f4500 con 0x7f19f40afff0 2024-09-16T15:37:45.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:45.243+0000 7f19f359e640 1 -- 172.21.15.98:0/2113287630 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19f40c8f60 con 0x7f19f40afff0 2024-09-16T15:37:45.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:45.244+0000 7f19eaffd640 1 -- 172.21.15.98:0/2113287630 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7f19e4039040 con 0x7f19f40afff0 2024-09-16T15:37:45.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:45.244+0000 7f19eaffd640 1 --2- 172.21.15.98:0/2113287630 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f19d4078880 0x7f19d407ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:45.249 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:45.245+0000 7f19eaffd640 1 -- 172.21.15.98:0/2113287630 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f19e40bb990 con 0x7f19f40afff0 2024-09-16T15:37:45.249 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:45.245+0000 7f19ebfff640 1 --2- 172.21.15.98:0/2113287630 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f19d4078880 0x7f19d407ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:45.249 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:45.245+0000 7f19ebfff640 1 --2- 172.21.15.98:0/2113287630 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f19d4078880 0x7f19d407ad40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f19f40af490 tx=0x7f19dc009260 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:45.251 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:45.249+0000 7f19eaffd640 1 -- 172.21.15.98:0/2113287630 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7f19f40c8f60 con 0x7f19f40afff0 2024-09-16T15:37:45.462 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:45.460+0000 7f19f359e640 1 -- 172.21.15.98:0/2113287630 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f19f41f42f0 con 0x7f19f40afff0 2024-09-16T15:37:46.179 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:46.178+0000 7f19eaffd640 1 -- 172.21.15.98:0/2113287630 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) ==== 118+0+0 (secure 0 0 0) 0x7f19e4084010 con 0x7f19f40afff0 2024-09-16T15:37:46.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:46.181+0000 7f19f359e640 1 -- 172.21.15.98:0/2113287630 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f19d4078880 msgr2=0x7f19d407ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:46.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:46.181+0000 7f19f359e640 1 --2- 172.21.15.98:0/2113287630 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f19d4078880 0x7f19d407ad40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f19f40af490 tx=0x7f19dc009260 comp rx=0 tx=0).stop 2024-09-16T15:37:46.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:46.181+0000 7f19f359e640 1 -- 172.21.15.98:0/2113287630 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f19f40afff0 msgr2=0x7f19f415c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:46.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:46.181+0000 7f19f359e640 1 --2- 172.21.15.98:0/2113287630 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f19f40afff0 0x7f19f415c4b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f19e4009950 tx=0x7f19e4032c10 comp rx=0 tx=0).stop 2024-09-16T15:37:46.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:46.181+0000 7f19f359e640 1 -- 172.21.15.98:0/2113287630 shutdown_connections 2024-09-16T15:37:46.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:46.181+0000 7f19f359e640 1 --2- 172.21.15.98:0/2113287630 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f19f415e1f0 0x7f19f40ae8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:46.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:46.181+0000 7f19f359e640 1 --2- 172.21.15.98:0/2113287630 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f19d4078880 0x7f19d407ad40 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:46.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:46.181+0000 7f19f359e640 1 --2- 172.21.15.98:0/2113287630 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19f415de10 0x7f19f40c7c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:46.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:46.181+0000 7f19f359e640 1 --2- 172.21.15.98:0/2113287630 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f19f40afff0 0x7f19f415c4b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:46.184 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:46.181+0000 7f19f359e640 1 -- 172.21.15.98:0/2113287630 >> 172.21.15.98:0/2113287630 conn(0x7f19f40d0b40 msgr2=0x7f19f4160780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:46.184 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:46.181+0000 7f19f359e640 1 -- 172.21.15.98:0/2113287630 shutdown_connections 2024-09-16T15:37:46.184 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:46.181+0000 7f19f359e640 1 -- 172.21.15.98:0/2113287630 wait complete. 2024-09-16T15:37:46.195 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-16T15:37:46.196 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-16T15:37:46.306 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:46.304+0000 7fbedef89640 1 -- 172.21.15.98:0/3535542383 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbec0004800 msgr2=0x7fbec0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:46.306 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:46.304+0000 7fbedef89640 1 --2- 172.21.15.98:0/3535542383 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbec0004800 0x7fbec0004c80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbed80cb600 tx=0x7fbec0005830 comp rx=0 tx=0).stop 2024-09-16T15:37:46.306 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:46.304+0000 7fbedd526640 1 -- 172.21.15.98:0/3535542383 reap_dead start 2024-09-16T15:37:46.307 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:46.304+0000 7fbedef89640 1 -- 172.21.15.98:0/3535542383 shutdown_connections 2024-09-16T15:37:46.307 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:46.304+0000 7fbedef89640 1 -- 172.21.15.98:0/3535542383 >> 172.21.15.98:0/3535542383 conn(0x7fbed80d0d40 msgr2=0x7fbed80d1150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:46.307 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:46.304+0000 7fbedef89640 1 -- 172.21.15.98:0/3535542383 shutdown_connections 2024-09-16T15:37:46.307 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:46.304+0000 7fbedef89640 1 -- 172.21.15.98:0/3535542383 wait complete. 2024-09-16T15:37:46.307 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:46.305+0000 7fbedef89640 1 Processor -- start 2024-09-16T15:37:46.307 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:46.305+0000 7fbedef89640 1 -- start start 2024-09-16T15:37:46.310 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:46.306+0000 7fbedef89640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbec0004800 0x7fbed8159f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:46.310 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:46.306+0000 7fbedef89640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbed8156710 0x7fbed8143d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:46.310 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:46.306+0000 7fbedef89640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbed80b4d40 0x7fbed80b51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:46.310 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:46.306+0000 7fbedef89640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fbed806f670 con 0x7fbed8156710 2024-09-16T15:37:46.310 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:46.306+0000 7fbedef89640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbed80cca60 con 0x7fbec0004800 2024-09-16T15:37:46.310 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:46.306+0000 7fbedef89640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fbed806f7f0 con 0x7fbed80b4d40 2024-09-16T15:37:46.311 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:46.306+0000 7fbed7fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbed8156710 0x7fbed8143d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:46.311 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:46.306+0000 7fbed7fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbed8156710 0x7fbed8143d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59436/0 (socket says 172.21.15.98:59436) 2024-09-16T15:37:46.311 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:46.306+0000 7fbed7fff640 1 -- 172.21.15.98:0/325715965 learned_addr learned my addr 172.21.15.98:0/325715965 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:37:46.311 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:46.306+0000 7fbedcd25640 1 --2- 172.21.15.98:0/325715965 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbec0004800 0x7fbed8159f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:46.311 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:46.306+0000 7fbedd526640 1 --2- 172.21.15.98:0/325715965 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbed80b4d40 0x7fbed80b51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:46.311 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:46.306+0000 7fbed7fff640 1 -- 172.21.15.98:0/325715965 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbed80b4d40 msgr2=0x7fbed80b51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:46.311 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:46.306+0000 7fbed7fff640 1 --2- 172.21.15.98:0/325715965 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbed80b4d40 0x7fbed80b51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:46.311 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:46.306+0000 7fbed7fff640 1 -- 172.21.15.98:0/325715965 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbec0004800 msgr2=0x7fbed8159f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:46.311 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:46.306+0000 7fbed7fff640 1 --2- 172.21.15.98:0/325715965 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbec0004800 0x7fbed8159f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:46.311 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:46.306+0000 7fbed7fff640 1 -- 172.21.15.98:0/325715965 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbed8156c20 con 0x7fbed8156710 2024-09-16T15:37:46.311 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:46.306+0000 7fbedd526640 1 --2- 172.21.15.98:0/325715965 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbed80b4d40 0x7fbed80b51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T15:37:46.311 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:46.307+0000 7fbedcd25640 1 --2- 172.21.15.98:0/325715965 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbec0004800 0x7fbed8159f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T15:37:46.312 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:46.307+0000 7fbed7fff640 1 --2- 172.21.15.98:0/325715965 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbed8156710 0x7fbed8143d60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbecc001260 tx=0x7fbecc004df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:46.312 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:46.307+0000 7fbed57fa640 1 -- 172.21.15.98:0/325715965 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbecc031040 con 0x7fbed8156710 2024-09-16T15:37:46.312 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:46.307+0000 7fbed57fa640 1 -- 172.21.15.98:0/325715965 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbecc006440 con 0x7fbed8156710 2024-09-16T15:37:46.312 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:46.307+0000 7fbedef89640 1 -- 172.21.15.98:0/325715965 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbed8159470 con 0x7fbed8156710 2024-09-16T15:37:46.312 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:46.307+0000 7fbed57fa640 1 -- 172.21.15.98:0/325715965 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbecc001d10 con 0x7fbed8156710 2024-09-16T15:37:46.312 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:46.307+0000 7fbedef89640 1 -- 172.21.15.98:0/325715965 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbed8159a30 con 0x7fbed8156710 2024-09-16T15:37:46.312 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:46.308+0000 7fbedef89640 1 -- 172.21.15.98:0/325715965 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbed80704f0 con 0x7fbed8156710 2024-09-16T15:37:46.312 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:46.308+0000 7fbed57fa640 1 -- 172.21.15.98:0/325715965 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7fbecc034070 con 0x7fbed8156710 2024-09-16T15:37:46.313 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:46.309+0000 7fbed57fa640 1 --2- 172.21.15.98:0/325715965 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fbec40788b0 0x7fbec407ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:46.313 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:46.309+0000 7fbed57fa640 1 -- 172.21.15.98:0/325715965 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fbecc0babf0 con 0x7fbed8156710 2024-09-16T15:37:46.313 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:46.309+0000 7fbedcd25640 1 --2- 172.21.15.98:0/325715965 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fbec40788b0 0x7fbec407ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:46.313 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:46.310+0000 7fbedcd25640 1 --2- 172.21.15.98:0/325715965 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fbec40788b0 0x7fbec407ad70 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fbec8009b60 tx=0x7fbec8005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:46.315 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:46.313+0000 7fbed57fa640 1 -- 172.21.15.98:0/325715965 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7fbecc045060 con 0x7fbed8156710 2024-09-16T15:37:46.529 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:46.527+0000 7fbedef89640 1 -- 172.21.15.98:0/325715965 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fbed815b080 con 0x7fbed8156710 2024-09-16T15:37:47.528 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.526+0000 7fbed57fa640 1 -- 172.21.15.98:0/325715965 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) ==== 122+0+0 (secure 0 0 0) 0x7fbecc083260 con 0x7fbed8156710 2024-09-16T15:37:47.531 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.529+0000 7fbedef89640 1 -- 172.21.15.98:0/325715965 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fbec40788b0 msgr2=0x7fbec407ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:47.532 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.529+0000 7fbedef89640 1 --2- 172.21.15.98:0/325715965 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fbec40788b0 0x7fbec407ad70 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fbec8009b60 tx=0x7fbec8005f90 comp rx=0 tx=0).stop 2024-09-16T15:37:47.532 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.529+0000 7fbedef89640 1 -- 172.21.15.98:0/325715965 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbed8156710 msgr2=0x7fbed8143d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:47.532 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.529+0000 7fbedef89640 1 --2- 172.21.15.98:0/325715965 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbed8156710 0x7fbed8143d60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbecc001260 tx=0x7fbecc004df0 comp rx=0 tx=0).stop 2024-09-16T15:37:47.532 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.529+0000 7fbedef89640 1 -- 172.21.15.98:0/325715965 shutdown_connections 2024-09-16T15:37:47.532 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.529+0000 7fbedef89640 1 --2- 172.21.15.98:0/325715965 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbed80b4d40 0x7fbed80b51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:47.532 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.529+0000 7fbedef89640 1 --2- 172.21.15.98:0/325715965 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbed8156710 0x7fbed8143d60 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:47.532 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.529+0000 7fbedef89640 1 --2- 172.21.15.98:0/325715965 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fbec40788b0 0x7fbec407ad70 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:47.532 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.529+0000 7fbedef89640 1 --2- 172.21.15.98:0/325715965 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbec0004800 0x7fbed8159f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:47.532 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.529+0000 7fbedef89640 1 -- 172.21.15.98:0/325715965 >> 172.21.15.98:0/325715965 conn(0x7fbed80d0d40 msgr2=0x7fbed80717f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:47.532 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.529+0000 7fbedef89640 1 -- 172.21.15.98:0/325715965 shutdown_connections 2024-09-16T15:37:47.532 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.529+0000 7fbedef89640 1 -- 172.21.15.98:0/325715965 wait complete. 2024-09-16T15:37:47.544 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-16T15:37:47.545 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T15:37:47.650 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.648+0000 7f0996cbd640 1 -- 172.21.15.98:0/2465692669 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f09900d1610 msgr2=0x7f09900cecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:47.651 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.648+0000 7f0996cbd640 1 --2- 172.21.15.98:0/2465692669 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f09900d1610 0x7f09900cecc0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0988005fd0 tx=0x7f098802a5d0 comp rx=0 tx=0).stop 2024-09-16T15:37:47.651 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.648+0000 7f0996cbd640 1 -- 172.21.15.98:0/2465692669 shutdown_connections 2024-09-16T15:37:47.651 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.648+0000 7f0996cbd640 1 --2- 172.21.15.98:0/2465692669 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f09900d1610 0x7f09900cecc0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:47.651 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.648+0000 7f0996cbd640 1 --2- 172.21.15.98:0/2465692669 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09900d2050 0x7f09900d10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:47.651 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.648+0000 7f0996cbd640 1 -- 172.21.15.98:0/2465692669 >> 172.21.15.98:0/2465692669 conn(0x7f09900d3fe0 msgr2=0x7f09900d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:47.651 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.648+0000 7f0996cbd640 1 -- 172.21.15.98:0/2465692669 shutdown_connections 2024-09-16T15:37:47.651 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.648+0000 7f0996cbd640 1 -- 172.21.15.98:0/2465692669 wait complete. 2024-09-16T15:37:47.651 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.649+0000 7f0996cbd640 1 Processor -- start 2024-09-16T15:37:47.652 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.649+0000 7f0996cbd640 1 -- start start 2024-09-16T15:37:47.654 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.650+0000 7f0996cbd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09900d1610 0x7f09900cc4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:47.654 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.650+0000 7f0996cbd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09900d2050 0x7f0990155160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:47.654 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.650+0000 7f0996cbd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f099015e0d0 0x7f099015c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:47.654 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.650+0000 7f0996cbd640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f09900cf670 con 0x7f099015e0d0 2024-09-16T15:37:47.654 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.650+0000 7f0996cbd640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f09900cf4f0 con 0x7f09900d2050 2024-09-16T15:37:47.654 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.650+0000 7f0996cbd640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f09900cf7f0 con 0x7f09900d1610 2024-09-16T15:37:47.654 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.650+0000 7f099525a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f099015e0d0 0x7f099015c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:47.654 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.650+0000 7f099525a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f099015e0d0 0x7f099015c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59452/0 (socket says 172.21.15.98:59452) 2024-09-16T15:37:47.655 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.650+0000 7f099525a640 1 -- 172.21.15.98:0/701927484 learned_addr learned my addr 172.21.15.98:0/701927484 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:37:47.655 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.651+0000 7f0994a59640 1 --2- 172.21.15.98:0/701927484 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09900d1610 0x7f09900cc4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:47.655 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.651+0000 7f098ffff640 1 --2- 172.21.15.98:0/701927484 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09900d2050 0x7f0990155160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:47.655 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.651+0000 7f099525a640 1 -- 172.21.15.98:0/701927484 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09900d1610 msgr2=0x7f09900cc4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:47.655 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.651+0000 7f099525a640 1 --2- 172.21.15.98:0/701927484 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09900d1610 0x7f09900cc4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:47.655 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.651+0000 7f099525a640 1 -- 172.21.15.98:0/701927484 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09900d2050 msgr2=0x7f0990155160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:47.655 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.651+0000 7f099525a640 1 --2- 172.21.15.98:0/701927484 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09900d2050 0x7f0990155160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:47.655 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.651+0000 7f099525a640 1 -- 172.21.15.98:0/701927484 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09901f7f60 con 0x7f099015e0d0 2024-09-16T15:37:47.655 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.651+0000 7f0994a59640 1 --2- 172.21.15.98:0/701927484 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09900d1610 0x7f09900cc4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T15:37:47.655 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.651+0000 7f099525a640 1 --2- 172.21.15.98:0/701927484 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f099015e0d0 0x7f099015c550 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0988006010 tx=0x7f0988003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:47.655 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.651+0000 7f098d7fa640 1 -- 172.21.15.98:0/701927484 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f098803f070 con 0x7f099015e0d0 2024-09-16T15:37:47.655 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.651+0000 7f098d7fa640 1 -- 172.21.15.98:0/701927484 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0988005600 con 0x7f099015e0d0 2024-09-16T15:37:47.655 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.651+0000 7f0996cbd640 1 -- 172.21.15.98:0/701927484 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09901f8240 con 0x7f099015e0d0 2024-09-16T15:37:47.655 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.651+0000 7f098d7fa640 1 -- 172.21.15.98:0/701927484 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0988035030 con 0x7f099015e0d0 2024-09-16T15:37:47.656 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.651+0000 7f0996cbd640 1 -- 172.21.15.98:0/701927484 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09901f8800 con 0x7f099015e0d0 2024-09-16T15:37:47.656 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.652+0000 7f0996cbd640 1 -- 172.21.15.98:0/701927484 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09901f8cf0 con 0x7f099015e0d0 2024-09-16T15:37:47.656 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.653+0000 7f098d7fa640 1 -- 172.21.15.98:0/701927484 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7f0988042070 con 0x7f099015e0d0 2024-09-16T15:37:47.656 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.653+0000 7f098d7fa640 1 --2- 172.21.15.98:0/701927484 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f0970078850 0x7f097007ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:47.657 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.653+0000 7f098d7fa640 1 -- 172.21.15.98:0/701927484 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f09880bb460 con 0x7f099015e0d0 2024-09-16T15:37:47.657 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.653+0000 7f0994a59640 1 --2- 172.21.15.98:0/701927484 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f0970078850 0x7f097007ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:47.657 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.654+0000 7f0994a59640 1 --2- 172.21.15.98:0/701927484 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f0970078850 0x7f097007ad10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f09901f7ec0 tx=0x7f0980009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:47.659 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.657+0000 7f098d7fa640 1 -- 172.21.15.98:0/701927484 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7f0988083b60 con 0x7f099015e0d0 2024-09-16T15:37:47.873 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.871+0000 7f0996cbd640 1 -- 172.21.15.98:0/701927484 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f09900cfca0 con 0x7f099015e0d0 2024-09-16T15:37:47.874 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.872+0000 7f098d7fa640 1 -- 172.21.15.98:0/701927484 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5220 (secure 0 0 0) 0x7f0988083460 con 0x7f099015e0d0 2024-09-16T15:37:47.874 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:37:47.874 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":7,"btime":"2024-09-16T15:37:47:522910+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4348,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/808747266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":808747266},{"type":"v1","addr":"172.21.15.135:6836","nonce":808747266}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4351,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/1940037746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":1940037746},{"type":"v1","addr":"172.21.15.135:6837","nonce":1940037746}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4353,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6834/3679859923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":3679859923},{"type":"v1","addr":"172.21.15.98:6834","nonce":3679859923}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T15:37:43.891616+0000","modified":"2024-09-16T15:37:46.529306+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4356},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4356":{"gid":4356,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.98:6835/1824614871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6833","nonce":1824614871},{"type":"v1","addr":"172.21.15.98:6835","nonce":1824614871}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4356,"qdb_cluster":[4356]},"id":1}]} 2024-09-16T15:37:47.874 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 7 2024-09-16T15:37:47.876 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.874+0000 7f0996cbd640 1 -- 172.21.15.98:0/701927484 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f0970078850 msgr2=0x7f097007ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:47.876 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.874+0000 7f0996cbd640 1 --2- 172.21.15.98:0/701927484 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f0970078850 0x7f097007ad10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f09901f7ec0 tx=0x7f0980009040 comp rx=0 tx=0).stop 2024-09-16T15:37:47.876 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.874+0000 7f0996cbd640 1 -- 172.21.15.98:0/701927484 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f099015e0d0 msgr2=0x7f099015c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:47.876 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.874+0000 7f0996cbd640 1 --2- 172.21.15.98:0/701927484 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f099015e0d0 0x7f099015c550 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0988006010 tx=0x7f0988003820 comp rx=0 tx=0).stop 2024-09-16T15:37:47.876 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.874+0000 7f0996cbd640 1 -- 172.21.15.98:0/701927484 shutdown_connections 2024-09-16T15:37:47.877 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.874+0000 7f0996cbd640 1 --2- 172.21.15.98:0/701927484 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f099015e0d0 0x7f099015c550 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:47.877 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.874+0000 7f0996cbd640 1 --2- 172.21.15.98:0/701927484 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f0970078850 0x7f097007ad10 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:47.877 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.874+0000 7f0996cbd640 1 --2- 172.21.15.98:0/701927484 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09900d2050 0x7f0990155160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:47.877 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.874+0000 7f0996cbd640 1 --2- 172.21.15.98:0/701927484 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f09900d1610 0x7f09900cc4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:47.877 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.874+0000 7f0996cbd640 1 -- 172.21.15.98:0/701927484 >> 172.21.15.98:0/701927484 conn(0x7f09900d3fe0 msgr2=0x7f0990161140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:47.877 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.874+0000 7f0996cbd640 1 -- 172.21.15.98:0/701927484 shutdown_connections 2024-09-16T15:37:47.877 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.874+0000 7f0996cbd640 1 -- 172.21.15.98:0/701927484 wait complete. 2024-09-16T15:37:47.886 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T15:37:47.987 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.985+0000 7f2a32b05640 1 -- 172.21.15.98:0/2583268080 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a2c071bf0 msgr2=0x7f2a2c071260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:47.987 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.985+0000 7f2a32b05640 1 --2- 172.21.15.98:0/2583268080 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a2c071bf0 0x7f2a2c071260 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2a24005fd0 tx=0x7f2a2402aa10 comp rx=0 tx=0).stop 2024-09-16T15:37:47.987 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.985+0000 7f2a32b05640 1 -- 172.21.15.98:0/2583268080 shutdown_connections 2024-09-16T15:37:47.987 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.985+0000 7f2a32b05640 1 --2- 172.21.15.98:0/2583268080 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a2c071bf0 0x7f2a2c071260 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:47.987 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.985+0000 7f2a32b05640 1 -- 172.21.15.98:0/2583268080 >> 172.21.15.98:0/2583268080 conn(0x7f2a2c06d230 msgr2=0x7f2a2c0688b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:47.987 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.985+0000 7f2a32b05640 1 -- 172.21.15.98:0/2583268080 shutdown_connections 2024-09-16T15:37:47.987 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.985+0000 7f2a32b05640 1 -- 172.21.15.98:0/2583268080 wait complete. 2024-09-16T15:37:47.988 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.986+0000 7f2a32b05640 1 Processor -- start 2024-09-16T15:37:47.988 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.986+0000 7f2a32b05640 1 -- start start 2024-09-16T15:37:47.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.987+0000 7f2a32b05640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2a2c071bf0 0x7f2a2c1f25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:47.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.987+0000 7f2a32b05640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a2c0b73c0 0x7f2a2c1f6620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:47.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.987+0000 7f2a32b05640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a2c0cf170 0x7f2a2c0b3270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:47.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.987+0000 7f2a32b05640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2a2c0d2350 con 0x7f2a2c0cf170 2024-09-16T15:37:47.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.987+0000 7f2a32b05640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2a2c0b79b0 con 0x7f2a2c0b73c0 2024-09-16T15:37:47.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.987+0000 7f2a32b05640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f2a2c0d24d0 con 0x7f2a2c071bf0 2024-09-16T15:37:47.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.987+0000 7f2a310a2640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a2c0cf170 0x7f2a2c0b3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:47.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.987+0000 7f2a310a2640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a2c0cf170 0x7f2a2c0b3270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59458/0 (socket says 172.21.15.98:59458) 2024-09-16T15:37:47.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.987+0000 7f2a310a2640 1 -- 172.21.15.98:0/2847714418 learned_addr learned my addr 172.21.15.98:0/2847714418 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:37:47.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.987+0000 7f2a308a1640 1 --2- 172.21.15.98:0/2847714418 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2a2c071bf0 0x7f2a2c1f25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:47.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.987+0000 7f2a2bfff640 1 --2- 172.21.15.98:0/2847714418 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a2c0b73c0 0x7f2a2c1f6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:47.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.987+0000 7f2a310a2640 1 -- 172.21.15.98:0/2847714418 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2a2c071bf0 msgr2=0x7f2a2c1f25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:47.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.987+0000 7f2a310a2640 1 --2- 172.21.15.98:0/2847714418 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2a2c071bf0 0x7f2a2c1f25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:47.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.987+0000 7f2a310a2640 1 -- 172.21.15.98:0/2847714418 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a2c0b73c0 msgr2=0x7f2a2c1f6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:47.992 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.987+0000 7f2a310a2640 1 --2- 172.21.15.98:0/2847714418 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a2c0b73c0 0x7f2a2c1f6620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:47.992 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.987+0000 7f2a310a2640 1 -- 172.21.15.98:0/2847714418 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a2c1f6b60 con 0x7f2a2c0cf170 2024-09-16T15:37:47.992 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.987+0000 7f2a308a1640 1 --2- 172.21.15.98:0/2847714418 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2a2c071bf0 0x7f2a2c1f25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T15:37:47.992 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.988+0000 7f2a310a2640 1 --2- 172.21.15.98:0/2847714418 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a2c0cf170 0x7f2a2c0b3270 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2a24009d90 tx=0x7f2a24003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:47.992 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.988+0000 7f2a297fa640 1 -- 172.21.15.98:0/2847714418 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a24047070 con 0x7f2a2c0cf170 2024-09-16T15:37:47.992 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.988+0000 7f2a297fa640 1 -- 172.21.15.98:0/2847714418 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2a24004250 con 0x7f2a2c0cf170 2024-09-16T15:37:47.992 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.988+0000 7f2a297fa640 1 -- 172.21.15.98:0/2847714418 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a24033050 con 0x7f2a2c0cf170 2024-09-16T15:37:47.992 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.988+0000 7f2a32b05640 1 -- 172.21.15.98:0/2847714418 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a2c0b1b10 con 0x7f2a2c0cf170 2024-09-16T15:37:47.992 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.988+0000 7f2a32b05640 1 -- 172.21.15.98:0/2847714418 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a2c1f2f90 con 0x7f2a2c0cf170 2024-09-16T15:37:47.992 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.989+0000 7f2a32b05640 1 -- 172.21.15.98:0/2847714418 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a2c071260 con 0x7f2a2c0cf170 2024-09-16T15:37:47.993 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.989+0000 7f2a297fa640 1 -- 172.21.15.98:0/2847714418 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7f2a2404a070 con 0x7f2a2c0cf170 2024-09-16T15:37:47.993 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.990+0000 7f2a297fa640 1 --2- 172.21.15.98:0/2847714418 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f2a10078850 0x7f2a1007ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:47.993 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.990+0000 7f2a297fa640 1 -- 172.21.15.98:0/2847714418 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f2a240bbc80 con 0x7f2a2c0cf170 2024-09-16T15:37:47.993 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.990+0000 7f2a308a1640 1 --2- 172.21.15.98:0/2847714418 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f2a10078850 0x7f2a1007ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:47.993 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.991+0000 7f2a308a1640 1 --2- 172.21.15.98:0/2847714418 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f2a10078850 0x7f2a1007ad10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c0d1350 tx=0x7f2a20009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:47.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:47.994+0000 7f2a297fa640 1 -- 172.21.15.98:0/2847714418 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7f2a2c1f6b60 con 0x7f2a2c0cf170 2024-09-16T15:37:48.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.169+0000 7f2a32b05640 1 -- 172.21.15.98:0/2847714418 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2a2c0c54d0 con 0x7f2a2c0cf170 2024-09-16T15:37:48.172 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.170+0000 7f2a297fa640 1 -- 172.21.15.98:0/2847714418 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16681 (secure 0 0 0) 0x7f2a240842f0 con 0x7f2a2c0cf170 2024-09-16T15:37:48.172 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:37:48.173 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":23,"fsid":"52a38a45-21d2-4cb0-bb3a-4fb8be3a08df","created":"2024-09-16T15:37:20.387654+0000","modified":"2024-09-16T15:37:45.512714+0000","last_up_change":"2024-09-16T15:37:33.417470+0000","last_in_change":"2024-09-16T15:37:23.430578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T15:37:34.725090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-16T15:37:42.223874+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-16T15:37:42.808291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a2d61df4-2577-47e6-a4ac-c36bbb85ab8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1967099790},{"type":"v1","addr":"172.21.15.98:6825","nonce":1967099790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1967099790},{"type":"v1","addr":"172.21.15.98:6827","nonce":1967099790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":1967099790},{"type":"v1","addr":"172.21.15.98:6831","nonce":1967099790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1967099790},{"type":"v1","addr":"172.21.15.98:6829","nonce":1967099790}]},"public_addr":"172.21.15.98:6825/1967099790","cluster_addr":"172.21.15.98:6827/1967099790","heartbeat_back_addr":"172.21.15.98:6831/1967099790","heartbeat_front_addr":"172.21.15.98:6829/1967099790","state":["exists","up"]},{"osd":1,"uuid":"bb3a68a5-c22f-442b-b292-7c272fe01ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":3571460482},{"type":"v1","addr":"172.21.15.98:6809","nonce":3571460482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":3571460482},{"type":"v1","addr":"172.21.15.98:6811","nonce":3571460482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":3571460482},{"type":"v1","addr":"172.21.15.98:6815","nonce":3571460482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":3571460482},{"type":"v1","addr":"172.21.15.98:6813","nonce":3571460482}]},"public_addr":"172.21.15.98:6809/3571460482","cluster_addr":"172.21.15.98:6811/3571460482","heartbeat_back_addr":"172.21.15.98:6815/3571460482","heartbeat_front_addr":"172.21.15.98:6813/3571460482","state":["exists","up"]},{"osd":2,"uuid":"c8429195-a480-409b-8e5f-8dc4c6abc0a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":2573210695},{"type":"v1","addr":"172.21.15.98:6801","nonce":2573210695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":2573210695},{"type":"v1","addr":"172.21.15.98:6803","nonce":2573210695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":2573210695},{"type":"v1","addr":"172.21.15.98:6807","nonce":2573210695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":2573210695},{"type":"v1","addr":"172.21.15.98:6805","nonce":2573210695}]},"public_addr":"172.21.15.98:6801/2573210695","cluster_addr":"172.21.15.98:6803/2573210695","heartbeat_back_addr":"172.21.15.98:6807/2573210695","heartbeat_front_addr":"172.21.15.98:6805/2573210695","state":["exists","up"]},{"osd":3,"uuid":"0e800d7b-096f-4f65-b3cc-c7cda3870de4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":3951374837},{"type":"v1","addr":"172.21.15.98:6817","nonce":3951374837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":3951374837},{"type":"v1","addr":"172.21.15.98:6819","nonce":3951374837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":3951374837},{"type":"v1","addr":"172.21.15.98:6823","nonce":3951374837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":3951374837},{"type":"v1","addr":"172.21.15.98:6821","nonce":3951374837}]},"public_addr":"172.21.15.98:6817/3951374837","cluster_addr":"172.21.15.98:6819/3951374837","heartbeat_back_addr":"172.21.15.98:6823/3951374837","heartbeat_front_addr":"172.21.15.98:6821/3951374837","state":["exists","up"]},{"osd":4,"uuid":"c7822e9b-8e29-48d9-b92a-e8f9c7bc5247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":724302036},{"type":"v1","addr":"172.21.15.135:6811","nonce":724302036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":724302036},{"type":"v1","addr":"172.21.15.135:6813","nonce":724302036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":724302036},{"type":"v1","addr":"172.21.15.135:6817","nonce":724302036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":724302036},{"type":"v1","addr":"172.21.15.135:6815","nonce":724302036}]},"public_addr":"172.21.15.135:6811/724302036","cluster_addr":"172.21.15.135:6813/724302036","heartbeat_back_addr":"172.21.15.135:6817/724302036","heartbeat_front_addr":"172.21.15.135:6815/724302036","state":["exists","up"]},{"osd":5,"uuid":"35805e02-484a-4404-a78f-aa44f4daa41f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3083482635},{"type":"v1","addr":"172.21.15.135:6803","nonce":3083482635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3083482635},{"type":"v1","addr":"172.21.15.135:6805","nonce":3083482635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3083482635},{"type":"v1","addr":"172.21.15.135:6809","nonce":3083482635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3083482635},{"type":"v1","addr":"172.21.15.135:6807","nonce":3083482635}]},"public_addr":"172.21.15.135:6803/3083482635","cluster_addr":"172.21.15.135:6805/3083482635","heartbeat_back_addr":"172.21.15.135:6809/3083482635","heartbeat_front_addr":"172.21.15.135:6807/3083482635","state":["exists","up"]},{"osd":6,"uuid":"6327ba84-aaeb-41fa-9717-188988ff2c4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3376376340},{"type":"v1","addr":"172.21.15.135:6819","nonce":3376376340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3376376340},{"type":"v1","addr":"172.21.15.135:6821","nonce":3376376340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":3376376340},{"type":"v1","addr":"172.21.15.135:6825","nonce":3376376340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3376376340},{"type":"v1","addr":"172.21.15.135:6823","nonce":3376376340}]},"public_addr":"172.21.15.135:6819/3376376340","cluster_addr":"172.21.15.135:6821/3376376340","heartbeat_back_addr":"172.21.15.135:6825/3376376340","heartbeat_front_addr":"172.21.15.135:6823/3376376340","state":["exists","up"]},{"osd":7,"uuid":"392d0958-dff9-4248-b3d8-a1201c10f354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2559837727},{"type":"v1","addr":"172.21.15.135:6827","nonce":2559837727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2559837727},{"type":"v1","addr":"172.21.15.135:6829","nonce":2559837727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":2559837727},{"type":"v1","addr":"172.21.15.135:6833","nonce":2559837727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2559837727},{"type":"v1","addr":"172.21.15.135:6831","nonce":2559837727}]},"public_addr":"172.21.15.135:6827/2559837727","cluster_addr":"172.21.15.135:6829/2559837727","heartbeat_back_addr":"172.21.15.135:6833/2559837727","heartbeat_front_addr":"172.21.15.135:6831/2559837727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.939904+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.717296+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.785817+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:30.211718+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.973359+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:30.250109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.699327+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:30.173063+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T15:37:48.175 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.172+0000 7f2a32b05640 1 -- 172.21.15.98:0/2847714418 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f2a10078850 msgr2=0x7f2a1007ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:48.175 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.172+0000 7f2a32b05640 1 --2- 172.21.15.98:0/2847714418 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f2a10078850 0x7f2a1007ad10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c0d1350 tx=0x7f2a20009040 comp rx=0 tx=0).stop 2024-09-16T15:37:48.175 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.172+0000 7f2a32b05640 1 -- 172.21.15.98:0/2847714418 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a2c0cf170 msgr2=0x7f2a2c0b3270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:48.175 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.172+0000 7f2a32b05640 1 --2- 172.21.15.98:0/2847714418 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a2c0cf170 0x7f2a2c0b3270 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2a24009d90 tx=0x7f2a24003f10 comp rx=0 tx=0).stop 2024-09-16T15:37:48.175 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.173+0000 7f2a32b05640 1 -- 172.21.15.98:0/2847714418 shutdown_connections 2024-09-16T15:37:48.175 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.173+0000 7f2a32b05640 1 --2- 172.21.15.98:0/2847714418 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a2c0cf170 0x7f2a2c0b3270 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:48.175 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.173+0000 7f2a32b05640 1 --2- 172.21.15.98:0/2847714418 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f2a10078850 0x7f2a1007ad10 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:48.175 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.173+0000 7f2a32b05640 1 --2- 172.21.15.98:0/2847714418 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a2c0b73c0 0x7f2a2c1f6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:48.175 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.173+0000 7f2a32b05640 1 --2- 172.21.15.98:0/2847714418 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2a2c071bf0 0x7f2a2c1f25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:48.175 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.173+0000 7f2a32b05640 1 -- 172.21.15.98:0/2847714418 >> 172.21.15.98:0/2847714418 conn(0x7f2a2c06d230 msgr2=0x7f2a2c0b5e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:48.175 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.173+0000 7f2a32b05640 1 -- 172.21.15.98:0/2847714418 shutdown_connections 2024-09-16T15:37:48.176 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.173+0000 7f2a32b05640 1 -- 172.21.15.98:0/2847714418 wait complete. 2024-09-16T15:37:48.185 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-16T15:37:48.186 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T15:37:48.286 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.284+0000 7ffaae29b640 1 -- 172.21.15.98:0/760070862 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa90004800 msgr2=0x7ffa90004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:48.286 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.284+0000 7ffaae29b640 1 --2- 172.21.15.98:0/760070862 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa90004800 0x7ffa90004c80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c001690 tx=0x7ffa90005830 comp rx=0 tx=0).stop 2024-09-16T15:37:48.286 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.284+0000 7ffaac838640 1 -- 172.21.15.98:0/760070862 reap_dead start 2024-09-16T15:37:48.286 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.284+0000 7ffaae29b640 1 -- 172.21.15.98:0/760070862 shutdown_connections 2024-09-16T15:37:48.286 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.284+0000 7ffaae29b640 1 -- 172.21.15.98:0/760070862 >> 172.21.15.98:0/760070862 conn(0x7ffaa80b2b90 msgr2=0x7ffaa80b2f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:48.286 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.284+0000 7ffaae29b640 1 -- 172.21.15.98:0/760070862 shutdown_connections 2024-09-16T15:37:48.286 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.284+0000 7ffaae29b640 1 -- 172.21.15.98:0/760070862 wait complete. 2024-09-16T15:37:48.287 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.285+0000 7ffaae29b640 1 Processor -- start 2024-09-16T15:37:48.287 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.285+0000 7ffaae29b640 1 -- start start 2024-09-16T15:37:48.289 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.286+0000 7ffaae29b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffa90004800 0x7ffaa8149d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:48.289 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.286+0000 7ffaae29b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffaa8070fd0 0x7ffaa815d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:48.289 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.286+0000 7ffaae29b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffaa815d920 0x7ffaa80c7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:48.289 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.286+0000 7ffaae29b640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa80706b0 con 0x7ffaa815d920 2024-09-16T15:37:48.289 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.286+0000 7ffaae29b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa8070530 con 0x7ffaa8070fd0 2024-09-16T15:37:48.289 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.286+0000 7ffaae29b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ffaa8070830 con 0x7ffa90004800 2024-09-16T15:37:48.290 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.286+0000 7ffaac838640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffaa815d920 0x7ffaa80c7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:48.290 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.286+0000 7ffaac838640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffaa815d920 0x7ffaa80c7f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59470/0 (socket says 172.21.15.98:59470) 2024-09-16T15:37:48.290 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.286+0000 7ffaac838640 1 -- 172.21.15.98:0/3853745371 learned_addr learned my addr 172.21.15.98:0/3853745371 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:37:48.290 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.286+0000 7ffaa77fe640 1 --2- 172.21.15.98:0/3853745371 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffaa8070fd0 0x7ffaa815d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:48.290 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.286+0000 7ffaa7fff640 1 --2- 172.21.15.98:0/3853745371 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffa90004800 0x7ffaa8149d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:48.290 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.286+0000 7ffaac838640 1 -- 172.21.15.98:0/3853745371 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffa90004800 msgr2=0x7ffaa8149d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:48.290 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.286+0000 7ffaac838640 1 --2- 172.21.15.98:0/3853745371 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffa90004800 0x7ffaa8149d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:48.290 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.286+0000 7ffaac838640 1 -- 172.21.15.98:0/3853745371 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffaa8070fd0 msgr2=0x7ffaa815d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:48.290 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.286+0000 7ffaac838640 1 --2- 172.21.15.98:0/3853745371 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffaa8070fd0 0x7ffaa815d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:48.290 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.286+0000 7ffaac838640 1 -- 172.21.15.98:0/3853745371 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaa80c6ef0 con 0x7ffaa815d920 2024-09-16T15:37:48.290 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.286+0000 7ffaac838640 1 --2- 172.21.15.98:0/3853745371 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffaa815d920 0x7ffaa80c7f90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ffaa0006fd0 tx=0x7ffaa0006720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:48.290 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.286+0000 7ffaa4ff9640 1 -- 172.21.15.98:0/3853745371 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa000fa80 con 0x7ffaa815d920 2024-09-16T15:37:48.290 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.287+0000 7ffaa4ff9640 1 -- 172.21.15.98:0/3853745371 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffaa000fc20 con 0x7ffaa815d920 2024-09-16T15:37:48.290 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.287+0000 7ffaae29b640 1 -- 172.21.15.98:0/3853745371 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffaa80c71d0 con 0x7ffaa815d920 2024-09-16T15:37:48.291 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.287+0000 7ffaa4ff9640 1 -- 172.21.15.98:0/3853745371 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa0011430 con 0x7ffaa815d920 2024-09-16T15:37:48.291 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.287+0000 7ffaae29b640 1 -- 172.21.15.98:0/3853745371 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffaa80c7790 con 0x7ffaa815d920 2024-09-16T15:37:48.291 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.288+0000 7ffaae29b640 1 -- 172.21.15.98:0/3853745371 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffaa8070dc0 con 0x7ffaa815d920 2024-09-16T15:37:48.291 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.288+0000 7ffaa4ff9640 1 -- 172.21.15.98:0/3853745371 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7ffaa00115d0 con 0x7ffaa815d920 2024-09-16T15:37:48.292 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.289+0000 7ffaa4ff9640 1 --2- 172.21.15.98:0/3853745371 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7ffa94078880 0x7ffa9407ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:48.292 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.289+0000 7ffaa4ff9640 1 -- 172.21.15.98:0/3853745371 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7ffaa009b150 con 0x7ffaa815d920 2024-09-16T15:37:48.292 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.289+0000 7ffaa7fff640 1 --2- 172.21.15.98:0/3853745371 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7ffa94078880 0x7ffa9407ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:48.292 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.289+0000 7ffaa7fff640 1 --2- 172.21.15.98:0/3853745371 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7ffa94078880 0x7ffa9407ad40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ffaa815e370 tx=0x7ffa98005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:48.295 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.293+0000 7ffaa4ff9640 1 -- 172.21.15.98:0/3853745371 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7ffaa0063200 con 0x7ffaa815d920 2024-09-16T15:37:48.467 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.465+0000 7ffaae29b640 1 -- 172.21.15.98:0/3853745371 --> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ffaa80ccf30 con 0x7ffa94078880 2024-09-16T15:37:48.471 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.470+0000 7ffaa4ff9640 1 -- 172.21.15.98:0/3853745371 <== mgr.4100 v2:172.21.15.135:6800/699234772 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+245613 (secure 0 0 0) 0x7ffaa80ccf30 con 0x7ffa94078880 2024-09-16T15:37:48.474 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:37:48.475 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2024-09-16T15:37:48.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.473+0000 7ffaae29b640 1 -- 172.21.15.98:0/3853745371 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7ffa94078880 msgr2=0x7ffa9407ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:48.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.473+0000 7ffaae29b640 1 --2- 172.21.15.98:0/3853745371 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7ffa94078880 0x7ffa9407ad40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ffaa815e370 tx=0x7ffa98005f90 comp rx=0 tx=0).stop 2024-09-16T15:37:48.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.473+0000 7ffaae29b640 1 -- 172.21.15.98:0/3853745371 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffaa815d920 msgr2=0x7ffaa80c7f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:48.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.473+0000 7ffaae29b640 1 --2- 172.21.15.98:0/3853745371 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffaa815d920 0x7ffaa80c7f90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ffaa0006fd0 tx=0x7ffaa0006720 comp rx=0 tx=0).stop 2024-09-16T15:37:48.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.473+0000 7ffaae29b640 1 -- 172.21.15.98:0/3853745371 shutdown_connections 2024-09-16T15:37:48.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.473+0000 7ffaae29b640 1 --2- 172.21.15.98:0/3853745371 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffaa815d920 0x7ffaa80c7f90 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:48.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.473+0000 7ffaae29b640 1 --2- 172.21.15.98:0/3853745371 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7ffa94078880 0x7ffa9407ad40 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:48.478 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.473+0000 7ffaae29b640 1 --2- 172.21.15.98:0/3853745371 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffaa8070fd0 0x7ffaa815d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:48.478 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.473+0000 7ffaae29b640 1 --2- 172.21.15.98:0/3853745371 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffa90004800 0x7ffaa8149d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:48.478 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.473+0000 7ffaae29b640 1 -- 172.21.15.98:0/3853745371 >> 172.21.15.98:0/3853745371 conn(0x7ffaa80b2b90 msgr2=0x7ffaa80cbe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:48.478 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.473+0000 7ffaae29b640 1 -- 172.21.15.98:0/3853745371 shutdown_connections 2024-09-16T15:37:48.478 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.473+0000 7ffaae29b640 1 -- 172.21.15.98:0/3853745371 wait complete. 2024-09-16T15:37:48.485 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-16T15:37:46.709120+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":174,"acting":174,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":7,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":218940,"kb_used_data":2708,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755780,"statfs":{"total":773094113280,"available":772869918720,"internally_reserved":0,"allocated":2772992,"data_stored":1682549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.219541"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.506408+0000","last_change":"2024-09-16T15:37:43.506408+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.506408+0000","last_undegraded":"2024-09-16T15:37:43.506408+0000","last_fullsized":"2024-09-16T15:37:43.506408+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.506105+0000","last_change":"2024-09-16T15:37:43.506105+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.506105+0000","last_undegraded":"2024-09-16T15:37:43.506105+0000","last_fullsized":"2024-09-16T15:37:43.506105+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.503720+0000","last_change":"2024-09-16T15:37:43.503720+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.503720+0000","last_undegraded":"2024-09-16T15:37:43.503720+0000","last_fullsized":"2024-09-16T15:37:43.503720+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.503566+0000","last_change":"2024-09-16T15:37:43.503566+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.503566+0000","last_undegraded":"2024-09-16T15:37:43.503566+0000","last_fullsized":"2024-09-16T15:37:43.503566+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.502948+0000","last_change":"2024-09-16T15:37:43.502948+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.502948+0000","last_undegraded":"2024-09-16T15:37:43.502948+0000","last_fullsized":"2024-09-16T15:37:43.502948+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.503197+0000","last_change":"2024-09-16T15:37:43.503197+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.503197+0000","last_undegraded":"2024-09-16T15:37:43.503197+0000","last_fullsized":"2024-09-16T15:37:43.503197+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.504333+0000","last_change":"2024-09-16T15:37:43.504333+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.504333+0000","last_undegraded":"2024-09-16T15:37:43.504333+0000","last_fullsized":"2024-09-16T15:37:43.504333+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.505582+0000","last_change":"2024-09-16T15:37:43.505582+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.505582+0000","last_undegraded":"2024-09-16T15:37:43.505582+0000","last_fullsized":"2024-09-16T15:37:43.505582+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.501405+0000","last_change":"2024-09-16T15:37:43.501405+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.501405+0000","last_undegraded":"2024-09-16T15:37:43.501405+0000","last_fullsized":"2024-09-16T15:37:43.501405+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.505383+0000","last_change":"2024-09-16T15:37:43.505383+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.505383+0000","last_undegraded":"2024-09-16T15:37:43.505383+0000","last_fullsized":"2024-09-16T15:37:43.505383+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.505413+0000","last_change":"2024-09-16T15:37:43.505413+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.505413+0000","last_undegraded":"2024-09-16T15:37:43.505413+0000","last_fullsized":"2024-09-16T15:37:43.505413+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.506807+0000","last_change":"2024-09-16T15:37:43.506807+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.506807+0000","last_undegraded":"2024-09-16T15:37:43.506807+0000","last_fullsized":"2024-09-16T15:37:43.506807+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:37:43.489547+0000","last_change":"2024-09-16T15:37:43.489547+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.489547+0000","last_undegraded":"2024-09-16T15:37:43.489547+0000","last_fullsized":"2024-09-16T15:37:43.489547+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:37:43.489547+0000","last_change":"2024-09-16T15:37:43.489547+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.489547+0000","last_undegraded":"2024-09-16T15:37:43.489547+0000","last_fullsized":"2024-09-16T15:37:43.489547+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.503610+0000","last_change":"2024-09-16T15:37:43.503610+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.503610+0000","last_undegraded":"2024-09-16T15:37:43.503610+0000","last_fullsized":"2024-09-16T15:37:43.503610+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.510644+0000","last_change":"2024-09-16T15:37:43.510644+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.510644+0000","last_undegraded":"2024-09-16T15:37:43.510644+0000","last_fullsized":"2024-09-16T15:37:43.510644+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.509791+0000","last_change":"2024-09-16T15:37:43.509791+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.509791+0000","last_undegraded":"2024-09-16T15:37:43.509791+0000","last_fullsized":"2024-09-16T15:37:43.509791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.509988+0000","last_change":"2024-09-16T15:37:43.509988+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.509988+0000","last_undegraded":"2024-09-16T15:37:43.509988+0000","last_fullsized":"2024-09-16T15:37:43.509988+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.508646+0000","last_change":"2024-09-16T15:37:43.508646+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.508646+0000","last_undegraded":"2024-09-16T15:37:43.508646+0000","last_fullsized":"2024-09-16T15:37:43.508646+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.506205+0000","last_change":"2024-09-16T15:37:43.506205+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.506205+0000","last_undegraded":"2024-09-16T15:37:43.506205+0000","last_fullsized":"2024-09-16T15:37:43.506205+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.508778+0000","last_change":"2024-09-16T15:37:43.508778+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.508778+0000","last_undegraded":"2024-09-16T15:37:43.508778+0000","last_fullsized":"2024-09-16T15:37:43.508778+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.502662+0000","last_change":"2024-09-16T15:37:43.502662+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.502662+0000","last_undegraded":"2024-09-16T15:37:43.502662+0000","last_fullsized":"2024-09-16T15:37:43.502662+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.502763+0000","last_change":"2024-09-16T15:37:43.502763+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.502763+0000","last_undegraded":"2024-09-16T15:37:43.502763+0000","last_fullsized":"2024-09-16T15:37:43.502763+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.506771+0000","last_change":"2024-09-16T15:37:43.506771+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.506771+0000","last_undegraded":"2024-09-16T15:37:43.506771+0000","last_fullsized":"2024-09-16T15:37:43.506771+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.507085+0000","last_change":"2024-09-16T15:37:43.507085+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.507085+0000","last_undegraded":"2024-09-16T15:37:43.507085+0000","last_fullsized":"2024-09-16T15:37:43.507085+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.504681+0000","last_change":"2024-09-16T15:37:43.504681+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.504681+0000","last_undegraded":"2024-09-16T15:37:43.504681+0000","last_fullsized":"2024-09-16T15:37:43.504681+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:37:43.489547+0000","last_change":"2024-09-16T15:37:43.489547+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.489547+0000","last_undegraded":"2024-09-16T15:37:43.489547+0000","last_fullsized":"2024-09-16T15:37:43.489547+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:37:43.489547+0000","last_change":"2024-09-16T15:37:43.489547+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.489547+0000","last_undegraded":"2024-09-16T15:37:43.489547+0000","last_fullsized":"2024-09-16T15:37:43.489547+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.504364+0000","last_change":"2024-09-16T15:37:43.504364+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.504364+0000","last_undegraded":"2024-09-16T15:37:43.504364+0000","last_fullsized":"2024-09-16T15:37:43.504364+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.508166+0000","last_change":"2024-09-16T15:37:43.508166+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.508166+0000","last_undegraded":"2024-09-16T15:37:43.508166+0000","last_fullsized":"2024-09-16T15:37:43.508166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.509609+0000","last_change":"2024-09-16T15:37:43.509609+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.509609+0000","last_undegraded":"2024-09-16T15:37:43.509609+0000","last_fullsized":"2024-09-16T15:37:43.509609+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.502933+0000","last_change":"2024-09-16T15:37:43.502933+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.502933+0000","last_undegraded":"2024-09-16T15:37:43.502933+0000","last_fullsized":"2024-09-16T15:37:43.502933+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.501835+0000","last_change":"2024-09-16T15:37:43.501835+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.501835+0000","last_undegraded":"2024-09-16T15:37:43.501835+0000","last_fullsized":"2024-09-16T15:37:43.501835+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.513635+0000","last_change":"2024-09-16T15:37:43.510897+0000","last_active":"2024-09-16T15:37:43.513635+0000","last_peered":"2024-09-16T15:37:43.513635+0000","last_clean":"2024-09-16T15:37:43.513635+0000","last_became_active":"2024-09-16T15:37:43.510468+0000","last_became_peered":"2024-09-16T15:37:43.510468+0000","last_unstale":"2024-09-16T15:37:43.513635+0000","last_undegraded":"2024-09-16T15:37:43.513635+0000","last_fullsized":"2024-09-16T15:37:43.513635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:58:36.781822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.507082+0000","last_change":"2024-09-16T15:37:43.507082+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.507082+0000","last_undegraded":"2024-09-16T15:37:43.507082+0000","last_fullsized":"2024-09-16T15:37:43.507082+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.523221+0000","last_change":"2024-09-16T15:37:43.521672+0000","last_active":"2024-09-16T15:37:43.523221+0000","last_peered":"2024-09-16T15:37:43.523221+0000","last_clean":"2024-09-16T15:37:43.523221+0000","last_became_active":"2024-09-16T15:37:43.521418+0000","last_became_peered":"2024-09-16T15:37:43.521418+0000","last_unstale":"2024-09-16T15:37:43.523221+0000","last_undegraded":"2024-09-16T15:37:43.523221+0000","last_fullsized":"2024-09-16T15:37:43.523221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:03:21.436525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:37:42.482667+0000","last_change":"2024-09-16T15:37:42.482667+0000","last_active":"2024-09-16T15:37:42.482667+0000","last_peered":"2024-09-16T15:37:42.482667+0000","last_clean":"2024-09-16T15:37:42.482667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:42.482667+0000","last_undegraded":"2024-09-16T15:37:42.482667+0000","last_fullsized":"2024-09-16T15:37:42.482667+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.504239+0000","last_change":"2024-09-16T15:37:43.504239+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.504239+0000","last_undegraded":"2024-09-16T15:37:43.504239+0000","last_fullsized":"2024-09-16T15:37:43.504239+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.521219+0000","last_change":"2024-09-16T15:37:43.519319+0000","last_active":"2024-09-16T15:37:43.521219+0000","last_peered":"2024-09-16T15:37:43.521219+0000","last_clean":"2024-09-16T15:37:43.521219+0000","last_became_active":"2024-09-16T15:37:43.518711+0000","last_became_peered":"2024-09-16T15:37:43.518711+0000","last_unstale":"2024-09-16T15:37:43.521219+0000","last_undegraded":"2024-09-16T15:37:43.521219+0000","last_fullsized":"2024-09-16T15:37:43.521219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:25:01.970817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.507140+0000","last_change":"2024-09-16T15:37:43.507140+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.507140+0000","last_undegraded":"2024-09-16T15:37:43.507140+0000","last_fullsized":"2024-09-16T15:37:43.507140+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.516204+0000","last_change":"2024-09-16T15:37:43.514400+0000","last_active":"2024-09-16T15:37:43.516204+0000","last_peered":"2024-09-16T15:37:43.516204+0000","last_clean":"2024-09-16T15:37:43.516204+0000","last_became_active":"2024-09-16T15:37:43.514124+0000","last_became_peered":"2024-09-16T15:37:43.514124+0000","last_unstale":"2024-09-16T15:37:43.516204+0000","last_undegraded":"2024-09-16T15:37:43.516204+0000","last_fullsized":"2024-09-16T15:37:43.516204+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:58:36.781822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.504279+0000","last_change":"2024-09-16T15:37:43.504279+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.504279+0000","last_undegraded":"2024-09-16T15:37:43.504279+0000","last_fullsized":"2024-09-16T15:37:43.504279+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.517060+0000","last_change":"2024-09-16T15:37:43.515976+0000","last_active":"2024-09-16T15:37:43.517060+0000","last_peered":"2024-09-16T15:37:43.517060+0000","last_clean":"2024-09-16T15:37:43.517060+0000","last_became_active":"2024-09-16T15:37:43.515426+0000","last_became_peered":"2024-09-16T15:37:43.515426+0000","last_unstale":"2024-09-16T15:37:43.517060+0000","last_undegraded":"2024-09-16T15:37:43.517060+0000","last_fullsized":"2024-09-16T15:37:43.517060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T21:42:39.448578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.503121+0000","last_change":"2024-09-16T15:37:43.503121+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.503121+0000","last_undegraded":"2024-09-16T15:37:43.503121+0000","last_fullsized":"2024-09-16T15:37:43.503121+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.522596+0000","last_change":"2024-09-16T15:37:43.516257+0000","last_active":"2024-09-16T15:37:43.522596+0000","last_peered":"2024-09-16T15:37:43.522596+0000","last_clean":"2024-09-16T15:37:43.522596+0000","last_became_active":"2024-09-16T15:37:43.515944+0000","last_became_peered":"2024-09-16T15:37:43.515944+0000","last_unstale":"2024-09-16T15:37:43.522596+0000","last_undegraded":"2024-09-16T15:37:43.522596+0000","last_fullsized":"2024-09-16T15:37:43.522596+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:58:36.781822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.502789+0000","last_change":"2024-09-16T15:37:43.502789+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.502789+0000","last_undegraded":"2024-09-16T15:37:43.502789+0000","last_fullsized":"2024-09-16T15:37:43.502789+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.516162+0000","last_change":"2024-09-16T15:37:43.514513+0000","last_active":"2024-09-16T15:37:43.516162+0000","last_peered":"2024-09-16T15:37:43.516162+0000","last_clean":"2024-09-16T15:37:43.516162+0000","last_became_active":"2024-09-16T15:37:43.514196+0000","last_became_peered":"2024-09-16T15:37:43.514196+0000","last_unstale":"2024-09-16T15:37:43.516162+0000","last_undegraded":"2024-09-16T15:37:43.516162+0000","last_fullsized":"2024-09-16T15:37:43.516162+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:43:24.500518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.504417+0000","last_change":"2024-09-16T15:37:43.504417+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.504417+0000","last_undegraded":"2024-09-16T15:37:43.504417+0000","last_fullsized":"2024-09-16T15:37:43.504417+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.525199+0000","last_change":"2024-09-16T15:37:43.521768+0000","last_active":"2024-09-16T15:37:43.525199+0000","last_peered":"2024-09-16T15:37:43.525199+0000","last_clean":"2024-09-16T15:37:43.525199+0000","last_became_active":"2024-09-16T15:37:43.521541+0000","last_became_peered":"2024-09-16T15:37:43.521541+0000","last_unstale":"2024-09-16T15:37:43.525199+0000","last_undegraded":"2024-09-16T15:37:43.525199+0000","last_fullsized":"2024-09-16T15:37:43.525199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:24:48.654268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:37:43.489547+0000","last_change":"2024-09-16T15:37:43.489547+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.489547+0000","last_undegraded":"2024-09-16T15:37:43.489547+0000","last_fullsized":"2024-09-16T15:37:43.489547+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.521972+0000","last_change":"2024-09-16T15:37:43.519519+0000","last_active":"2024-09-16T15:37:43.521972+0000","last_peered":"2024-09-16T15:37:43.521972+0000","last_clean":"2024-09-16T15:37:43.521972+0000","last_became_active":"2024-09-16T15:37:43.518682+0000","last_became_peered":"2024-09-16T15:37:43.518682+0000","last_unstale":"2024-09-16T15:37:43.521972+0000","last_undegraded":"2024-09-16T15:37:43.521972+0000","last_fullsized":"2024-09-16T15:37:43.521972+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T21:23:32.133055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.508570+0000","last_change":"2024-09-16T15:37:43.508570+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.508570+0000","last_undegraded":"2024-09-16T15:37:43.508570+0000","last_fullsized":"2024-09-16T15:37:43.508570+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.521229+0000","last_change":"2024-09-16T15:37:43.519576+0000","last_active":"2024-09-16T15:37:43.521229+0000","last_peered":"2024-09-16T15:37:43.521229+0000","last_clean":"2024-09-16T15:37:43.521229+0000","last_became_active":"2024-09-16T15:37:43.517609+0000","last_became_peered":"2024-09-16T15:37:43.517609+0000","last_unstale":"2024-09-16T15:37:43.521229+0000","last_undegraded":"2024-09-16T15:37:43.521229+0000","last_fullsized":"2024-09-16T15:37:43.521229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:37:32.374134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.501758+0000","last_change":"2024-09-16T15:37:43.501758+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.501758+0000","last_undegraded":"2024-09-16T15:37:43.501758+0000","last_fullsized":"2024-09-16T15:37:43.501758+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.517876+0000","last_change":"2024-09-16T15:37:43.514266+0000","last_active":"2024-09-16T15:37:43.517876+0000","last_peered":"2024-09-16T15:37:43.517876+0000","last_clean":"2024-09-16T15:37:43.517876+0000","last_became_active":"2024-09-16T15:37:43.513980+0000","last_became_peered":"2024-09-16T15:37:43.513980+0000","last_unstale":"2024-09-16T15:37:43.517876+0000","last_undegraded":"2024-09-16T15:37:43.517876+0000","last_fullsized":"2024-09-16T15:37:43.517876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:24:48.654268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.504309+0000","last_change":"2024-09-16T15:37:43.504309+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.504309+0000","last_undegraded":"2024-09-16T15:37:43.504309+0000","last_fullsized":"2024-09-16T15:37:43.504309+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.521176+0000","last_change":"2024-09-16T15:37:43.518884+0000","last_active":"2024-09-16T15:37:43.521176+0000","last_peered":"2024-09-16T15:37:43.521176+0000","last_clean":"2024-09-16T15:37:43.521176+0000","last_became_active":"2024-09-16T15:37:43.517494+0000","last_became_peered":"2024-09-16T15:37:43.517494+0000","last_unstale":"2024-09-16T15:37:43.521176+0000","last_undegraded":"2024-09-16T15:37:43.521176+0000","last_fullsized":"2024-09-16T15:37:43.521176+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:45:09.277422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.503176+0000","last_change":"2024-09-16T15:37:43.503176+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.503176+0000","last_undegraded":"2024-09-16T15:37:43.503176+0000","last_fullsized":"2024-09-16T15:37:43.503176+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.517928+0000","last_change":"2024-09-16T15:37:43.514250+0000","last_active":"2024-09-16T15:37:43.517928+0000","last_peered":"2024-09-16T15:37:43.517928+0000","last_clean":"2024-09-16T15:37:43.517928+0000","last_became_active":"2024-09-16T15:37:43.513954+0000","last_became_peered":"2024-09-16T15:37:43.513954+0000","last_unstale":"2024-09-16T15:37:43.517928+0000","last_undegraded":"2024-09-16T15:37:43.517928+0000","last_fullsized":"2024-09-16T15:37:43.517928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:58:36.781822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.505682+0000","last_change":"2024-09-16T15:37:43.505682+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.505682+0000","last_undegraded":"2024-09-16T15:37:43.505682+0000","last_fullsized":"2024-09-16T15:37:43.505682+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.516491+0000","last_change":"2024-09-16T15:37:43.514330+0000","last_active":"2024-09-16T15:37:43.516491+0000","last_peered":"2024-09-16T15:37:43.516491+0000","last_clean":"2024-09-16T15:37:43.516491+0000","last_became_active":"2024-09-16T15:37:43.513900+0000","last_became_peered":"2024-09-16T15:37:43.513900+0000","last_unstale":"2024-09-16T15:37:43.516491+0000","last_undegraded":"2024-09-16T15:37:43.516491+0000","last_fullsized":"2024-09-16T15:37:43.516491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T23:50:34.279091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.505063+0000","last_change":"2024-09-16T15:37:43.505063+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.505063+0000","last_undegraded":"2024-09-16T15:37:43.505063+0000","last_fullsized":"2024-09-16T15:37:43.505063+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:37:42.482667+0000","last_change":"2024-09-16T15:37:42.482667+0000","last_active":"2024-09-16T15:37:42.482667+0000","last_peered":"2024-09-16T15:37:42.482667+0000","last_clean":"2024-09-16T15:37:42.482667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:42.482667+0000","last_undegraded":"2024-09-16T15:37:42.482667+0000","last_fullsized":"2024-09-16T15:37:42.482667+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.506168+0000","last_change":"2024-09-16T15:37:43.506168+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.506168+0000","last_undegraded":"2024-09-16T15:37:43.506168+0000","last_fullsized":"2024-09-16T15:37:43.506168+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":107,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.498711+0000","last_change":"2024-09-16T15:37:37.258601+0000","last_active":"2024-09-16T15:37:43.498711+0000","last_peered":"2024-09-16T15:37:43.498711+0000","last_clean":"2024-09-16T15:37:43.498711+0000","last_became_active":"2024-09-16T15:37:37.257584+0000","last_became_peered":"2024-09-16T15:37:37.257584+0000","last_unstale":"2024-09-16T15:37:43.498711+0000","last_undegraded":"2024-09-16T15:37:43.498711+0000","last_fullsized":"2024-09-16T15:37:43.498711+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:35.447043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:35.447043+0000","last_clean_scrub_stamp":"2024-09-16T15:37:35.447043+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:43:17.464894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.513875+0000","last_change":"2024-09-16T15:37:43.510139+0000","last_active":"2024-09-16T15:37:43.513875+0000","last_peered":"2024-09-16T15:37:43.513875+0000","last_clean":"2024-09-16T15:37:43.513875+0000","last_became_active":"2024-09-16T15:37:43.509820+0000","last_became_peered":"2024-09-16T15:37:43.509820+0000","last_unstale":"2024-09-16T15:37:43.513875+0000","last_undegraded":"2024-09-16T15:37:43.513875+0000","last_fullsized":"2024-09-16T15:37:43.513875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:18:57.765147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.507336+0000","last_change":"2024-09-16T15:37:43.507336+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.507336+0000","last_undegraded":"2024-09-16T15:37:43.507336+0000","last_fullsized":"2024-09-16T15:37:43.507336+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.521246+0000","last_change":"2024-09-16T15:37:43.519442+0000","last_active":"2024-09-16T15:37:43.521246+0000","last_peered":"2024-09-16T15:37:43.521246+0000","last_clean":"2024-09-16T15:37:43.521246+0000","last_became_active":"2024-09-16T15:37:43.519204+0000","last_became_peered":"2024-09-16T15:37:43.519204+0000","last_unstale":"2024-09-16T15:37:43.521246+0000","last_undegraded":"2024-09-16T15:37:43.521246+0000","last_fullsized":"2024-09-16T15:37:43.521246+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:42:35.749344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:37:43.489547+0000","last_change":"2024-09-16T15:37:43.489547+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.489547+0000","last_undegraded":"2024-09-16T15:37:43.489547+0000","last_fullsized":"2024-09-16T15:37:43.489547+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.522564+0000","last_change":"2024-09-16T15:37:43.515953+0000","last_active":"2024-09-16T15:37:43.522564+0000","last_peered":"2024-09-16T15:37:43.522564+0000","last_clean":"2024-09-16T15:37:43.522564+0000","last_became_active":"2024-09-16T15:37:43.515662+0000","last_became_peered":"2024-09-16T15:37:43.515662+0000","last_unstale":"2024-09-16T15:37:43.522564+0000","last_undegraded":"2024-09-16T15:37:43.522564+0000","last_fullsized":"2024-09-16T15:37:43.522564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:18:57.765147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.505160+0000","last_change":"2024-09-16T15:37:43.505160+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.505160+0000","last_undegraded":"2024-09-16T15:37:43.505160+0000","last_fullsized":"2024-09-16T15:37:43.505160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.514888+0000","last_change":"2024-09-16T15:37:43.513231+0000","last_active":"2024-09-16T15:37:43.514888+0000","last_peered":"2024-09-16T15:37:43.514888+0000","last_clean":"2024-09-16T15:37:43.514888+0000","last_became_active":"2024-09-16T15:37:43.512954+0000","last_became_peered":"2024-09-16T15:37:43.512954+0000","last_unstale":"2024-09-16T15:37:43.514888+0000","last_undegraded":"2024-09-16T15:37:43.514888+0000","last_fullsized":"2024-09-16T15:37:43.514888+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:58:36.781822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.503500+0000","last_change":"2024-09-16T15:37:43.503500+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.503500+0000","last_undegraded":"2024-09-16T15:37:43.503500+0000","last_fullsized":"2024-09-16T15:37:43.503500+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.513599+0000","last_change":"2024-09-16T15:37:43.510480+0000","last_active":"2024-09-16T15:37:43.513599+0000","last_peered":"2024-09-16T15:37:43.513599+0000","last_clean":"2024-09-16T15:37:43.513599+0000","last_became_active":"2024-09-16T15:37:43.510223+0000","last_became_peered":"2024-09-16T15:37:43.510223+0000","last_unstale":"2024-09-16T15:37:43.513599+0000","last_undegraded":"2024-09-16T15:37:43.513599+0000","last_fullsized":"2024-09-16T15:37:43.513599+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:18:57.765147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.503364+0000","last_change":"2024-09-16T15:37:43.503364+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.503364+0000","last_undegraded":"2024-09-16T15:37:43.503364+0000","last_fullsized":"2024-09-16T15:37:43.503364+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.516668+0000","last_change":"2024-09-16T15:37:43.515757+0000","last_active":"2024-09-16T15:37:43.516668+0000","last_peered":"2024-09-16T15:37:43.516668+0000","last_clean":"2024-09-16T15:37:43.516668+0000","last_became_active":"2024-09-16T15:37:43.515199+0000","last_became_peered":"2024-09-16T15:37:43.515199+0000","last_unstale":"2024-09-16T15:37:43.516668+0000","last_undegraded":"2024-09-16T15:37:43.516668+0000","last_fullsized":"2024-09-16T15:37:43.516668+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T23:50:34.279091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:37:43.489547+0000","last_change":"2024-09-16T15:37:43.489547+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.489547+0000","last_undegraded":"2024-09-16T15:37:43.489547+0000","last_fullsized":"2024-09-16T15:37:43.489547+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.522756+0000","last_change":"2024-09-16T15:37:43.518081+0000","last_active":"2024-09-16T15:37:43.522756+0000","last_peered":"2024-09-16T15:37:43.522756+0000","last_clean":"2024-09-16T15:37:43.522756+0000","last_became_active":"2024-09-16T15:37:43.517744+0000","last_became_peered":"2024-09-16T15:37:43.517744+0000","last_unstale":"2024-09-16T15:37:43.522756+0000","last_undegraded":"2024-09-16T15:37:43.522756+0000","last_fullsized":"2024-09-16T15:37:43.522756+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:08:31.665964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.508877+0000","last_change":"2024-09-16T15:37:43.508877+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.508877+0000","last_undegraded":"2024-09-16T15:37:43.508877+0000","last_fullsized":"2024-09-16T15:37:43.508877+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.521293+0000","last_change":"2024-09-16T15:37:43.519357+0000","last_active":"2024-09-16T15:37:43.521293+0000","last_peered":"2024-09-16T15:37:43.521293+0000","last_clean":"2024-09-16T15:37:43.521293+0000","last_became_active":"2024-09-16T15:37:43.519050+0000","last_became_peered":"2024-09-16T15:37:43.519050+0000","last_unstale":"2024-09-16T15:37:43.521293+0000","last_undegraded":"2024-09-16T15:37:43.521293+0000","last_fullsized":"2024-09-16T15:37:43.521293+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:08:31.665964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.508507+0000","last_change":"2024-09-16T15:37:43.508507+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.508507+0000","last_undegraded":"2024-09-16T15:37:43.508507+0000","last_fullsized":"2024-09-16T15:37:43.508507+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.521054+0000","last_change":"2024-09-16T15:37:43.517924+0000","last_active":"2024-09-16T15:37:43.521054+0000","last_peered":"2024-09-16T15:37:43.521054+0000","last_clean":"2024-09-16T15:37:43.521054+0000","last_became_active":"2024-09-16T15:37:43.516036+0000","last_became_peered":"2024-09-16T15:37:43.516036+0000","last_unstale":"2024-09-16T15:37:43.521054+0000","last_undegraded":"2024-09-16T15:37:43.521054+0000","last_fullsized":"2024-09-16T15:37:43.521054+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T23:52:54.008046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.503358+0000","last_change":"2024-09-16T15:37:43.503358+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.503358+0000","last_undegraded":"2024-09-16T15:37:43.503358+0000","last_fullsized":"2024-09-16T15:37:43.503358+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.522744+0000","last_change":"2024-09-16T15:37:43.518084+0000","last_active":"2024-09-16T15:37:43.522744+0000","last_peered":"2024-09-16T15:37:43.522744+0000","last_clean":"2024-09-16T15:37:43.522744+0000","last_became_active":"2024-09-16T15:37:43.517773+0000","last_became_peered":"2024-09-16T15:37:43.517773+0000","last_unstale":"2024-09-16T15:37:43.522744+0000","last_undegraded":"2024-09-16T15:37:43.522744+0000","last_fullsized":"2024-09-16T15:37:43.522744+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:25:01.970817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.507353+0000","last_change":"2024-09-16T15:37:43.507353+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.507353+0000","last_undegraded":"2024-09-16T15:37:43.507353+0000","last_fullsized":"2024-09-16T15:37:43.507353+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:37:42.482667+0000","last_change":"2024-09-16T15:37:42.482667+0000","last_active":"2024-09-16T15:37:42.482667+0000","last_peered":"2024-09-16T15:37:42.482667+0000","last_clean":"2024-09-16T15:37:42.482667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:42.482667+0000","last_undegraded":"2024-09-16T15:37:42.482667+0000","last_fullsized":"2024-09-16T15:37:42.482667+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.510415+0000","last_change":"2024-09-16T15:37:43.510415+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.510415+0000","last_undegraded":"2024-09-16T15:37:43.510415+0000","last_fullsized":"2024-09-16T15:37:43.510415+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.514961+0000","last_change":"2024-09-16T15:37:43.513406+0000","last_active":"2024-09-16T15:37:43.514961+0000","last_peered":"2024-09-16T15:37:43.514961+0000","last_clean":"2024-09-16T15:37:43.514961+0000","last_became_active":"2024-09-16T15:37:43.512994+0000","last_became_peered":"2024-09-16T15:37:43.512994+0000","last_unstale":"2024-09-16T15:37:43.514961+0000","last_undegraded":"2024-09-16T15:37:43.514961+0000","last_fullsized":"2024-09-16T15:37:43.514961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:24:48.654268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.507703+0000","last_change":"2024-09-16T15:37:43.507703+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.507703+0000","last_undegraded":"2024-09-16T15:37:43.507703+0000","last_fullsized":"2024-09-16T15:37:43.507703+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.507590+0000","last_change":"2024-09-16T15:37:43.507590+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.507590+0000","last_undegraded":"2024-09-16T15:37:43.507590+0000","last_fullsized":"2024-09-16T15:37:43.507590+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.517270+0000","last_change":"2024-09-16T15:37:43.512302+0000","last_active":"2024-09-16T15:37:43.517270+0000","last_peered":"2024-09-16T15:37:43.517270+0000","last_clean":"2024-09-16T15:37:43.517270+0000","last_became_active":"2024-09-16T15:37:43.511884+0000","last_became_peered":"2024-09-16T15:37:43.511884+0000","last_unstale":"2024-09-16T15:37:43.517270+0000","last_undegraded":"2024-09-16T15:37:43.517270+0000","last_fullsized":"2024-09-16T15:37:43.517270+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:43:24.500518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.501832+0000","last_change":"2024-09-16T15:37:43.501832+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.501832+0000","last_undegraded":"2024-09-16T15:37:43.501832+0000","last_fullsized":"2024-09-16T15:37:43.501832+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.521108+0000","last_change":"2024-09-16T15:37:43.518058+0000","last_active":"2024-09-16T15:37:43.521108+0000","last_peered":"2024-09-16T15:37:43.521108+0000","last_clean":"2024-09-16T15:37:43.521108+0000","last_became_active":"2024-09-16T15:37:43.517743+0000","last_became_peered":"2024-09-16T15:37:43.517743+0000","last_unstale":"2024-09-16T15:37:43.521108+0000","last_undegraded":"2024-09-16T15:37:43.521108+0000","last_fullsized":"2024-09-16T15:37:43.521108+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:44:54.808566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.506222+0000","last_change":"2024-09-16T15:37:43.506222+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.506222+0000","last_undegraded":"2024-09-16T15:37:43.506222+0000","last_fullsized":"2024-09-16T15:37:43.506222+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.515283+0000","last_change":"2024-09-16T15:37:43.513164+0000","last_active":"2024-09-16T15:37:43.515283+0000","last_peered":"2024-09-16T15:37:43.515283+0000","last_clean":"2024-09-16T15:37:43.515283+0000","last_became_active":"2024-09-16T15:37:43.512890+0000","last_became_peered":"2024-09-16T15:37:43.512890+0000","last_unstale":"2024-09-16T15:37:43.515283+0000","last_undegraded":"2024-09-16T15:37:43.515283+0000","last_fullsized":"2024-09-16T15:37:43.515283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:24:48.654268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.505396+0000","last_change":"2024-09-16T15:37:43.505396+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.505396+0000","last_undegraded":"2024-09-16T15:37:43.505396+0000","last_fullsized":"2024-09-16T15:37:43.505396+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.520386+0000","last_change":"2024-09-16T15:37:43.515725+0000","last_active":"2024-09-16T15:37:43.520386+0000","last_peered":"2024-09-16T15:37:43.520386+0000","last_clean":"2024-09-16T15:37:43.520386+0000","last_became_active":"2024-09-16T15:37:43.515461+0000","last_became_peered":"2024-09-16T15:37:43.515461+0000","last_unstale":"2024-09-16T15:37:43.520386+0000","last_undegraded":"2024-09-16T15:37:43.520386+0000","last_fullsized":"2024-09-16T15:37:43.520386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T23:50:34.279091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":114,"acting":114,"num_store_stats":7},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":58,"acting":58,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":790528,"data_stored":652253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509446,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":208896,"data_stored":68160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":802816,"data_stored":658528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":56068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T15:37:48.489 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T15:37:48.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.623+0000 7ff35b016640 1 -- 172.21.15.98:0/95333235 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff35415bdc0 msgr2=0x7ff3540b3d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:48.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.623+0000 7ff35b016640 1 --2- 172.21.15.98:0/95333235 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff35415bdc0 0x7ff3540b3d00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff34c005fd0 tx=0x7ff34c02a5d0 comp rx=0 tx=0).stop 2024-09-16T15:37:48.626 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.623+0000 7ff35b016640 1 -- 172.21.15.98:0/95333235 shutdown_connections 2024-09-16T15:37:48.626 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.623+0000 7ff35b016640 1 --2- 172.21.15.98:0/95333235 >> v2:172.21.15.135:3300/0 conn(0x7ff3540737d0 0x7ff354151750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:48.626 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.623+0000 7ff35b016640 1 --2- 172.21.15.98:0/95333235 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff35415bdc0 0x7ff3540b3d00 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:48.626 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.623+0000 7ff35b016640 1 -- 172.21.15.98:0/95333235 >> 172.21.15.98:0/95333235 conn(0x7ff3540b2230 msgr2=0x7ff3540b2610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:48.626 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.623+0000 7ff35b016640 1 -- 172.21.15.98:0/95333235 shutdown_connections 2024-09-16T15:37:48.626 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.623+0000 7ff35b016640 1 -- 172.21.15.98:0/95333235 wait complete. 2024-09-16T15:37:48.626 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.624+0000 7ff35b016640 1 Processor -- start 2024-09-16T15:37:48.626 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.624+0000 7ff35b016640 1 -- start start 2024-09-16T15:37:48.628 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.625+0000 7ff35b016640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3540737d0 0x7ff354147f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:48.628 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.625+0000 7ff35b016640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3540b4240 0x7ff35406d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:48.628 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.625+0000 7ff35b016640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff35415bdc0 0x7ff354154700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:48.628 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.625+0000 7ff35b016640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff354152020 con 0x7ff3540737d0 2024-09-16T15:37:48.628 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.625+0000 7ff35b016640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff354151ea0 con 0x7ff3540b4240 2024-09-16T15:37:48.629 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.625+0000 7ff35b016640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff3541521a0 con 0x7ff35415bdc0 2024-09-16T15:37:48.629 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.625+0000 7ff358db2640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3540737d0 0x7ff354147f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:48.629 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.625+0000 7ff358db2640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3540737d0 0x7ff354147f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59478/0 (socket says 172.21.15.98:59478) 2024-09-16T15:37:48.629 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.625+0000 7ff358db2640 1 -- 172.21.15.98:0/364203163 learned_addr learned my addr 172.21.15.98:0/364203163 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:37:48.629 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.626+0000 7ff353fff640 1 --2- 172.21.15.98:0/364203163 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3540b4240 0x7ff35406d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:48.629 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.626+0000 7ff3595b3640 1 --2- 172.21.15.98:0/364203163 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff35415bdc0 0x7ff354154700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:48.629 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.626+0000 7ff358db2640 1 -- 172.21.15.98:0/364203163 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff35415bdc0 msgr2=0x7ff354154700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:48.629 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.626+0000 7ff358db2640 1 --2- 172.21.15.98:0/364203163 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff35415bdc0 0x7ff354154700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:48.629 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.626+0000 7ff358db2640 1 -- 172.21.15.98:0/364203163 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3540b4240 msgr2=0x7ff35406d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:48.629 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.626+0000 7ff358db2640 1 --2- 172.21.15.98:0/364203163 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3540b4240 0x7ff35406d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:48.629 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.626+0000 7ff358db2640 1 -- 172.21.15.98:0/364203163 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3541f6280 con 0x7ff3540737d0 2024-09-16T15:37:48.629 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.626+0000 7ff358db2640 1 --2- 172.21.15.98:0/364203163 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3540737d0 0x7ff354147f30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff34c009850 tx=0x7ff34c0035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:48.629 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.626+0000 7ff3517fa640 1 -- 172.21.15.98:0/364203163 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff34c03e030 con 0x7ff3540737d0 2024-09-16T15:37:48.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.626+0000 7ff35b016640 1 -- 172.21.15.98:0/364203163 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3541f6540 con 0x7ff3540737d0 2024-09-16T15:37:48.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.626+0000 7ff3517fa640 1 -- 172.21.15.98:0/364203163 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff34c003ae0 con 0x7ff3540737d0 2024-09-16T15:37:48.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.626+0000 7ff3517fa640 1 -- 172.21.15.98:0/364203163 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff34c035040 con 0x7ff3540737d0 2024-09-16T15:37:48.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.626+0000 7ff35b016640 1 -- 172.21.15.98:0/364203163 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3541f6b00 con 0x7ff3540737d0 2024-09-16T15:37:48.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.627+0000 7ff35b016640 1 -- 172.21.15.98:0/364203163 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff354151750 con 0x7ff3540737d0 2024-09-16T15:37:48.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.628+0000 7ff3517fa640 1 -- 172.21.15.98:0/364203163 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7ff34c041030 con 0x7ff3540737d0 2024-09-16T15:37:48.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.628+0000 7ff3517fa640 1 --2- 172.21.15.98:0/364203163 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7ff334078880 0x7ff33407ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:48.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.628+0000 7ff3517fa640 1 -- 172.21.15.98:0/364203163 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7ff34c0bacf0 con 0x7ff3540737d0 2024-09-16T15:37:48.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.628+0000 7ff353fff640 1 --2- 172.21.15.98:0/364203163 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7ff334078880 0x7ff33407ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:48.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.629+0000 7ff353fff640 1 --2- 172.21.15.98:0/364203163 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7ff334078880 0x7ff33407ad40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff3540d04b0 tx=0x7ff33c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:48.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.632+0000 7ff3517fa640 1 -- 172.21.15.98:0/364203163 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7ff34c0bf070 con 0x7ff3540737d0 2024-09-16T15:37:48.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.807+0000 7ff35b016640 1 -- 172.21.15.98:0/364203163 --> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff354159940 con 0x7ff334078880 2024-09-16T15:37:48.813 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.811+0000 7ff3517fa640 1 -- 172.21.15.98:0/364203163 <== mgr.4100 v2:172.21.15.135:6800/699234772 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247211 (secure 0 0 0) 0x7ff354159940 con 0x7ff334078880 2024-09-16T15:37:48.816 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:37:48.817 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2024-09-16T15:37:48.818 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.814+0000 7ff35b016640 1 -- 172.21.15.98:0/364203163 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7ff334078880 msgr2=0x7ff33407ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:48.818 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.814+0000 7ff35b016640 1 --2- 172.21.15.98:0/364203163 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7ff334078880 0x7ff33407ad40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff3540d04b0 tx=0x7ff33c009040 comp rx=0 tx=0).stop 2024-09-16T15:37:48.818 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.814+0000 7ff35b016640 1 -- 172.21.15.98:0/364203163 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3540737d0 msgr2=0x7ff354147f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:48.818 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.814+0000 7ff35b016640 1 --2- 172.21.15.98:0/364203163 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3540737d0 0x7ff354147f30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff34c009850 tx=0x7ff34c0035f0 comp rx=0 tx=0).stop 2024-09-16T15:37:48.819 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.814+0000 7ff35b016640 1 -- 172.21.15.98:0/364203163 shutdown_connections 2024-09-16T15:37:48.819 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.814+0000 7ff35b016640 1 --2- 172.21.15.98:0/364203163 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff35415bdc0 0x7ff354154700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:48.819 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.814+0000 7ff35b016640 1 --2- 172.21.15.98:0/364203163 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7ff334078880 0x7ff33407ad40 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:48.819 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.814+0000 7ff35b016640 1 --2- 172.21.15.98:0/364203163 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3540b4240 0x7ff35406d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:48.819 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.814+0000 7ff35b016640 1 --2- 172.21.15.98:0/364203163 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3540737d0 0x7ff354147f30 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:48.819 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.814+0000 7ff35b016640 1 -- 172.21.15.98:0/364203163 >> 172.21.15.98:0/364203163 conn(0x7ff3540b2230 msgr2=0x7ff354159bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:48.819 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.814+0000 7ff35b016640 1 -- 172.21.15.98:0/364203163 shutdown_connections 2024-09-16T15:37:48.819 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.814+0000 7ff35b016640 1 -- 172.21.15.98:0/364203163 wait complete. 2024-09-16T15:37:48.826 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-16T15:37:48.709658+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":7,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218996,"kb_used_data":2756,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755724,"statfs":{"total":773094113280,"available":772869861376,"internally_reserved":0,"allocated":2822144,"data_stored":1707716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001463"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.506408+0000","last_change":"2024-09-16T15:37:43.506408+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.506408+0000","last_undegraded":"2024-09-16T15:37:43.506408+0000","last_fullsized":"2024-09-16T15:37:43.506408+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.506105+0000","last_change":"2024-09-16T15:37:43.506105+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.506105+0000","last_undegraded":"2024-09-16T15:37:43.506105+0000","last_fullsized":"2024-09-16T15:37:43.506105+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.503720+0000","last_change":"2024-09-16T15:37:43.503720+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.503720+0000","last_undegraded":"2024-09-16T15:37:43.503720+0000","last_fullsized":"2024-09-16T15:37:43.503720+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.503566+0000","last_change":"2024-09-16T15:37:43.503566+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.503566+0000","last_undegraded":"2024-09-16T15:37:43.503566+0000","last_fullsized":"2024-09-16T15:37:43.503566+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.502948+0000","last_change":"2024-09-16T15:37:43.502948+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.502948+0000","last_undegraded":"2024-09-16T15:37:43.502948+0000","last_fullsized":"2024-09-16T15:37:43.502948+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.503197+0000","last_change":"2024-09-16T15:37:43.503197+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.503197+0000","last_undegraded":"2024-09-16T15:37:43.503197+0000","last_fullsized":"2024-09-16T15:37:43.503197+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.504333+0000","last_change":"2024-09-16T15:37:43.504333+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.504333+0000","last_undegraded":"2024-09-16T15:37:43.504333+0000","last_fullsized":"2024-09-16T15:37:43.504333+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.505582+0000","last_change":"2024-09-16T15:37:43.505582+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.505582+0000","last_undegraded":"2024-09-16T15:37:43.505582+0000","last_fullsized":"2024-09-16T15:37:43.505582+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.501405+0000","last_change":"2024-09-16T15:37:43.501405+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.501405+0000","last_undegraded":"2024-09-16T15:37:43.501405+0000","last_fullsized":"2024-09-16T15:37:43.501405+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.505383+0000","last_change":"2024-09-16T15:37:43.505383+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.505383+0000","last_undegraded":"2024-09-16T15:37:43.505383+0000","last_fullsized":"2024-09-16T15:37:43.505383+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.505413+0000","last_change":"2024-09-16T15:37:43.505413+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.505413+0000","last_undegraded":"2024-09-16T15:37:43.505413+0000","last_fullsized":"2024-09-16T15:37:43.505413+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.506807+0000","last_change":"2024-09-16T15:37:43.506807+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.506807+0000","last_undegraded":"2024-09-16T15:37:43.506807+0000","last_fullsized":"2024-09-16T15:37:43.506807+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.526086+0000","last_change":"2024-09-16T15:37:44.515572+0000","last_active":"2024-09-16T15:37:45.526086+0000","last_peered":"2024-09-16T15:37:45.526086+0000","last_clean":"2024-09-16T15:37:45.526086+0000","last_became_active":"2024-09-16T15:37:44.514667+0000","last_became_peered":"2024-09-16T15:37:44.514667+0000","last_unstale":"2024-09-16T15:37:45.526086+0000","last_undegraded":"2024-09-16T15:37:45.526086+0000","last_fullsized":"2024-09-16T15:37:45.526086+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:37:31.235473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.526350+0000","last_change":"2024-09-16T15:37:44.517134+0000","last_active":"2024-09-16T15:37:45.526350+0000","last_peered":"2024-09-16T15:37:45.526350+0000","last_clean":"2024-09-16T15:37:45.526350+0000","last_became_active":"2024-09-16T15:37:44.515946+0000","last_became_peered":"2024-09-16T15:37:44.515946+0000","last_unstale":"2024-09-16T15:37:45.526350+0000","last_undegraded":"2024-09-16T15:37:45.526350+0000","last_fullsized":"2024-09-16T15:37:45.526350+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:01:35.813267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.503610+0000","last_change":"2024-09-16T15:37:43.503610+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.503610+0000","last_undegraded":"2024-09-16T15:37:43.503610+0000","last_fullsized":"2024-09-16T15:37:43.503610+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.510644+0000","last_change":"2024-09-16T15:37:43.510644+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.510644+0000","last_undegraded":"2024-09-16T15:37:43.510644+0000","last_fullsized":"2024-09-16T15:37:43.510644+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.509791+0000","last_change":"2024-09-16T15:37:43.509791+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.509791+0000","last_undegraded":"2024-09-16T15:37:43.509791+0000","last_fullsized":"2024-09-16T15:37:43.509791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.509988+0000","last_change":"2024-09-16T15:37:43.509988+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.509988+0000","last_undegraded":"2024-09-16T15:37:43.509988+0000","last_fullsized":"2024-09-16T15:37:43.509988+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.508646+0000","last_change":"2024-09-16T15:37:43.508646+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.508646+0000","last_undegraded":"2024-09-16T15:37:43.508646+0000","last_fullsized":"2024-09-16T15:37:43.508646+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.506205+0000","last_change":"2024-09-16T15:37:43.506205+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.506205+0000","last_undegraded":"2024-09-16T15:37:43.506205+0000","last_fullsized":"2024-09-16T15:37:43.506205+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.508778+0000","last_change":"2024-09-16T15:37:43.508778+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.508778+0000","last_undegraded":"2024-09-16T15:37:43.508778+0000","last_fullsized":"2024-09-16T15:37:43.508778+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.502662+0000","last_change":"2024-09-16T15:37:43.502662+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.502662+0000","last_undegraded":"2024-09-16T15:37:43.502662+0000","last_fullsized":"2024-09-16T15:37:43.502662+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.502763+0000","last_change":"2024-09-16T15:37:43.502763+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.502763+0000","last_undegraded":"2024-09-16T15:37:43.502763+0000","last_fullsized":"2024-09-16T15:37:43.502763+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.506771+0000","last_change":"2024-09-16T15:37:43.506771+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.506771+0000","last_undegraded":"2024-09-16T15:37:43.506771+0000","last_fullsized":"2024-09-16T15:37:43.506771+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.507085+0000","last_change":"2024-09-16T15:37:43.507085+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.507085+0000","last_undegraded":"2024-09-16T15:37:43.507085+0000","last_fullsized":"2024-09-16T15:37:43.507085+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.504681+0000","last_change":"2024-09-16T15:37:43.504681+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.504681+0000","last_undegraded":"2024-09-16T15:37:43.504681+0000","last_fullsized":"2024-09-16T15:37:43.504681+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.526539+0000","last_change":"2024-09-16T15:37:44.519708+0000","last_active":"2024-09-16T15:37:45.526539+0000","last_peered":"2024-09-16T15:37:45.526539+0000","last_clean":"2024-09-16T15:37:45.526539+0000","last_became_active":"2024-09-16T15:37:44.519439+0000","last_became_peered":"2024-09-16T15:37:44.519439+0000","last_unstale":"2024-09-16T15:37:45.526539+0000","last_undegraded":"2024-09-16T15:37:45.526539+0000","last_fullsized":"2024-09-16T15:37:45.526539+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:56:40.956164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.526026+0000","last_change":"2024-09-16T15:37:44.518861+0000","last_active":"2024-09-16T15:37:45.526026+0000","last_peered":"2024-09-16T15:37:45.526026+0000","last_clean":"2024-09-16T15:37:45.526026+0000","last_became_active":"2024-09-16T15:37:44.518600+0000","last_became_peered":"2024-09-16T15:37:44.518600+0000","last_unstale":"2024-09-16T15:37:45.526026+0000","last_undegraded":"2024-09-16T15:37:45.526026+0000","last_fullsized":"2024-09-16T15:37:45.526026+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:52:07.454732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.504364+0000","last_change":"2024-09-16T15:37:43.504364+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.504364+0000","last_undegraded":"2024-09-16T15:37:43.504364+0000","last_fullsized":"2024-09-16T15:37:43.504364+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.508166+0000","last_change":"2024-09-16T15:37:43.508166+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.508166+0000","last_undegraded":"2024-09-16T15:37:43.508166+0000","last_fullsized":"2024-09-16T15:37:43.508166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.509609+0000","last_change":"2024-09-16T15:37:43.509609+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.509609+0000","last_undegraded":"2024-09-16T15:37:43.509609+0000","last_fullsized":"2024-09-16T15:37:43.509609+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.502933+0000","last_change":"2024-09-16T15:37:43.502933+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.502933+0000","last_undegraded":"2024-09-16T15:37:43.502933+0000","last_fullsized":"2024-09-16T15:37:43.502933+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.501835+0000","last_change":"2024-09-16T15:37:43.501835+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.501835+0000","last_undegraded":"2024-09-16T15:37:43.501835+0000","last_fullsized":"2024-09-16T15:37:43.501835+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.513635+0000","last_change":"2024-09-16T15:37:43.510897+0000","last_active":"2024-09-16T15:37:43.513635+0000","last_peered":"2024-09-16T15:37:43.513635+0000","last_clean":"2024-09-16T15:37:43.513635+0000","last_became_active":"2024-09-16T15:37:43.510468+0000","last_became_peered":"2024-09-16T15:37:43.510468+0000","last_unstale":"2024-09-16T15:37:43.513635+0000","last_undegraded":"2024-09-16T15:37:43.513635+0000","last_fullsized":"2024-09-16T15:37:43.513635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:58:36.781822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.507082+0000","last_change":"2024-09-16T15:37:43.507082+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.507082+0000","last_undegraded":"2024-09-16T15:37:43.507082+0000","last_fullsized":"2024-09-16T15:37:43.507082+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.523221+0000","last_change":"2024-09-16T15:37:43.521672+0000","last_active":"2024-09-16T15:37:43.523221+0000","last_peered":"2024-09-16T15:37:43.523221+0000","last_clean":"2024-09-16T15:37:43.523221+0000","last_became_active":"2024-09-16T15:37:43.521418+0000","last_became_peered":"2024-09-16T15:37:43.521418+0000","last_unstale":"2024-09-16T15:37:43.523221+0000","last_undegraded":"2024-09-16T15:37:43.523221+0000","last_fullsized":"2024-09-16T15:37:43.523221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:03:21.436525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.525828+0000","last_change":"2024-09-16T15:37:43.517465+0000","last_active":"2024-09-16T15:37:45.525828+0000","last_peered":"2024-09-16T15:37:45.525828+0000","last_clean":"2024-09-16T15:37:45.525828+0000","last_became_active":"2024-09-16T15:37:43.517177+0000","last_became_peered":"2024-09-16T15:37:43.517177+0000","last_unstale":"2024-09-16T15:37:45.525828+0000","last_undegraded":"2024-09-16T15:37:45.525828+0000","last_fullsized":"2024-09-16T15:37:45.525828+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T21:38:37.823375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.504239+0000","last_change":"2024-09-16T15:37:43.504239+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.504239+0000","last_undegraded":"2024-09-16T15:37:43.504239+0000","last_fullsized":"2024-09-16T15:37:43.504239+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.521219+0000","last_change":"2024-09-16T15:37:43.519319+0000","last_active":"2024-09-16T15:37:43.521219+0000","last_peered":"2024-09-16T15:37:43.521219+0000","last_clean":"2024-09-16T15:37:43.521219+0000","last_became_active":"2024-09-16T15:37:43.518711+0000","last_became_peered":"2024-09-16T15:37:43.518711+0000","last_unstale":"2024-09-16T15:37:43.521219+0000","last_undegraded":"2024-09-16T15:37:43.521219+0000","last_fullsized":"2024-09-16T15:37:43.521219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:25:01.970817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.507140+0000","last_change":"2024-09-16T15:37:43.507140+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.507140+0000","last_undegraded":"2024-09-16T15:37:43.507140+0000","last_fullsized":"2024-09-16T15:37:43.507140+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.516204+0000","last_change":"2024-09-16T15:37:43.514400+0000","last_active":"2024-09-16T15:37:43.516204+0000","last_peered":"2024-09-16T15:37:43.516204+0000","last_clean":"2024-09-16T15:37:43.516204+0000","last_became_active":"2024-09-16T15:37:43.514124+0000","last_became_peered":"2024-09-16T15:37:43.514124+0000","last_unstale":"2024-09-16T15:37:43.516204+0000","last_undegraded":"2024-09-16T15:37:43.516204+0000","last_fullsized":"2024-09-16T15:37:43.516204+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:58:36.781822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.504279+0000","last_change":"2024-09-16T15:37:43.504279+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.504279+0000","last_undegraded":"2024-09-16T15:37:43.504279+0000","last_fullsized":"2024-09-16T15:37:43.504279+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.517060+0000","last_change":"2024-09-16T15:37:43.515976+0000","last_active":"2024-09-16T15:37:43.517060+0000","last_peered":"2024-09-16T15:37:43.517060+0000","last_clean":"2024-09-16T15:37:43.517060+0000","last_became_active":"2024-09-16T15:37:43.515426+0000","last_became_peered":"2024-09-16T15:37:43.515426+0000","last_unstale":"2024-09-16T15:37:43.517060+0000","last_undegraded":"2024-09-16T15:37:43.517060+0000","last_fullsized":"2024-09-16T15:37:43.517060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T21:42:39.448578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.503121+0000","last_change":"2024-09-16T15:37:43.503121+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.503121+0000","last_undegraded":"2024-09-16T15:37:43.503121+0000","last_fullsized":"2024-09-16T15:37:43.503121+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.522596+0000","last_change":"2024-09-16T15:37:43.516257+0000","last_active":"2024-09-16T15:37:43.522596+0000","last_peered":"2024-09-16T15:37:43.522596+0000","last_clean":"2024-09-16T15:37:43.522596+0000","last_became_active":"2024-09-16T15:37:43.515944+0000","last_became_peered":"2024-09-16T15:37:43.515944+0000","last_unstale":"2024-09-16T15:37:43.522596+0000","last_undegraded":"2024-09-16T15:37:43.522596+0000","last_fullsized":"2024-09-16T15:37:43.522596+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:58:36.781822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.502789+0000","last_change":"2024-09-16T15:37:43.502789+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.502789+0000","last_undegraded":"2024-09-16T15:37:43.502789+0000","last_fullsized":"2024-09-16T15:37:43.502789+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.516162+0000","last_change":"2024-09-16T15:37:43.514513+0000","last_active":"2024-09-16T15:37:43.516162+0000","last_peered":"2024-09-16T15:37:43.516162+0000","last_clean":"2024-09-16T15:37:43.516162+0000","last_became_active":"2024-09-16T15:37:43.514196+0000","last_became_peered":"2024-09-16T15:37:43.514196+0000","last_unstale":"2024-09-16T15:37:43.516162+0000","last_undegraded":"2024-09-16T15:37:43.516162+0000","last_fullsized":"2024-09-16T15:37:43.516162+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:43:24.500518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.504417+0000","last_change":"2024-09-16T15:37:43.504417+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.504417+0000","last_undegraded":"2024-09-16T15:37:43.504417+0000","last_fullsized":"2024-09-16T15:37:43.504417+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.525199+0000","last_change":"2024-09-16T15:37:43.521768+0000","last_active":"2024-09-16T15:37:43.525199+0000","last_peered":"2024-09-16T15:37:43.525199+0000","last_clean":"2024-09-16T15:37:43.525199+0000","last_became_active":"2024-09-16T15:37:43.521541+0000","last_became_peered":"2024-09-16T15:37:43.521541+0000","last_unstale":"2024-09-16T15:37:43.525199+0000","last_undegraded":"2024-09-16T15:37:43.525199+0000","last_fullsized":"2024-09-16T15:37:43.525199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:24:48.654268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.526567+0000","last_change":"2024-09-16T15:37:44.520303+0000","last_active":"2024-09-16T15:37:45.526567+0000","last_peered":"2024-09-16T15:37:45.526567+0000","last_clean":"2024-09-16T15:37:45.526567+0000","last_became_active":"2024-09-16T15:37:44.520036+0000","last_became_peered":"2024-09-16T15:37:44.520036+0000","last_unstale":"2024-09-16T15:37:45.526567+0000","last_undegraded":"2024-09-16T15:37:45.526567+0000","last_fullsized":"2024-09-16T15:37:45.526567+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:02:45.771447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.521972+0000","last_change":"2024-09-16T15:37:43.519519+0000","last_active":"2024-09-16T15:37:43.521972+0000","last_peered":"2024-09-16T15:37:43.521972+0000","last_clean":"2024-09-16T15:37:43.521972+0000","last_became_active":"2024-09-16T15:37:43.518682+0000","last_became_peered":"2024-09-16T15:37:43.518682+0000","last_unstale":"2024-09-16T15:37:43.521972+0000","last_undegraded":"2024-09-16T15:37:43.521972+0000","last_fullsized":"2024-09-16T15:37:43.521972+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T21:23:32.133055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.508570+0000","last_change":"2024-09-16T15:37:43.508570+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.508570+0000","last_undegraded":"2024-09-16T15:37:43.508570+0000","last_fullsized":"2024-09-16T15:37:43.508570+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.521229+0000","last_change":"2024-09-16T15:37:43.519576+0000","last_active":"2024-09-16T15:37:43.521229+0000","last_peered":"2024-09-16T15:37:43.521229+0000","last_clean":"2024-09-16T15:37:43.521229+0000","last_became_active":"2024-09-16T15:37:43.517609+0000","last_became_peered":"2024-09-16T15:37:43.517609+0000","last_unstale":"2024-09-16T15:37:43.521229+0000","last_undegraded":"2024-09-16T15:37:43.521229+0000","last_fullsized":"2024-09-16T15:37:43.521229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:37:32.374134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.501758+0000","last_change":"2024-09-16T15:37:43.501758+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.501758+0000","last_undegraded":"2024-09-16T15:37:43.501758+0000","last_fullsized":"2024-09-16T15:37:43.501758+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.517876+0000","last_change":"2024-09-16T15:37:43.514266+0000","last_active":"2024-09-16T15:37:43.517876+0000","last_peered":"2024-09-16T15:37:43.517876+0000","last_clean":"2024-09-16T15:37:43.517876+0000","last_became_active":"2024-09-16T15:37:43.513980+0000","last_became_peered":"2024-09-16T15:37:43.513980+0000","last_unstale":"2024-09-16T15:37:43.517876+0000","last_undegraded":"2024-09-16T15:37:43.517876+0000","last_fullsized":"2024-09-16T15:37:43.517876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:24:48.654268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.504309+0000","last_change":"2024-09-16T15:37:43.504309+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.504309+0000","last_undegraded":"2024-09-16T15:37:43.504309+0000","last_fullsized":"2024-09-16T15:37:43.504309+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.521176+0000","last_change":"2024-09-16T15:37:43.518884+0000","last_active":"2024-09-16T15:37:43.521176+0000","last_peered":"2024-09-16T15:37:43.521176+0000","last_clean":"2024-09-16T15:37:43.521176+0000","last_became_active":"2024-09-16T15:37:43.517494+0000","last_became_peered":"2024-09-16T15:37:43.517494+0000","last_unstale":"2024-09-16T15:37:43.521176+0000","last_undegraded":"2024-09-16T15:37:43.521176+0000","last_fullsized":"2024-09-16T15:37:43.521176+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:45:09.277422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.503176+0000","last_change":"2024-09-16T15:37:43.503176+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.503176+0000","last_undegraded":"2024-09-16T15:37:43.503176+0000","last_fullsized":"2024-09-16T15:37:43.503176+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.517928+0000","last_change":"2024-09-16T15:37:43.514250+0000","last_active":"2024-09-16T15:37:43.517928+0000","last_peered":"2024-09-16T15:37:43.517928+0000","last_clean":"2024-09-16T15:37:43.517928+0000","last_became_active":"2024-09-16T15:37:43.513954+0000","last_became_peered":"2024-09-16T15:37:43.513954+0000","last_unstale":"2024-09-16T15:37:43.517928+0000","last_undegraded":"2024-09-16T15:37:43.517928+0000","last_fullsized":"2024-09-16T15:37:43.517928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:58:36.781822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.505682+0000","last_change":"2024-09-16T15:37:43.505682+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.505682+0000","last_undegraded":"2024-09-16T15:37:43.505682+0000","last_fullsized":"2024-09-16T15:37:43.505682+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.516491+0000","last_change":"2024-09-16T15:37:43.514330+0000","last_active":"2024-09-16T15:37:43.516491+0000","last_peered":"2024-09-16T15:37:43.516491+0000","last_clean":"2024-09-16T15:37:43.516491+0000","last_became_active":"2024-09-16T15:37:43.513900+0000","last_became_peered":"2024-09-16T15:37:43.513900+0000","last_unstale":"2024-09-16T15:37:43.516491+0000","last_undegraded":"2024-09-16T15:37:43.516491+0000","last_fullsized":"2024-09-16T15:37:43.516491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T23:50:34.279091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.505063+0000","last_change":"2024-09-16T15:37:43.505063+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.505063+0000","last_undegraded":"2024-09-16T15:37:43.505063+0000","last_fullsized":"2024-09-16T15:37:43.505063+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.526586+0000","last_change":"2024-09-16T15:37:43.520873+0000","last_active":"2024-09-16T15:37:45.526586+0000","last_peered":"2024-09-16T15:37:45.526586+0000","last_clean":"2024-09-16T15:37:45.526586+0000","last_became_active":"2024-09-16T15:37:43.520561+0000","last_became_peered":"2024-09-16T15:37:43.520561+0000","last_unstale":"2024-09-16T15:37:45.526586+0000","last_undegraded":"2024-09-16T15:37:45.526586+0000","last_fullsized":"2024-09-16T15:37:45.526586+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:08:30.145981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.506168+0000","last_change":"2024-09-16T15:37:43.506168+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.506168+0000","last_undegraded":"2024-09-16T15:37:43.506168+0000","last_fullsized":"2024-09-16T15:37:43.506168+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":107,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.498711+0000","last_change":"2024-09-16T15:37:37.258601+0000","last_active":"2024-09-16T15:37:43.498711+0000","last_peered":"2024-09-16T15:37:43.498711+0000","last_clean":"2024-09-16T15:37:43.498711+0000","last_became_active":"2024-09-16T15:37:37.257584+0000","last_became_peered":"2024-09-16T15:37:37.257584+0000","last_unstale":"2024-09-16T15:37:43.498711+0000","last_undegraded":"2024-09-16T15:37:43.498711+0000","last_fullsized":"2024-09-16T15:37:43.498711+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:35.447043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:35.447043+0000","last_clean_scrub_stamp":"2024-09-16T15:37:35.447043+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:43:17.464894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.513875+0000","last_change":"2024-09-16T15:37:43.510139+0000","last_active":"2024-09-16T15:37:43.513875+0000","last_peered":"2024-09-16T15:37:43.513875+0000","last_clean":"2024-09-16T15:37:43.513875+0000","last_became_active":"2024-09-16T15:37:43.509820+0000","last_became_peered":"2024-09-16T15:37:43.509820+0000","last_unstale":"2024-09-16T15:37:43.513875+0000","last_undegraded":"2024-09-16T15:37:43.513875+0000","last_fullsized":"2024-09-16T15:37:43.513875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:18:57.765147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.507336+0000","last_change":"2024-09-16T15:37:43.507336+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.507336+0000","last_undegraded":"2024-09-16T15:37:43.507336+0000","last_fullsized":"2024-09-16T15:37:43.507336+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.521246+0000","last_change":"2024-09-16T15:37:43.519442+0000","last_active":"2024-09-16T15:37:43.521246+0000","last_peered":"2024-09-16T15:37:43.521246+0000","last_clean":"2024-09-16T15:37:43.521246+0000","last_became_active":"2024-09-16T15:37:43.519204+0000","last_became_peered":"2024-09-16T15:37:43.519204+0000","last_unstale":"2024-09-16T15:37:43.521246+0000","last_undegraded":"2024-09-16T15:37:43.521246+0000","last_fullsized":"2024-09-16T15:37:43.521246+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:42:35.749344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.525649+0000","last_change":"2024-09-16T15:37:44.511988+0000","last_active":"2024-09-16T15:37:45.525649+0000","last_peered":"2024-09-16T15:37:45.525649+0000","last_clean":"2024-09-16T15:37:45.525649+0000","last_became_active":"2024-09-16T15:37:44.511679+0000","last_became_peered":"2024-09-16T15:37:44.511679+0000","last_unstale":"2024-09-16T15:37:45.525649+0000","last_undegraded":"2024-09-16T15:37:45.525649+0000","last_fullsized":"2024-09-16T15:37:45.525649+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:39:56.702467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.522564+0000","last_change":"2024-09-16T15:37:43.515953+0000","last_active":"2024-09-16T15:37:43.522564+0000","last_peered":"2024-09-16T15:37:43.522564+0000","last_clean":"2024-09-16T15:37:43.522564+0000","last_became_active":"2024-09-16T15:37:43.515662+0000","last_became_peered":"2024-09-16T15:37:43.515662+0000","last_unstale":"2024-09-16T15:37:43.522564+0000","last_undegraded":"2024-09-16T15:37:43.522564+0000","last_fullsized":"2024-09-16T15:37:43.522564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:18:57.765147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.505160+0000","last_change":"2024-09-16T15:37:43.505160+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.505160+0000","last_undegraded":"2024-09-16T15:37:43.505160+0000","last_fullsized":"2024-09-16T15:37:43.505160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.514888+0000","last_change":"2024-09-16T15:37:43.513231+0000","last_active":"2024-09-16T15:37:43.514888+0000","last_peered":"2024-09-16T15:37:43.514888+0000","last_clean":"2024-09-16T15:37:43.514888+0000","last_became_active":"2024-09-16T15:37:43.512954+0000","last_became_peered":"2024-09-16T15:37:43.512954+0000","last_unstale":"2024-09-16T15:37:43.514888+0000","last_undegraded":"2024-09-16T15:37:43.514888+0000","last_fullsized":"2024-09-16T15:37:43.514888+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:58:36.781822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.503500+0000","last_change":"2024-09-16T15:37:43.503500+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.503500+0000","last_undegraded":"2024-09-16T15:37:43.503500+0000","last_fullsized":"2024-09-16T15:37:43.503500+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.513599+0000","last_change":"2024-09-16T15:37:43.510480+0000","last_active":"2024-09-16T15:37:43.513599+0000","last_peered":"2024-09-16T15:37:43.513599+0000","last_clean":"2024-09-16T15:37:43.513599+0000","last_became_active":"2024-09-16T15:37:43.510223+0000","last_became_peered":"2024-09-16T15:37:43.510223+0000","last_unstale":"2024-09-16T15:37:43.513599+0000","last_undegraded":"2024-09-16T15:37:43.513599+0000","last_fullsized":"2024-09-16T15:37:43.513599+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:18:57.765147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.503364+0000","last_change":"2024-09-16T15:37:43.503364+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.503364+0000","last_undegraded":"2024-09-16T15:37:43.503364+0000","last_fullsized":"2024-09-16T15:37:43.503364+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.516668+0000","last_change":"2024-09-16T15:37:43.515757+0000","last_active":"2024-09-16T15:37:43.516668+0000","last_peered":"2024-09-16T15:37:43.516668+0000","last_clean":"2024-09-16T15:37:43.516668+0000","last_became_active":"2024-09-16T15:37:43.515199+0000","last_became_peered":"2024-09-16T15:37:43.515199+0000","last_unstale":"2024-09-16T15:37:43.516668+0000","last_undegraded":"2024-09-16T15:37:43.516668+0000","last_fullsized":"2024-09-16T15:37:43.516668+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T23:50:34.279091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.526573+0000","last_change":"2024-09-16T15:37:44.515147+0000","last_active":"2024-09-16T15:37:45.526573+0000","last_peered":"2024-09-16T15:37:45.526573+0000","last_clean":"2024-09-16T15:37:45.526573+0000","last_became_active":"2024-09-16T15:37:44.514518+0000","last_became_peered":"2024-09-16T15:37:44.514518+0000","last_unstale":"2024-09-16T15:37:45.526573+0000","last_undegraded":"2024-09-16T15:37:45.526573+0000","last_fullsized":"2024-09-16T15:37:45.526573+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:57:36.296851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.522756+0000","last_change":"2024-09-16T15:37:43.518081+0000","last_active":"2024-09-16T15:37:43.522756+0000","last_peered":"2024-09-16T15:37:43.522756+0000","last_clean":"2024-09-16T15:37:43.522756+0000","last_became_active":"2024-09-16T15:37:43.517744+0000","last_became_peered":"2024-09-16T15:37:43.517744+0000","last_unstale":"2024-09-16T15:37:43.522756+0000","last_undegraded":"2024-09-16T15:37:43.522756+0000","last_fullsized":"2024-09-16T15:37:43.522756+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:08:31.665964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.508877+0000","last_change":"2024-09-16T15:37:43.508877+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.508877+0000","last_undegraded":"2024-09-16T15:37:43.508877+0000","last_fullsized":"2024-09-16T15:37:43.508877+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.521293+0000","last_change":"2024-09-16T15:37:43.519357+0000","last_active":"2024-09-16T15:37:43.521293+0000","last_peered":"2024-09-16T15:37:43.521293+0000","last_clean":"2024-09-16T15:37:43.521293+0000","last_became_active":"2024-09-16T15:37:43.519050+0000","last_became_peered":"2024-09-16T15:37:43.519050+0000","last_unstale":"2024-09-16T15:37:43.521293+0000","last_undegraded":"2024-09-16T15:37:43.521293+0000","last_fullsized":"2024-09-16T15:37:43.521293+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:08:31.665964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.508507+0000","last_change":"2024-09-16T15:37:43.508507+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.508507+0000","last_undegraded":"2024-09-16T15:37:43.508507+0000","last_fullsized":"2024-09-16T15:37:43.508507+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.521054+0000","last_change":"2024-09-16T15:37:43.517924+0000","last_active":"2024-09-16T15:37:43.521054+0000","last_peered":"2024-09-16T15:37:43.521054+0000","last_clean":"2024-09-16T15:37:43.521054+0000","last_became_active":"2024-09-16T15:37:43.516036+0000","last_became_peered":"2024-09-16T15:37:43.516036+0000","last_unstale":"2024-09-16T15:37:43.521054+0000","last_undegraded":"2024-09-16T15:37:43.521054+0000","last_fullsized":"2024-09-16T15:37:43.521054+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T23:52:54.008046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.503358+0000","last_change":"2024-09-16T15:37:43.503358+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.503358+0000","last_undegraded":"2024-09-16T15:37:43.503358+0000","last_fullsized":"2024-09-16T15:37:43.503358+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.522744+0000","last_change":"2024-09-16T15:37:43.518084+0000","last_active":"2024-09-16T15:37:43.522744+0000","last_peered":"2024-09-16T15:37:43.522744+0000","last_clean":"2024-09-16T15:37:43.522744+0000","last_became_active":"2024-09-16T15:37:43.517773+0000","last_became_peered":"2024-09-16T15:37:43.517773+0000","last_unstale":"2024-09-16T15:37:43.522744+0000","last_undegraded":"2024-09-16T15:37:43.522744+0000","last_fullsized":"2024-09-16T15:37:43.522744+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:25:01.970817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.507353+0000","last_change":"2024-09-16T15:37:43.507353+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.507353+0000","last_undegraded":"2024-09-16T15:37:43.507353+0000","last_fullsized":"2024-09-16T15:37:43.507353+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.526487+0000","last_change":"2024-09-16T15:37:43.511936+0000","last_active":"2024-09-16T15:37:45.526487+0000","last_peered":"2024-09-16T15:37:45.526487+0000","last_clean":"2024-09-16T15:37:45.526487+0000","last_became_active":"2024-09-16T15:37:43.511709+0000","last_became_peered":"2024-09-16T15:37:43.511709+0000","last_unstale":"2024-09-16T15:37:45.526487+0000","last_undegraded":"2024-09-16T15:37:45.526487+0000","last_fullsized":"2024-09-16T15:37:45.526487+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:22:48.178297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.510415+0000","last_change":"2024-09-16T15:37:43.510415+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.510415+0000","last_undegraded":"2024-09-16T15:37:43.510415+0000","last_fullsized":"2024-09-16T15:37:43.510415+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.514961+0000","last_change":"2024-09-16T15:37:43.513406+0000","last_active":"2024-09-16T15:37:43.514961+0000","last_peered":"2024-09-16T15:37:43.514961+0000","last_clean":"2024-09-16T15:37:43.514961+0000","last_became_active":"2024-09-16T15:37:43.512994+0000","last_became_peered":"2024-09-16T15:37:43.512994+0000","last_unstale":"2024-09-16T15:37:43.514961+0000","last_undegraded":"2024-09-16T15:37:43.514961+0000","last_fullsized":"2024-09-16T15:37:43.514961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:24:48.654268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.507703+0000","last_change":"2024-09-16T15:37:43.507703+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.507703+0000","last_undegraded":"2024-09-16T15:37:43.507703+0000","last_fullsized":"2024-09-16T15:37:43.507703+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.507590+0000","last_change":"2024-09-16T15:37:43.507590+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.507590+0000","last_undegraded":"2024-09-16T15:37:43.507590+0000","last_fullsized":"2024-09-16T15:37:43.507590+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.517270+0000","last_change":"2024-09-16T15:37:43.512302+0000","last_active":"2024-09-16T15:37:43.517270+0000","last_peered":"2024-09-16T15:37:43.517270+0000","last_clean":"2024-09-16T15:37:43.517270+0000","last_became_active":"2024-09-16T15:37:43.511884+0000","last_became_peered":"2024-09-16T15:37:43.511884+0000","last_unstale":"2024-09-16T15:37:43.517270+0000","last_undegraded":"2024-09-16T15:37:43.517270+0000","last_fullsized":"2024-09-16T15:37:43.517270+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:43:24.500518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.501832+0000","last_change":"2024-09-16T15:37:43.501832+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.501832+0000","last_undegraded":"2024-09-16T15:37:43.501832+0000","last_fullsized":"2024-09-16T15:37:43.501832+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.521108+0000","last_change":"2024-09-16T15:37:43.518058+0000","last_active":"2024-09-16T15:37:43.521108+0000","last_peered":"2024-09-16T15:37:43.521108+0000","last_clean":"2024-09-16T15:37:43.521108+0000","last_became_active":"2024-09-16T15:37:43.517743+0000","last_became_peered":"2024-09-16T15:37:43.517743+0000","last_unstale":"2024-09-16T15:37:43.521108+0000","last_undegraded":"2024-09-16T15:37:43.521108+0000","last_fullsized":"2024-09-16T15:37:43.521108+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:44:54.808566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.506222+0000","last_change":"2024-09-16T15:37:43.506222+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.506222+0000","last_undegraded":"2024-09-16T15:37:43.506222+0000","last_fullsized":"2024-09-16T15:37:43.506222+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.515283+0000","last_change":"2024-09-16T15:37:43.513164+0000","last_active":"2024-09-16T15:37:43.515283+0000","last_peered":"2024-09-16T15:37:43.515283+0000","last_clean":"2024-09-16T15:37:43.515283+0000","last_became_active":"2024-09-16T15:37:43.512890+0000","last_became_peered":"2024-09-16T15:37:43.512890+0000","last_unstale":"2024-09-16T15:37:43.515283+0000","last_undegraded":"2024-09-16T15:37:43.515283+0000","last_fullsized":"2024-09-16T15:37:43.515283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:24:48.654268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.505396+0000","last_change":"2024-09-16T15:37:43.505396+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.505396+0000","last_undegraded":"2024-09-16T15:37:43.505396+0000","last_fullsized":"2024-09-16T15:37:43.505396+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.520386+0000","last_change":"2024-09-16T15:37:43.515725+0000","last_active":"2024-09-16T15:37:43.520386+0000","last_peered":"2024-09-16T15:37:43.520386+0000","last_clean":"2024-09-16T15:37:43.520386+0000","last_became_active":"2024-09-16T15:37:43.515461+0000","last_became_peered":"2024-09-16T15:37:43.515461+0000","last_unstale":"2024-09-16T15:37:43.520386+0000","last_undegraded":"2024-09-16T15:37:43.520386+0000","last_fullsized":"2024-09-16T15:37:43.520386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T23:50:34.279091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":790528,"data_stored":652253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509446,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":208896,"data_stored":68160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":802816,"data_stored":658528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":233472,"data_stored":81235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T15:37:48.830 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T15:37:48.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.965+0000 7fe98a452640 1 -- 172.21.15.98:0/637422349 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe9840ccd00 msgr2=0x7fe98406f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:48.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.965+0000 7fe98a452640 1 --2- 172.21.15.98:0/637422349 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe9840ccd00 0x7fe98406f850 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe984076720 tx=0x7fe97802a5f0 comp rx=0 tx=0).stop 2024-09-16T15:37:48.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.965+0000 7fe98a452640 1 -- 172.21.15.98:0/637422349 shutdown_connections 2024-09-16T15:37:48.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.965+0000 7fe98a452640 1 --2- 172.21.15.98:0/637422349 >> v2:172.21.15.135:3300/0 conn(0x7fe98406fd90 0x7fe9840b3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:48.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.965+0000 7fe98a452640 1 --2- 172.21.15.98:0/637422349 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe9840ccd00 0x7fe98406f850 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:48.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.965+0000 7fe98a452640 1 -- 172.21.15.98:0/637422349 >> 172.21.15.98:0/637422349 conn(0x7fe9840b1950 msgr2=0x7fe9840b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:48.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.965+0000 7fe98a452640 1 -- 172.21.15.98:0/637422349 shutdown_connections 2024-09-16T15:37:48.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.965+0000 7fe98a452640 1 -- 172.21.15.98:0/637422349 wait complete. 2024-09-16T15:37:48.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.966+0000 7fe98a452640 1 Processor -- start 2024-09-16T15:37:48.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.966+0000 7fe98a452640 1 -- start start 2024-09-16T15:37:48.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.967+0000 7fe98a452640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe98406fd90 0x7fe9841f9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:48.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.967+0000 7fe98a452640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9840ccd00 0x7fe984159060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:48.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.967+0000 7fe98a452640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe9841438b0 0x7fe9840b04a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:48.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.967+0000 7fe98a452640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe984070aa0 con 0x7fe9841438b0 2024-09-16T15:37:48.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.967+0000 7fe98a452640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe984070920 con 0x7fe98406fd90 2024-09-16T15:37:48.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.967+0000 7fe98a452640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fe9840b4440 con 0x7fe9840ccd00 2024-09-16T15:37:48.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.967+0000 7fe9889ef640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe9841438b0 0x7fe9840b04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:48.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.967+0000 7fe9889ef640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe9841438b0 0x7fe9840b04a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59488/0 (socket says 172.21.15.98:59488) 2024-09-16T15:37:48.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.967+0000 7fe9889ef640 1 -- 172.21.15.98:0/1840024083 learned_addr learned my addr 172.21.15.98:0/1840024083 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:37:48.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.968+0000 7fe9837fe640 1 --2- 172.21.15.98:0/1840024083 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9840ccd00 0x7fe984159060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:48.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.968+0000 7fe983fff640 1 --2- 172.21.15.98:0/1840024083 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe98406fd90 0x7fe9841f9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:48.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.968+0000 7fe9889ef640 1 -- 172.21.15.98:0/1840024083 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9840ccd00 msgr2=0x7fe984159060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:48.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.968+0000 7fe9889ef640 1 --2- 172.21.15.98:0/1840024083 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9840ccd00 0x7fe984159060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:48.972 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.968+0000 7fe9889ef640 1 -- 172.21.15.98:0/1840024083 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe98406fd90 msgr2=0x7fe9841f9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:48.972 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.968+0000 7fe9889ef640 1 --2- 172.21.15.98:0/1840024083 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe98406fd90 0x7fe9841f9080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:48.972 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.968+0000 7fe9889ef640 1 -- 172.21.15.98:0/1840024083 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9841f95c0 con 0x7fe9841438b0 2024-09-16T15:37:48.972 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.968+0000 7fe983fff640 1 --2- 172.21.15.98:0/1840024083 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe98406fd90 0x7fe9841f9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T15:37:48.972 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.968+0000 7fe9889ef640 1 --2- 172.21.15.98:0/1840024083 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe9841438b0 0x7fe9840b04a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe97c00cd10 tx=0x7fe97c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:48.972 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.968+0000 7fe980ff9640 1 -- 172.21.15.98:0/1840024083 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe97c00f450 con 0x7fe9841438b0 2024-09-16T15:37:48.972 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.968+0000 7fe980ff9640 1 -- 172.21.15.98:0/1840024083 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe97c00f6e0 con 0x7fe9841438b0 2024-09-16T15:37:48.972 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.968+0000 7fe98a452640 1 -- 172.21.15.98:0/1840024083 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe984159d90 con 0x7fe9841438b0 2024-09-16T15:37:48.972 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.968+0000 7fe980ff9640 1 -- 172.21.15.98:0/1840024083 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe97c00fb30 con 0x7fe9841438b0 2024-09-16T15:37:48.972 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.968+0000 7fe98a452640 1 -- 172.21.15.98:0/1840024083 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe98415a350 con 0x7fe9841438b0 2024-09-16T15:37:48.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.969+0000 7fe98a452640 1 -- 172.21.15.98:0/1840024083 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9840b3f00 con 0x7fe9841438b0 2024-09-16T15:37:48.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.970+0000 7fe980ff9640 1 -- 172.21.15.98:0/1840024083 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7fe97c00fcd0 con 0x7fe9841438b0 2024-09-16T15:37:48.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.970+0000 7fe980ff9640 1 --2- 172.21.15.98:0/1840024083 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fe970078850 0x7fe97007ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:48.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.970+0000 7fe980ff9640 1 -- 172.21.15.98:0/1840024083 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fe97c09b4e0 con 0x7fe9841438b0 2024-09-16T15:37:48.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.971+0000 7fe983fff640 1 --2- 172.21.15.98:0/1840024083 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fe970078850 0x7fe97007ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:48.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.971+0000 7fe983fff640 1 --2- 172.21.15.98:0/1840024083 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fe970078850 0x7fe97007ad10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe974000f60 tx=0x7fe974009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:48.976 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:48.975+0000 7fe980ff9640 1 -- 172.21.15.98:0/1840024083 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7fe9841f95c0 con 0x7fe9841438b0 2024-09-16T15:37:49.151 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.149+0000 7fe98a452640 1 -- 172.21.15.98:0/1840024083 --> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe9840cd430 con 0x7fe970078850 2024-09-16T15:37:49.155 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.154+0000 7fe980ff9640 1 -- 172.21.15.98:0/1840024083 <== mgr.4100 v2:172.21.15.135:6800/699234772 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247211 (secure 0 0 0) 0x7fe9840cd430 con 0x7fe970078850 2024-09-16T15:37:49.158 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:37:49.159 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2024-09-16T15:37:49.161 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.157+0000 7fe98a452640 1 -- 172.21.15.98:0/1840024083 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fe970078850 msgr2=0x7fe97007ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:49.161 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.157+0000 7fe98a452640 1 --2- 172.21.15.98:0/1840024083 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fe970078850 0x7fe97007ad10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe974000f60 tx=0x7fe974009040 comp rx=0 tx=0).stop 2024-09-16T15:37:49.161 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.157+0000 7fe98a452640 1 -- 172.21.15.98:0/1840024083 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe9841438b0 msgr2=0x7fe9840b04a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:49.161 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.157+0000 7fe98a452640 1 --2- 172.21.15.98:0/1840024083 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe9841438b0 0x7fe9840b04a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe97c00cd10 tx=0x7fe97c00a620 comp rx=0 tx=0).stop 2024-09-16T15:37:49.161 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.157+0000 7fe98a452640 1 -- 172.21.15.98:0/1840024083 shutdown_connections 2024-09-16T15:37:49.161 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.157+0000 7fe98a452640 1 --2- 172.21.15.98:0/1840024083 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe9841438b0 0x7fe9840b04a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:49.161 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.157+0000 7fe98a452640 1 --2- 172.21.15.98:0/1840024083 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe9840ccd00 0x7fe984159060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:49.161 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.157+0000 7fe98a452640 1 --2- 172.21.15.98:0/1840024083 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fe970078850 0x7fe97007ad10 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:49.161 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.157+0000 7fe98a452640 1 --2- 172.21.15.98:0/1840024083 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe98406fd90 0x7fe9841f9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:49.161 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.157+0000 7fe98a452640 1 -- 172.21.15.98:0/1840024083 >> 172.21.15.98:0/1840024083 conn(0x7fe9840b1950 msgr2=0x7fe98413e0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:49.161 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.157+0000 7fe98a452640 1 -- 172.21.15.98:0/1840024083 shutdown_connections 2024-09-16T15:37:49.162 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.157+0000 7fe98a452640 1 -- 172.21.15.98:0/1840024083 wait complete. 2024-09-16T15:37:49.169 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-16T15:37:48.709658+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":7,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218996,"kb_used_data":2756,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755724,"statfs":{"total":773094113280,"available":772869861376,"internally_reserved":0,"allocated":2822144,"data_stored":1707716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001463"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.506408+0000","last_change":"2024-09-16T15:37:43.506408+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.506408+0000","last_undegraded":"2024-09-16T15:37:43.506408+0000","last_fullsized":"2024-09-16T15:37:43.506408+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.506105+0000","last_change":"2024-09-16T15:37:43.506105+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.506105+0000","last_undegraded":"2024-09-16T15:37:43.506105+0000","last_fullsized":"2024-09-16T15:37:43.506105+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.503720+0000","last_change":"2024-09-16T15:37:43.503720+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.503720+0000","last_undegraded":"2024-09-16T15:37:43.503720+0000","last_fullsized":"2024-09-16T15:37:43.503720+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.503566+0000","last_change":"2024-09-16T15:37:43.503566+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.503566+0000","last_undegraded":"2024-09-16T15:37:43.503566+0000","last_fullsized":"2024-09-16T15:37:43.503566+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.502948+0000","last_change":"2024-09-16T15:37:43.502948+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.502948+0000","last_undegraded":"2024-09-16T15:37:43.502948+0000","last_fullsized":"2024-09-16T15:37:43.502948+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.503197+0000","last_change":"2024-09-16T15:37:43.503197+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.503197+0000","last_undegraded":"2024-09-16T15:37:43.503197+0000","last_fullsized":"2024-09-16T15:37:43.503197+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.504333+0000","last_change":"2024-09-16T15:37:43.504333+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.504333+0000","last_undegraded":"2024-09-16T15:37:43.504333+0000","last_fullsized":"2024-09-16T15:37:43.504333+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.505582+0000","last_change":"2024-09-16T15:37:43.505582+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.505582+0000","last_undegraded":"2024-09-16T15:37:43.505582+0000","last_fullsized":"2024-09-16T15:37:43.505582+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.501405+0000","last_change":"2024-09-16T15:37:43.501405+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.501405+0000","last_undegraded":"2024-09-16T15:37:43.501405+0000","last_fullsized":"2024-09-16T15:37:43.501405+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.505383+0000","last_change":"2024-09-16T15:37:43.505383+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.505383+0000","last_undegraded":"2024-09-16T15:37:43.505383+0000","last_fullsized":"2024-09-16T15:37:43.505383+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.505413+0000","last_change":"2024-09-16T15:37:43.505413+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.505413+0000","last_undegraded":"2024-09-16T15:37:43.505413+0000","last_fullsized":"2024-09-16T15:37:43.505413+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.506807+0000","last_change":"2024-09-16T15:37:43.506807+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.506807+0000","last_undegraded":"2024-09-16T15:37:43.506807+0000","last_fullsized":"2024-09-16T15:37:43.506807+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.526086+0000","last_change":"2024-09-16T15:37:44.515572+0000","last_active":"2024-09-16T15:37:45.526086+0000","last_peered":"2024-09-16T15:37:45.526086+0000","last_clean":"2024-09-16T15:37:45.526086+0000","last_became_active":"2024-09-16T15:37:44.514667+0000","last_became_peered":"2024-09-16T15:37:44.514667+0000","last_unstale":"2024-09-16T15:37:45.526086+0000","last_undegraded":"2024-09-16T15:37:45.526086+0000","last_fullsized":"2024-09-16T15:37:45.526086+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:37:31.235473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.526350+0000","last_change":"2024-09-16T15:37:44.517134+0000","last_active":"2024-09-16T15:37:45.526350+0000","last_peered":"2024-09-16T15:37:45.526350+0000","last_clean":"2024-09-16T15:37:45.526350+0000","last_became_active":"2024-09-16T15:37:44.515946+0000","last_became_peered":"2024-09-16T15:37:44.515946+0000","last_unstale":"2024-09-16T15:37:45.526350+0000","last_undegraded":"2024-09-16T15:37:45.526350+0000","last_fullsized":"2024-09-16T15:37:45.526350+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:01:35.813267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.503610+0000","last_change":"2024-09-16T15:37:43.503610+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.503610+0000","last_undegraded":"2024-09-16T15:37:43.503610+0000","last_fullsized":"2024-09-16T15:37:43.503610+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.510644+0000","last_change":"2024-09-16T15:37:43.510644+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.510644+0000","last_undegraded":"2024-09-16T15:37:43.510644+0000","last_fullsized":"2024-09-16T15:37:43.510644+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.509791+0000","last_change":"2024-09-16T15:37:43.509791+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.509791+0000","last_undegraded":"2024-09-16T15:37:43.509791+0000","last_fullsized":"2024-09-16T15:37:43.509791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.509988+0000","last_change":"2024-09-16T15:37:43.509988+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.509988+0000","last_undegraded":"2024-09-16T15:37:43.509988+0000","last_fullsized":"2024-09-16T15:37:43.509988+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.508646+0000","last_change":"2024-09-16T15:37:43.508646+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.508646+0000","last_undegraded":"2024-09-16T15:37:43.508646+0000","last_fullsized":"2024-09-16T15:37:43.508646+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.506205+0000","last_change":"2024-09-16T15:37:43.506205+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.506205+0000","last_undegraded":"2024-09-16T15:37:43.506205+0000","last_fullsized":"2024-09-16T15:37:43.506205+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.508778+0000","last_change":"2024-09-16T15:37:43.508778+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.508778+0000","last_undegraded":"2024-09-16T15:37:43.508778+0000","last_fullsized":"2024-09-16T15:37:43.508778+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.502662+0000","last_change":"2024-09-16T15:37:43.502662+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.502662+0000","last_undegraded":"2024-09-16T15:37:43.502662+0000","last_fullsized":"2024-09-16T15:37:43.502662+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.502763+0000","last_change":"2024-09-16T15:37:43.502763+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.502763+0000","last_undegraded":"2024-09-16T15:37:43.502763+0000","last_fullsized":"2024-09-16T15:37:43.502763+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.506771+0000","last_change":"2024-09-16T15:37:43.506771+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.506771+0000","last_undegraded":"2024-09-16T15:37:43.506771+0000","last_fullsized":"2024-09-16T15:37:43.506771+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.507085+0000","last_change":"2024-09-16T15:37:43.507085+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.507085+0000","last_undegraded":"2024-09-16T15:37:43.507085+0000","last_fullsized":"2024-09-16T15:37:43.507085+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.504681+0000","last_change":"2024-09-16T15:37:43.504681+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.504681+0000","last_undegraded":"2024-09-16T15:37:43.504681+0000","last_fullsized":"2024-09-16T15:37:43.504681+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.526539+0000","last_change":"2024-09-16T15:37:44.519708+0000","last_active":"2024-09-16T15:37:45.526539+0000","last_peered":"2024-09-16T15:37:45.526539+0000","last_clean":"2024-09-16T15:37:45.526539+0000","last_became_active":"2024-09-16T15:37:44.519439+0000","last_became_peered":"2024-09-16T15:37:44.519439+0000","last_unstale":"2024-09-16T15:37:45.526539+0000","last_undegraded":"2024-09-16T15:37:45.526539+0000","last_fullsized":"2024-09-16T15:37:45.526539+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:56:40.956164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.526026+0000","last_change":"2024-09-16T15:37:44.518861+0000","last_active":"2024-09-16T15:37:45.526026+0000","last_peered":"2024-09-16T15:37:45.526026+0000","last_clean":"2024-09-16T15:37:45.526026+0000","last_became_active":"2024-09-16T15:37:44.518600+0000","last_became_peered":"2024-09-16T15:37:44.518600+0000","last_unstale":"2024-09-16T15:37:45.526026+0000","last_undegraded":"2024-09-16T15:37:45.526026+0000","last_fullsized":"2024-09-16T15:37:45.526026+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:52:07.454732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.504364+0000","last_change":"2024-09-16T15:37:43.504364+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.504364+0000","last_undegraded":"2024-09-16T15:37:43.504364+0000","last_fullsized":"2024-09-16T15:37:43.504364+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.508166+0000","last_change":"2024-09-16T15:37:43.508166+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.508166+0000","last_undegraded":"2024-09-16T15:37:43.508166+0000","last_fullsized":"2024-09-16T15:37:43.508166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.509609+0000","last_change":"2024-09-16T15:37:43.509609+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.509609+0000","last_undegraded":"2024-09-16T15:37:43.509609+0000","last_fullsized":"2024-09-16T15:37:43.509609+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.502933+0000","last_change":"2024-09-16T15:37:43.502933+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.502933+0000","last_undegraded":"2024-09-16T15:37:43.502933+0000","last_fullsized":"2024-09-16T15:37:43.502933+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.501835+0000","last_change":"2024-09-16T15:37:43.501835+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.501835+0000","last_undegraded":"2024-09-16T15:37:43.501835+0000","last_fullsized":"2024-09-16T15:37:43.501835+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.513635+0000","last_change":"2024-09-16T15:37:43.510897+0000","last_active":"2024-09-16T15:37:43.513635+0000","last_peered":"2024-09-16T15:37:43.513635+0000","last_clean":"2024-09-16T15:37:43.513635+0000","last_became_active":"2024-09-16T15:37:43.510468+0000","last_became_peered":"2024-09-16T15:37:43.510468+0000","last_unstale":"2024-09-16T15:37:43.513635+0000","last_undegraded":"2024-09-16T15:37:43.513635+0000","last_fullsized":"2024-09-16T15:37:43.513635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:58:36.781822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.507082+0000","last_change":"2024-09-16T15:37:43.507082+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.507082+0000","last_undegraded":"2024-09-16T15:37:43.507082+0000","last_fullsized":"2024-09-16T15:37:43.507082+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.523221+0000","last_change":"2024-09-16T15:37:43.521672+0000","last_active":"2024-09-16T15:37:43.523221+0000","last_peered":"2024-09-16T15:37:43.523221+0000","last_clean":"2024-09-16T15:37:43.523221+0000","last_became_active":"2024-09-16T15:37:43.521418+0000","last_became_peered":"2024-09-16T15:37:43.521418+0000","last_unstale":"2024-09-16T15:37:43.523221+0000","last_undegraded":"2024-09-16T15:37:43.523221+0000","last_fullsized":"2024-09-16T15:37:43.523221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:03:21.436525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.525828+0000","last_change":"2024-09-16T15:37:43.517465+0000","last_active":"2024-09-16T15:37:45.525828+0000","last_peered":"2024-09-16T15:37:45.525828+0000","last_clean":"2024-09-16T15:37:45.525828+0000","last_became_active":"2024-09-16T15:37:43.517177+0000","last_became_peered":"2024-09-16T15:37:43.517177+0000","last_unstale":"2024-09-16T15:37:45.525828+0000","last_undegraded":"2024-09-16T15:37:45.525828+0000","last_fullsized":"2024-09-16T15:37:45.525828+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T21:38:37.823375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.504239+0000","last_change":"2024-09-16T15:37:43.504239+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.504239+0000","last_undegraded":"2024-09-16T15:37:43.504239+0000","last_fullsized":"2024-09-16T15:37:43.504239+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.521219+0000","last_change":"2024-09-16T15:37:43.519319+0000","last_active":"2024-09-16T15:37:43.521219+0000","last_peered":"2024-09-16T15:37:43.521219+0000","last_clean":"2024-09-16T15:37:43.521219+0000","last_became_active":"2024-09-16T15:37:43.518711+0000","last_became_peered":"2024-09-16T15:37:43.518711+0000","last_unstale":"2024-09-16T15:37:43.521219+0000","last_undegraded":"2024-09-16T15:37:43.521219+0000","last_fullsized":"2024-09-16T15:37:43.521219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:25:01.970817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.507140+0000","last_change":"2024-09-16T15:37:43.507140+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.507140+0000","last_undegraded":"2024-09-16T15:37:43.507140+0000","last_fullsized":"2024-09-16T15:37:43.507140+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.516204+0000","last_change":"2024-09-16T15:37:43.514400+0000","last_active":"2024-09-16T15:37:43.516204+0000","last_peered":"2024-09-16T15:37:43.516204+0000","last_clean":"2024-09-16T15:37:43.516204+0000","last_became_active":"2024-09-16T15:37:43.514124+0000","last_became_peered":"2024-09-16T15:37:43.514124+0000","last_unstale":"2024-09-16T15:37:43.516204+0000","last_undegraded":"2024-09-16T15:37:43.516204+0000","last_fullsized":"2024-09-16T15:37:43.516204+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:58:36.781822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.504279+0000","last_change":"2024-09-16T15:37:43.504279+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.504279+0000","last_undegraded":"2024-09-16T15:37:43.504279+0000","last_fullsized":"2024-09-16T15:37:43.504279+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.517060+0000","last_change":"2024-09-16T15:37:43.515976+0000","last_active":"2024-09-16T15:37:43.517060+0000","last_peered":"2024-09-16T15:37:43.517060+0000","last_clean":"2024-09-16T15:37:43.517060+0000","last_became_active":"2024-09-16T15:37:43.515426+0000","last_became_peered":"2024-09-16T15:37:43.515426+0000","last_unstale":"2024-09-16T15:37:43.517060+0000","last_undegraded":"2024-09-16T15:37:43.517060+0000","last_fullsized":"2024-09-16T15:37:43.517060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T21:42:39.448578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.503121+0000","last_change":"2024-09-16T15:37:43.503121+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.503121+0000","last_undegraded":"2024-09-16T15:37:43.503121+0000","last_fullsized":"2024-09-16T15:37:43.503121+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.522596+0000","last_change":"2024-09-16T15:37:43.516257+0000","last_active":"2024-09-16T15:37:43.522596+0000","last_peered":"2024-09-16T15:37:43.522596+0000","last_clean":"2024-09-16T15:37:43.522596+0000","last_became_active":"2024-09-16T15:37:43.515944+0000","last_became_peered":"2024-09-16T15:37:43.515944+0000","last_unstale":"2024-09-16T15:37:43.522596+0000","last_undegraded":"2024-09-16T15:37:43.522596+0000","last_fullsized":"2024-09-16T15:37:43.522596+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:58:36.781822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.502789+0000","last_change":"2024-09-16T15:37:43.502789+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.502789+0000","last_undegraded":"2024-09-16T15:37:43.502789+0000","last_fullsized":"2024-09-16T15:37:43.502789+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.516162+0000","last_change":"2024-09-16T15:37:43.514513+0000","last_active":"2024-09-16T15:37:43.516162+0000","last_peered":"2024-09-16T15:37:43.516162+0000","last_clean":"2024-09-16T15:37:43.516162+0000","last_became_active":"2024-09-16T15:37:43.514196+0000","last_became_peered":"2024-09-16T15:37:43.514196+0000","last_unstale":"2024-09-16T15:37:43.516162+0000","last_undegraded":"2024-09-16T15:37:43.516162+0000","last_fullsized":"2024-09-16T15:37:43.516162+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:43:24.500518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.504417+0000","last_change":"2024-09-16T15:37:43.504417+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.504417+0000","last_undegraded":"2024-09-16T15:37:43.504417+0000","last_fullsized":"2024-09-16T15:37:43.504417+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.525199+0000","last_change":"2024-09-16T15:37:43.521768+0000","last_active":"2024-09-16T15:37:43.525199+0000","last_peered":"2024-09-16T15:37:43.525199+0000","last_clean":"2024-09-16T15:37:43.525199+0000","last_became_active":"2024-09-16T15:37:43.521541+0000","last_became_peered":"2024-09-16T15:37:43.521541+0000","last_unstale":"2024-09-16T15:37:43.525199+0000","last_undegraded":"2024-09-16T15:37:43.525199+0000","last_fullsized":"2024-09-16T15:37:43.525199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:24:48.654268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.526567+0000","last_change":"2024-09-16T15:37:44.520303+0000","last_active":"2024-09-16T15:37:45.526567+0000","last_peered":"2024-09-16T15:37:45.526567+0000","last_clean":"2024-09-16T15:37:45.526567+0000","last_became_active":"2024-09-16T15:37:44.520036+0000","last_became_peered":"2024-09-16T15:37:44.520036+0000","last_unstale":"2024-09-16T15:37:45.526567+0000","last_undegraded":"2024-09-16T15:37:45.526567+0000","last_fullsized":"2024-09-16T15:37:45.526567+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:02:45.771447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.521972+0000","last_change":"2024-09-16T15:37:43.519519+0000","last_active":"2024-09-16T15:37:43.521972+0000","last_peered":"2024-09-16T15:37:43.521972+0000","last_clean":"2024-09-16T15:37:43.521972+0000","last_became_active":"2024-09-16T15:37:43.518682+0000","last_became_peered":"2024-09-16T15:37:43.518682+0000","last_unstale":"2024-09-16T15:37:43.521972+0000","last_undegraded":"2024-09-16T15:37:43.521972+0000","last_fullsized":"2024-09-16T15:37:43.521972+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T21:23:32.133055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.508570+0000","last_change":"2024-09-16T15:37:43.508570+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.508570+0000","last_undegraded":"2024-09-16T15:37:43.508570+0000","last_fullsized":"2024-09-16T15:37:43.508570+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.521229+0000","last_change":"2024-09-16T15:37:43.519576+0000","last_active":"2024-09-16T15:37:43.521229+0000","last_peered":"2024-09-16T15:37:43.521229+0000","last_clean":"2024-09-16T15:37:43.521229+0000","last_became_active":"2024-09-16T15:37:43.517609+0000","last_became_peered":"2024-09-16T15:37:43.517609+0000","last_unstale":"2024-09-16T15:37:43.521229+0000","last_undegraded":"2024-09-16T15:37:43.521229+0000","last_fullsized":"2024-09-16T15:37:43.521229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:37:32.374134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.501758+0000","last_change":"2024-09-16T15:37:43.501758+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.501758+0000","last_undegraded":"2024-09-16T15:37:43.501758+0000","last_fullsized":"2024-09-16T15:37:43.501758+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.517876+0000","last_change":"2024-09-16T15:37:43.514266+0000","last_active":"2024-09-16T15:37:43.517876+0000","last_peered":"2024-09-16T15:37:43.517876+0000","last_clean":"2024-09-16T15:37:43.517876+0000","last_became_active":"2024-09-16T15:37:43.513980+0000","last_became_peered":"2024-09-16T15:37:43.513980+0000","last_unstale":"2024-09-16T15:37:43.517876+0000","last_undegraded":"2024-09-16T15:37:43.517876+0000","last_fullsized":"2024-09-16T15:37:43.517876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:24:48.654268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.504309+0000","last_change":"2024-09-16T15:37:43.504309+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.504309+0000","last_undegraded":"2024-09-16T15:37:43.504309+0000","last_fullsized":"2024-09-16T15:37:43.504309+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.521176+0000","last_change":"2024-09-16T15:37:43.518884+0000","last_active":"2024-09-16T15:37:43.521176+0000","last_peered":"2024-09-16T15:37:43.521176+0000","last_clean":"2024-09-16T15:37:43.521176+0000","last_became_active":"2024-09-16T15:37:43.517494+0000","last_became_peered":"2024-09-16T15:37:43.517494+0000","last_unstale":"2024-09-16T15:37:43.521176+0000","last_undegraded":"2024-09-16T15:37:43.521176+0000","last_fullsized":"2024-09-16T15:37:43.521176+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:45:09.277422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.503176+0000","last_change":"2024-09-16T15:37:43.503176+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.503176+0000","last_undegraded":"2024-09-16T15:37:43.503176+0000","last_fullsized":"2024-09-16T15:37:43.503176+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.517928+0000","last_change":"2024-09-16T15:37:43.514250+0000","last_active":"2024-09-16T15:37:43.517928+0000","last_peered":"2024-09-16T15:37:43.517928+0000","last_clean":"2024-09-16T15:37:43.517928+0000","last_became_active":"2024-09-16T15:37:43.513954+0000","last_became_peered":"2024-09-16T15:37:43.513954+0000","last_unstale":"2024-09-16T15:37:43.517928+0000","last_undegraded":"2024-09-16T15:37:43.517928+0000","last_fullsized":"2024-09-16T15:37:43.517928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:58:36.781822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.505682+0000","last_change":"2024-09-16T15:37:43.505682+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.505682+0000","last_undegraded":"2024-09-16T15:37:43.505682+0000","last_fullsized":"2024-09-16T15:37:43.505682+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.516491+0000","last_change":"2024-09-16T15:37:43.514330+0000","last_active":"2024-09-16T15:37:43.516491+0000","last_peered":"2024-09-16T15:37:43.516491+0000","last_clean":"2024-09-16T15:37:43.516491+0000","last_became_active":"2024-09-16T15:37:43.513900+0000","last_became_peered":"2024-09-16T15:37:43.513900+0000","last_unstale":"2024-09-16T15:37:43.516491+0000","last_undegraded":"2024-09-16T15:37:43.516491+0000","last_fullsized":"2024-09-16T15:37:43.516491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T23:50:34.279091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.505063+0000","last_change":"2024-09-16T15:37:43.505063+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.505063+0000","last_undegraded":"2024-09-16T15:37:43.505063+0000","last_fullsized":"2024-09-16T15:37:43.505063+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.526586+0000","last_change":"2024-09-16T15:37:43.520873+0000","last_active":"2024-09-16T15:37:45.526586+0000","last_peered":"2024-09-16T15:37:45.526586+0000","last_clean":"2024-09-16T15:37:45.526586+0000","last_became_active":"2024-09-16T15:37:43.520561+0000","last_became_peered":"2024-09-16T15:37:43.520561+0000","last_unstale":"2024-09-16T15:37:45.526586+0000","last_undegraded":"2024-09-16T15:37:45.526586+0000","last_fullsized":"2024-09-16T15:37:45.526586+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:08:30.145981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.506168+0000","last_change":"2024-09-16T15:37:43.506168+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.506168+0000","last_undegraded":"2024-09-16T15:37:43.506168+0000","last_fullsized":"2024-09-16T15:37:43.506168+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":107,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.498711+0000","last_change":"2024-09-16T15:37:37.258601+0000","last_active":"2024-09-16T15:37:43.498711+0000","last_peered":"2024-09-16T15:37:43.498711+0000","last_clean":"2024-09-16T15:37:43.498711+0000","last_became_active":"2024-09-16T15:37:37.257584+0000","last_became_peered":"2024-09-16T15:37:37.257584+0000","last_unstale":"2024-09-16T15:37:43.498711+0000","last_undegraded":"2024-09-16T15:37:43.498711+0000","last_fullsized":"2024-09-16T15:37:43.498711+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:35.447043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:35.447043+0000","last_clean_scrub_stamp":"2024-09-16T15:37:35.447043+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:43:17.464894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.513875+0000","last_change":"2024-09-16T15:37:43.510139+0000","last_active":"2024-09-16T15:37:43.513875+0000","last_peered":"2024-09-16T15:37:43.513875+0000","last_clean":"2024-09-16T15:37:43.513875+0000","last_became_active":"2024-09-16T15:37:43.509820+0000","last_became_peered":"2024-09-16T15:37:43.509820+0000","last_unstale":"2024-09-16T15:37:43.513875+0000","last_undegraded":"2024-09-16T15:37:43.513875+0000","last_fullsized":"2024-09-16T15:37:43.513875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:18:57.765147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.507336+0000","last_change":"2024-09-16T15:37:43.507336+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.507336+0000","last_undegraded":"2024-09-16T15:37:43.507336+0000","last_fullsized":"2024-09-16T15:37:43.507336+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.521246+0000","last_change":"2024-09-16T15:37:43.519442+0000","last_active":"2024-09-16T15:37:43.521246+0000","last_peered":"2024-09-16T15:37:43.521246+0000","last_clean":"2024-09-16T15:37:43.521246+0000","last_became_active":"2024-09-16T15:37:43.519204+0000","last_became_peered":"2024-09-16T15:37:43.519204+0000","last_unstale":"2024-09-16T15:37:43.521246+0000","last_undegraded":"2024-09-16T15:37:43.521246+0000","last_fullsized":"2024-09-16T15:37:43.521246+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:42:35.749344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.525649+0000","last_change":"2024-09-16T15:37:44.511988+0000","last_active":"2024-09-16T15:37:45.525649+0000","last_peered":"2024-09-16T15:37:45.525649+0000","last_clean":"2024-09-16T15:37:45.525649+0000","last_became_active":"2024-09-16T15:37:44.511679+0000","last_became_peered":"2024-09-16T15:37:44.511679+0000","last_unstale":"2024-09-16T15:37:45.525649+0000","last_undegraded":"2024-09-16T15:37:45.525649+0000","last_fullsized":"2024-09-16T15:37:45.525649+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:39:56.702467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.522564+0000","last_change":"2024-09-16T15:37:43.515953+0000","last_active":"2024-09-16T15:37:43.522564+0000","last_peered":"2024-09-16T15:37:43.522564+0000","last_clean":"2024-09-16T15:37:43.522564+0000","last_became_active":"2024-09-16T15:37:43.515662+0000","last_became_peered":"2024-09-16T15:37:43.515662+0000","last_unstale":"2024-09-16T15:37:43.522564+0000","last_undegraded":"2024-09-16T15:37:43.522564+0000","last_fullsized":"2024-09-16T15:37:43.522564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:18:57.765147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.505160+0000","last_change":"2024-09-16T15:37:43.505160+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.505160+0000","last_undegraded":"2024-09-16T15:37:43.505160+0000","last_fullsized":"2024-09-16T15:37:43.505160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.514888+0000","last_change":"2024-09-16T15:37:43.513231+0000","last_active":"2024-09-16T15:37:43.514888+0000","last_peered":"2024-09-16T15:37:43.514888+0000","last_clean":"2024-09-16T15:37:43.514888+0000","last_became_active":"2024-09-16T15:37:43.512954+0000","last_became_peered":"2024-09-16T15:37:43.512954+0000","last_unstale":"2024-09-16T15:37:43.514888+0000","last_undegraded":"2024-09-16T15:37:43.514888+0000","last_fullsized":"2024-09-16T15:37:43.514888+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:58:36.781822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.503500+0000","last_change":"2024-09-16T15:37:43.503500+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.503500+0000","last_undegraded":"2024-09-16T15:37:43.503500+0000","last_fullsized":"2024-09-16T15:37:43.503500+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.513599+0000","last_change":"2024-09-16T15:37:43.510480+0000","last_active":"2024-09-16T15:37:43.513599+0000","last_peered":"2024-09-16T15:37:43.513599+0000","last_clean":"2024-09-16T15:37:43.513599+0000","last_became_active":"2024-09-16T15:37:43.510223+0000","last_became_peered":"2024-09-16T15:37:43.510223+0000","last_unstale":"2024-09-16T15:37:43.513599+0000","last_undegraded":"2024-09-16T15:37:43.513599+0000","last_fullsized":"2024-09-16T15:37:43.513599+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:18:57.765147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.503364+0000","last_change":"2024-09-16T15:37:43.503364+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.503364+0000","last_undegraded":"2024-09-16T15:37:43.503364+0000","last_fullsized":"2024-09-16T15:37:43.503364+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.516668+0000","last_change":"2024-09-16T15:37:43.515757+0000","last_active":"2024-09-16T15:37:43.516668+0000","last_peered":"2024-09-16T15:37:43.516668+0000","last_clean":"2024-09-16T15:37:43.516668+0000","last_became_active":"2024-09-16T15:37:43.515199+0000","last_became_peered":"2024-09-16T15:37:43.515199+0000","last_unstale":"2024-09-16T15:37:43.516668+0000","last_undegraded":"2024-09-16T15:37:43.516668+0000","last_fullsized":"2024-09-16T15:37:43.516668+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T23:50:34.279091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.526573+0000","last_change":"2024-09-16T15:37:44.515147+0000","last_active":"2024-09-16T15:37:45.526573+0000","last_peered":"2024-09-16T15:37:45.526573+0000","last_clean":"2024-09-16T15:37:45.526573+0000","last_became_active":"2024-09-16T15:37:44.514518+0000","last_became_peered":"2024-09-16T15:37:44.514518+0000","last_unstale":"2024-09-16T15:37:45.526573+0000","last_undegraded":"2024-09-16T15:37:45.526573+0000","last_fullsized":"2024-09-16T15:37:45.526573+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:57:36.296851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.522756+0000","last_change":"2024-09-16T15:37:43.518081+0000","last_active":"2024-09-16T15:37:43.522756+0000","last_peered":"2024-09-16T15:37:43.522756+0000","last_clean":"2024-09-16T15:37:43.522756+0000","last_became_active":"2024-09-16T15:37:43.517744+0000","last_became_peered":"2024-09-16T15:37:43.517744+0000","last_unstale":"2024-09-16T15:37:43.522756+0000","last_undegraded":"2024-09-16T15:37:43.522756+0000","last_fullsized":"2024-09-16T15:37:43.522756+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:08:31.665964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.508877+0000","last_change":"2024-09-16T15:37:43.508877+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.508877+0000","last_undegraded":"2024-09-16T15:37:43.508877+0000","last_fullsized":"2024-09-16T15:37:43.508877+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.521293+0000","last_change":"2024-09-16T15:37:43.519357+0000","last_active":"2024-09-16T15:37:43.521293+0000","last_peered":"2024-09-16T15:37:43.521293+0000","last_clean":"2024-09-16T15:37:43.521293+0000","last_became_active":"2024-09-16T15:37:43.519050+0000","last_became_peered":"2024-09-16T15:37:43.519050+0000","last_unstale":"2024-09-16T15:37:43.521293+0000","last_undegraded":"2024-09-16T15:37:43.521293+0000","last_fullsized":"2024-09-16T15:37:43.521293+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:08:31.665964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.508507+0000","last_change":"2024-09-16T15:37:43.508507+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.508507+0000","last_undegraded":"2024-09-16T15:37:43.508507+0000","last_fullsized":"2024-09-16T15:37:43.508507+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.521054+0000","last_change":"2024-09-16T15:37:43.517924+0000","last_active":"2024-09-16T15:37:43.521054+0000","last_peered":"2024-09-16T15:37:43.521054+0000","last_clean":"2024-09-16T15:37:43.521054+0000","last_became_active":"2024-09-16T15:37:43.516036+0000","last_became_peered":"2024-09-16T15:37:43.516036+0000","last_unstale":"2024-09-16T15:37:43.521054+0000","last_undegraded":"2024-09-16T15:37:43.521054+0000","last_fullsized":"2024-09-16T15:37:43.521054+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T23:52:54.008046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.503358+0000","last_change":"2024-09-16T15:37:43.503358+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.503358+0000","last_undegraded":"2024-09-16T15:37:43.503358+0000","last_fullsized":"2024-09-16T15:37:43.503358+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.522744+0000","last_change":"2024-09-16T15:37:43.518084+0000","last_active":"2024-09-16T15:37:43.522744+0000","last_peered":"2024-09-16T15:37:43.522744+0000","last_clean":"2024-09-16T15:37:43.522744+0000","last_became_active":"2024-09-16T15:37:43.517773+0000","last_became_peered":"2024-09-16T15:37:43.517773+0000","last_unstale":"2024-09-16T15:37:43.522744+0000","last_undegraded":"2024-09-16T15:37:43.522744+0000","last_fullsized":"2024-09-16T15:37:43.522744+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:25:01.970817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.507353+0000","last_change":"2024-09-16T15:37:43.507353+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.507353+0000","last_undegraded":"2024-09-16T15:37:43.507353+0000","last_fullsized":"2024-09-16T15:37:43.507353+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.526487+0000","last_change":"2024-09-16T15:37:43.511936+0000","last_active":"2024-09-16T15:37:45.526487+0000","last_peered":"2024-09-16T15:37:45.526487+0000","last_clean":"2024-09-16T15:37:45.526487+0000","last_became_active":"2024-09-16T15:37:43.511709+0000","last_became_peered":"2024-09-16T15:37:43.511709+0000","last_unstale":"2024-09-16T15:37:45.526487+0000","last_undegraded":"2024-09-16T15:37:45.526487+0000","last_fullsized":"2024-09-16T15:37:45.526487+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:22:48.178297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.510415+0000","last_change":"2024-09-16T15:37:43.510415+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.510415+0000","last_undegraded":"2024-09-16T15:37:43.510415+0000","last_fullsized":"2024-09-16T15:37:43.510415+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.514961+0000","last_change":"2024-09-16T15:37:43.513406+0000","last_active":"2024-09-16T15:37:43.514961+0000","last_peered":"2024-09-16T15:37:43.514961+0000","last_clean":"2024-09-16T15:37:43.514961+0000","last_became_active":"2024-09-16T15:37:43.512994+0000","last_became_peered":"2024-09-16T15:37:43.512994+0000","last_unstale":"2024-09-16T15:37:43.514961+0000","last_undegraded":"2024-09-16T15:37:43.514961+0000","last_fullsized":"2024-09-16T15:37:43.514961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:24:48.654268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.507703+0000","last_change":"2024-09-16T15:37:43.507703+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.507703+0000","last_undegraded":"2024-09-16T15:37:43.507703+0000","last_fullsized":"2024-09-16T15:37:43.507703+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.507590+0000","last_change":"2024-09-16T15:37:43.507590+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.507590+0000","last_undegraded":"2024-09-16T15:37:43.507590+0000","last_fullsized":"2024-09-16T15:37:43.507590+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.517270+0000","last_change":"2024-09-16T15:37:43.512302+0000","last_active":"2024-09-16T15:37:43.517270+0000","last_peered":"2024-09-16T15:37:43.517270+0000","last_clean":"2024-09-16T15:37:43.517270+0000","last_became_active":"2024-09-16T15:37:43.511884+0000","last_became_peered":"2024-09-16T15:37:43.511884+0000","last_unstale":"2024-09-16T15:37:43.517270+0000","last_undegraded":"2024-09-16T15:37:43.517270+0000","last_fullsized":"2024-09-16T15:37:43.517270+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:43:24.500518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.501832+0000","last_change":"2024-09-16T15:37:43.501832+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.501832+0000","last_undegraded":"2024-09-16T15:37:43.501832+0000","last_fullsized":"2024-09-16T15:37:43.501832+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.521108+0000","last_change":"2024-09-16T15:37:43.518058+0000","last_active":"2024-09-16T15:37:43.521108+0000","last_peered":"2024-09-16T15:37:43.521108+0000","last_clean":"2024-09-16T15:37:43.521108+0000","last_became_active":"2024-09-16T15:37:43.517743+0000","last_became_peered":"2024-09-16T15:37:43.517743+0000","last_unstale":"2024-09-16T15:37:43.521108+0000","last_undegraded":"2024-09-16T15:37:43.521108+0000","last_fullsized":"2024-09-16T15:37:43.521108+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:44:54.808566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.506222+0000","last_change":"2024-09-16T15:37:43.506222+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.506222+0000","last_undegraded":"2024-09-16T15:37:43.506222+0000","last_fullsized":"2024-09-16T15:37:43.506222+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.515283+0000","last_change":"2024-09-16T15:37:43.513164+0000","last_active":"2024-09-16T15:37:43.515283+0000","last_peered":"2024-09-16T15:37:43.515283+0000","last_clean":"2024-09-16T15:37:43.515283+0000","last_became_active":"2024-09-16T15:37:43.512890+0000","last_became_peered":"2024-09-16T15:37:43.512890+0000","last_unstale":"2024-09-16T15:37:43.515283+0000","last_undegraded":"2024-09-16T15:37:43.515283+0000","last_fullsized":"2024-09-16T15:37:43.515283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:24:48.654268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.505396+0000","last_change":"2024-09-16T15:37:43.505396+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.505396+0000","last_undegraded":"2024-09-16T15:37:43.505396+0000","last_fullsized":"2024-09-16T15:37:43.505396+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.520386+0000","last_change":"2024-09-16T15:37:43.515725+0000","last_active":"2024-09-16T15:37:43.520386+0000","last_peered":"2024-09-16T15:37:43.520386+0000","last_clean":"2024-09-16T15:37:43.520386+0000","last_became_active":"2024-09-16T15:37:43.515461+0000","last_became_peered":"2024-09-16T15:37:43.515461+0000","last_unstale":"2024-09-16T15:37:43.520386+0000","last_undegraded":"2024-09-16T15:37:43.520386+0000","last_fullsized":"2024-09-16T15:37:43.520386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T23:50:34.279091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":790528,"data_stored":652253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509446,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":208896,"data_stored":68160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":802816,"data_stored":658528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":233472,"data_stored":81235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T15:37:49.174 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3f is not active+clean 2024-09-16T15:37:49.174 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-16T15:37:43.506408+0000', 'last_change': '2024-09-16T15:37:43.506408+0000', 'last_active': '2024-09-16T15:37:43.489547+0000', 'last_peered': '2024-09-16T15:37:43.489547+0000', 'last_clean': '2024-09-16T15:37:43.489547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:37:43.506408+0000', 'last_undegraded': '2024-09-16T15:37:43.506408+0000', 'last_fullsized': '2024-09-16T15:37:43.506408+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_clean_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-16T15:37:49.174 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3e is not active+clean 2024-09-16T15:37:49.174 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-16T15:37:43.506105+0000', 'last_change': '2024-09-16T15:37:43.506105+0000', 'last_active': '2024-09-16T15:37:43.489547+0000', 'last_peered': '2024-09-16T15:37:43.489547+0000', 'last_clean': '2024-09-16T15:37:43.489547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:37:43.506105+0000', 'last_undegraded': '2024-09-16T15:37:43.506105+0000', 'last_fullsized': '2024-09-16T15:37:43.506105+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_clean_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-16T15:37:49.175 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3d is not active+clean 2024-09-16T15:37:49.175 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-16T15:37:43.503720+0000', 'last_change': '2024-09-16T15:37:43.503720+0000', 'last_active': '2024-09-16T15:37:43.489547+0000', 'last_peered': '2024-09-16T15:37:43.489547+0000', 'last_clean': '2024-09-16T15:37:43.489547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:37:43.503720+0000', 'last_undegraded': '2024-09-16T15:37:43.503720+0000', 'last_fullsized': '2024-09-16T15:37:43.503720+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_clean_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-16T15:37:49.175 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3c is not active+clean 2024-09-16T15:37:49.175 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-16T15:37:43.503566+0000', 'last_change': '2024-09-16T15:37:43.503566+0000', 'last_active': '2024-09-16T15:37:43.489547+0000', 'last_peered': '2024-09-16T15:37:43.489547+0000', 'last_clean': '2024-09-16T15:37:43.489547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:37:43.503566+0000', 'last_undegraded': '2024-09-16T15:37:43.503566+0000', 'last_fullsized': '2024-09-16T15:37:43.503566+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_clean_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-16T15:37:49.175 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3b is not active+clean 2024-09-16T15:37:49.175 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-16T15:37:43.502948+0000', 'last_change': '2024-09-16T15:37:43.502948+0000', 'last_active': '2024-09-16T15:37:43.489547+0000', 'last_peered': '2024-09-16T15:37:43.489547+0000', 'last_clean': '2024-09-16T15:37:43.489547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:37:43.502948+0000', 'last_undegraded': '2024-09-16T15:37:43.502948+0000', 'last_fullsized': '2024-09-16T15:37:43.502948+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_clean_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-16T15:37:49.175 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3a is not active+clean 2024-09-16T15:37:49.175 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-16T15:37:43.503197+0000', 'last_change': '2024-09-16T15:37:43.503197+0000', 'last_active': '2024-09-16T15:37:43.489547+0000', 'last_peered': '2024-09-16T15:37:43.489547+0000', 'last_clean': '2024-09-16T15:37:43.489547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:37:43.503197+0000', 'last_undegraded': '2024-09-16T15:37:43.503197+0000', 'last_fullsized': '2024-09-16T15:37:43.503197+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_clean_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-16T15:37:49.175 INFO:tasks.ceph.ceph_manager.ceph:PG 3.39 is not active+clean 2024-09-16T15:37:49.175 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-16T15:37:43.504333+0000', 'last_change': '2024-09-16T15:37:43.504333+0000', 'last_active': '2024-09-16T15:37:43.489547+0000', 'last_peered': '2024-09-16T15:37:43.489547+0000', 'last_clean': '2024-09-16T15:37:43.489547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:37:43.504333+0000', 'last_undegraded': '2024-09-16T15:37:43.504333+0000', 'last_fullsized': '2024-09-16T15:37:43.504333+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_clean_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-16T15:37:49.176 INFO:tasks.ceph.ceph_manager.ceph:PG 3.38 is not active+clean 2024-09-16T15:37:49.176 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-16T15:37:43.505582+0000', 'last_change': '2024-09-16T15:37:43.505582+0000', 'last_active': '2024-09-16T15:37:43.489547+0000', 'last_peered': '2024-09-16T15:37:43.489547+0000', 'last_clean': '2024-09-16T15:37:43.489547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:37:43.505582+0000', 'last_undegraded': '2024-09-16T15:37:43.505582+0000', 'last_fullsized': '2024-09-16T15:37:43.505582+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_clean_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-16T15:37:49.176 INFO:tasks.ceph.ceph_manager.ceph:PG 3.37 is not active+clean 2024-09-16T15:37:49.176 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-16T15:37:43.501405+0000', 'last_change': '2024-09-16T15:37:43.501405+0000', 'last_active': '2024-09-16T15:37:43.489547+0000', 'last_peered': '2024-09-16T15:37:43.489547+0000', 'last_clean': '2024-09-16T15:37:43.489547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:37:43.501405+0000', 'last_undegraded': '2024-09-16T15:37:43.501405+0000', 'last_fullsized': '2024-09-16T15:37:43.501405+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_clean_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-16T15:37:49.176 INFO:tasks.ceph.ceph_manager.ceph:PG 3.36 is not active+clean 2024-09-16T15:37:49.176 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-16T15:37:43.505383+0000', 'last_change': '2024-09-16T15:37:43.505383+0000', 'last_active': '2024-09-16T15:37:43.489547+0000', 'last_peered': '2024-09-16T15:37:43.489547+0000', 'last_clean': '2024-09-16T15:37:43.489547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:37:43.505383+0000', 'last_undegraded': '2024-09-16T15:37:43.505383+0000', 'last_fullsized': '2024-09-16T15:37:43.505383+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_clean_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-16T15:37:49.176 INFO:tasks.ceph.ceph_manager.ceph:PG 3.35 is not active+clean 2024-09-16T15:37:49.176 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-16T15:37:43.505413+0000', 'last_change': '2024-09-16T15:37:43.505413+0000', 'last_active': '2024-09-16T15:37:43.489547+0000', 'last_peered': '2024-09-16T15:37:43.489547+0000', 'last_clean': '2024-09-16T15:37:43.489547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:37:43.505413+0000', 'last_undegraded': '2024-09-16T15:37:43.505413+0000', 'last_fullsized': '2024-09-16T15:37:43.505413+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_clean_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-16T15:37:49.176 INFO:tasks.ceph.ceph_manager.ceph:PG 3.34 is not active+clean 2024-09-16T15:37:49.176 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-16T15:37:43.506807+0000', 'last_change': '2024-09-16T15:37:43.506807+0000', 'last_active': '2024-09-16T15:37:43.489547+0000', 'last_peered': '2024-09-16T15:37:43.489547+0000', 'last_clean': '2024-09-16T15:37:43.489547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:37:43.506807+0000', 'last_undegraded': '2024-09-16T15:37:43.506807+0000', 'last_fullsized': '2024-09-16T15:37:43.506807+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_clean_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-16T15:37:49.176 INFO:tasks.ceph.ceph_manager.ceph:PG 3.31 is not active+clean 2024-09-16T15:37:49.177 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-16T15:37:43.503610+0000', 'last_change': '2024-09-16T15:37:43.503610+0000', 'last_active': '2024-09-16T15:37:43.489547+0000', 'last_peered': '2024-09-16T15:37:43.489547+0000', 'last_clean': '2024-09-16T15:37:43.489547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:37:43.503610+0000', 'last_undegraded': '2024-09-16T15:37:43.503610+0000', 'last_fullsized': '2024-09-16T15:37:43.503610+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_clean_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-16T15:37:49.177 INFO:tasks.ceph.ceph_manager.ceph:PG 3.30 is not active+clean 2024-09-16T15:37:49.177 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-16T15:37:43.510644+0000', 'last_change': '2024-09-16T15:37:43.510644+0000', 'last_active': '2024-09-16T15:37:43.489547+0000', 'last_peered': '2024-09-16T15:37:43.489547+0000', 'last_clean': '2024-09-16T15:37:43.489547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:37:43.510644+0000', 'last_undegraded': '2024-09-16T15:37:43.510644+0000', 'last_fullsized': '2024-09-16T15:37:43.510644+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_clean_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-16T15:37:49.177 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2f is not active+clean 2024-09-16T15:37:49.177 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-16T15:37:43.509791+0000', 'last_change': '2024-09-16T15:37:43.509791+0000', 'last_active': '2024-09-16T15:37:43.489547+0000', 'last_peered': '2024-09-16T15:37:43.489547+0000', 'last_clean': '2024-09-16T15:37:43.489547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:37:43.509791+0000', 'last_undegraded': '2024-09-16T15:37:43.509791+0000', 'last_fullsized': '2024-09-16T15:37:43.509791+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_clean_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-16T15:37:49.177 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2e is not active+clean 2024-09-16T15:37:49.177 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-16T15:37:43.509988+0000', 'last_change': '2024-09-16T15:37:43.509988+0000', 'last_active': '2024-09-16T15:37:43.489547+0000', 'last_peered': '2024-09-16T15:37:43.489547+0000', 'last_clean': '2024-09-16T15:37:43.489547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:37:43.509988+0000', 'last_undegraded': '2024-09-16T15:37:43.509988+0000', 'last_fullsized': '2024-09-16T15:37:43.509988+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_clean_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-16T15:37:49.177 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2d is not active+clean 2024-09-16T15:37:49.177 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-16T15:37:43.508646+0000', 'last_change': '2024-09-16T15:37:43.508646+0000', 'last_active': '2024-09-16T15:37:43.489547+0000', 'last_peered': '2024-09-16T15:37:43.489547+0000', 'last_clean': '2024-09-16T15:37:43.489547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:37:43.508646+0000', 'last_undegraded': '2024-09-16T15:37:43.508646+0000', 'last_fullsized': '2024-09-16T15:37:43.508646+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_clean_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-16T15:37:49.177 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2c is not active+clean 2024-09-16T15:37:49.177 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-16T15:37:43.506205+0000', 'last_change': '2024-09-16T15:37:43.506205+0000', 'last_active': '2024-09-16T15:37:43.489547+0000', 'last_peered': '2024-09-16T15:37:43.489547+0000', 'last_clean': '2024-09-16T15:37:43.489547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:37:43.506205+0000', 'last_undegraded': '2024-09-16T15:37:43.506205+0000', 'last_fullsized': '2024-09-16T15:37:43.506205+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_clean_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-16T15:37:49.177 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2b is not active+clean 2024-09-16T15:37:49.177 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-16T15:37:43.508778+0000', 'last_change': '2024-09-16T15:37:43.508778+0000', 'last_active': '2024-09-16T15:37:43.489547+0000', 'last_peered': '2024-09-16T15:37:43.489547+0000', 'last_clean': '2024-09-16T15:37:43.489547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:37:43.508778+0000', 'last_undegraded': '2024-09-16T15:37:43.508778+0000', 'last_fullsized': '2024-09-16T15:37:43.508778+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_clean_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-16T15:37:49.178 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2a is not active+clean 2024-09-16T15:37:49.178 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-16T15:37:43.502662+0000', 'last_change': '2024-09-16T15:37:43.502662+0000', 'last_active': '2024-09-16T15:37:43.489547+0000', 'last_peered': '2024-09-16T15:37:43.489547+0000', 'last_clean': '2024-09-16T15:37:43.489547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:37:43.502662+0000', 'last_undegraded': '2024-09-16T15:37:43.502662+0000', 'last_fullsized': '2024-09-16T15:37:43.502662+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_clean_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-16T15:37:49.178 INFO:tasks.ceph.ceph_manager.ceph:PG 3.29 is not active+clean 2024-09-16T15:37:49.178 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-16T15:37:43.502763+0000', 'last_change': '2024-09-16T15:37:43.502763+0000', 'last_active': '2024-09-16T15:37:43.489547+0000', 'last_peered': '2024-09-16T15:37:43.489547+0000', 'last_clean': '2024-09-16T15:37:43.489547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:37:43.502763+0000', 'last_undegraded': '2024-09-16T15:37:43.502763+0000', 'last_fullsized': '2024-09-16T15:37:43.502763+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_clean_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-16T15:37:49.178 INFO:tasks.ceph.ceph_manager.ceph:PG 3.28 is not active+clean 2024-09-16T15:37:49.178 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-16T15:37:43.506771+0000', 'last_change': '2024-09-16T15:37:43.506771+0000', 'last_active': '2024-09-16T15:37:43.489547+0000', 'last_peered': '2024-09-16T15:37:43.489547+0000', 'last_clean': '2024-09-16T15:37:43.489547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:37:43.506771+0000', 'last_undegraded': '2024-09-16T15:37:43.506771+0000', 'last_fullsized': '2024-09-16T15:37:43.506771+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_clean_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-16T15:37:49.178 INFO:tasks.ceph.ceph_manager.ceph:PG 3.27 is not active+clean 2024-09-16T15:37:49.178 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-16T15:37:43.507085+0000', 'last_change': '2024-09-16T15:37:43.507085+0000', 'last_active': '2024-09-16T15:37:43.489547+0000', 'last_peered': '2024-09-16T15:37:43.489547+0000', 'last_clean': '2024-09-16T15:37:43.489547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:37:43.507085+0000', 'last_undegraded': '2024-09-16T15:37:43.507085+0000', 'last_fullsized': '2024-09-16T15:37:43.507085+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_clean_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-16T15:37:49.178 INFO:tasks.ceph.ceph_manager.ceph:PG 3.26 is not active+clean 2024-09-16T15:37:49.178 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-16T15:37:43.504681+0000', 'last_change': '2024-09-16T15:37:43.504681+0000', 'last_active': '2024-09-16T15:37:43.489547+0000', 'last_peered': '2024-09-16T15:37:43.489547+0000', 'last_clean': '2024-09-16T15:37:43.489547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:37:43.504681+0000', 'last_undegraded': '2024-09-16T15:37:43.504681+0000', 'last_fullsized': '2024-09-16T15:37:43.504681+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_clean_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-16T15:37:49.179 INFO:tasks.ceph.ceph_manager.ceph:PG 3.23 is not active+clean 2024-09-16T15:37:49.179 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-16T15:37:43.504364+0000', 'last_change': '2024-09-16T15:37:43.504364+0000', 'last_active': '2024-09-16T15:37:43.489547+0000', 'last_peered': '2024-09-16T15:37:43.489547+0000', 'last_clean': '2024-09-16T15:37:43.489547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:37:43.504364+0000', 'last_undegraded': '2024-09-16T15:37:43.504364+0000', 'last_fullsized': '2024-09-16T15:37:43.504364+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_clean_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-16T15:37:49.179 INFO:tasks.ceph.ceph_manager.ceph:PG 3.22 is not active+clean 2024-09-16T15:37:49.179 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-16T15:37:43.508166+0000', 'last_change': '2024-09-16T15:37:43.508166+0000', 'last_active': '2024-09-16T15:37:43.489547+0000', 'last_peered': '2024-09-16T15:37:43.489547+0000', 'last_clean': '2024-09-16T15:37:43.489547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:37:43.508166+0000', 'last_undegraded': '2024-09-16T15:37:43.508166+0000', 'last_fullsized': '2024-09-16T15:37:43.508166+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_clean_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-16T15:37:49.179 INFO:tasks.ceph.ceph_manager.ceph:PG 3.21 is not active+clean 2024-09-16T15:37:49.179 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-16T15:37:43.509609+0000', 'last_change': '2024-09-16T15:37:43.509609+0000', 'last_active': '2024-09-16T15:37:43.489547+0000', 'last_peered': '2024-09-16T15:37:43.489547+0000', 'last_clean': '2024-09-16T15:37:43.489547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:37:43.509609+0000', 'last_undegraded': '2024-09-16T15:37:43.509609+0000', 'last_fullsized': '2024-09-16T15:37:43.509609+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_clean_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-16T15:37:49.179 INFO:tasks.ceph.ceph_manager.ceph:PG 3.20 is not active+clean 2024-09-16T15:37:49.179 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-16T15:37:43.502933+0000', 'last_change': '2024-09-16T15:37:43.502933+0000', 'last_active': '2024-09-16T15:37:43.489547+0000', 'last_peered': '2024-09-16T15:37:43.489547+0000', 'last_clean': '2024-09-16T15:37:43.489547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:37:43.502933+0000', 'last_undegraded': '2024-09-16T15:37:43.502933+0000', 'last_fullsized': '2024-09-16T15:37:43.502933+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_clean_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-16T15:37:49.179 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1a is not active+clean 2024-09-16T15:37:49.179 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-16T15:37:43.501835+0000', 'last_change': '2024-09-16T15:37:43.501835+0000', 'last_active': '2024-09-16T15:37:43.489547+0000', 'last_peered': '2024-09-16T15:37:43.489547+0000', 'last_clean': '2024-09-16T15:37:43.489547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:37:43.501835+0000', 'last_undegraded': '2024-09-16T15:37:43.501835+0000', 'last_fullsized': '2024-09-16T15:37:43.501835+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_clean_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-16T15:37:49.179 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1b is not active+clean 2024-09-16T15:37:49.179 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-16T15:37:43.507082+0000', 'last_change': '2024-09-16T15:37:43.507082+0000', 'last_active': '2024-09-16T15:37:43.489547+0000', 'last_peered': '2024-09-16T15:37:43.489547+0000', 'last_clean': '2024-09-16T15:37:43.489547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:37:43.507082+0000', 'last_undegraded': '2024-09-16T15:37:43.507082+0000', 'last_fullsized': '2024-09-16T15:37:43.507082+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_clean_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-16T15:37:49.180 INFO:tasks.ceph.ceph_manager.ceph:PG 3.18 is not active+clean 2024-09-16T15:37:49.180 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-16T15:37:43.504239+0000', 'last_change': '2024-09-16T15:37:43.504239+0000', 'last_active': '2024-09-16T15:37:43.489547+0000', 'last_peered': '2024-09-16T15:37:43.489547+0000', 'last_clean': '2024-09-16T15:37:43.489547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:37:43.504239+0000', 'last_undegraded': '2024-09-16T15:37:43.504239+0000', 'last_fullsized': '2024-09-16T15:37:43.504239+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_clean_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-16T15:37:49.180 INFO:tasks.ceph.ceph_manager.ceph:PG 3.19 is not active+clean 2024-09-16T15:37:49.180 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-16T15:37:43.507140+0000', 'last_change': '2024-09-16T15:37:43.507140+0000', 'last_active': '2024-09-16T15:37:43.489547+0000', 'last_peered': '2024-09-16T15:37:43.489547+0000', 'last_clean': '2024-09-16T15:37:43.489547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:37:43.507140+0000', 'last_undegraded': '2024-09-16T15:37:43.507140+0000', 'last_fullsized': '2024-09-16T15:37:43.507140+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_clean_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-16T15:37:49.180 INFO:tasks.ceph.ceph_manager.ceph:PG 3.16 is not active+clean 2024-09-16T15:37:49.180 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-16T15:37:43.504279+0000', 'last_change': '2024-09-16T15:37:43.504279+0000', 'last_active': '2024-09-16T15:37:43.489547+0000', 'last_peered': '2024-09-16T15:37:43.489547+0000', 'last_clean': '2024-09-16T15:37:43.489547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:37:43.504279+0000', 'last_undegraded': '2024-09-16T15:37:43.504279+0000', 'last_fullsized': '2024-09-16T15:37:43.504279+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_clean_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-16T15:37:49.180 INFO:tasks.ceph.ceph_manager.ceph:PG 3.17 is not active+clean 2024-09-16T15:37:49.180 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-16T15:37:43.503121+0000', 'last_change': '2024-09-16T15:37:43.503121+0000', 'last_active': '2024-09-16T15:37:43.489547+0000', 'last_peered': '2024-09-16T15:37:43.489547+0000', 'last_clean': '2024-09-16T15:37:43.489547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:37:43.503121+0000', 'last_undegraded': '2024-09-16T15:37:43.503121+0000', 'last_fullsized': '2024-09-16T15:37:43.503121+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_clean_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-16T15:37:49.180 INFO:tasks.ceph.ceph_manager.ceph:PG 3.14 is not active+clean 2024-09-16T15:37:49.180 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-16T15:37:43.502789+0000', 'last_change': '2024-09-16T15:37:43.502789+0000', 'last_active': '2024-09-16T15:37:43.489547+0000', 'last_peered': '2024-09-16T15:37:43.489547+0000', 'last_clean': '2024-09-16T15:37:43.489547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:37:43.502789+0000', 'last_undegraded': '2024-09-16T15:37:43.502789+0000', 'last_fullsized': '2024-09-16T15:37:43.502789+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_clean_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-16T15:37:49.180 INFO:tasks.ceph.ceph_manager.ceph:PG 3.15 is not active+clean 2024-09-16T15:37:49.181 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-16T15:37:43.504417+0000', 'last_change': '2024-09-16T15:37:43.504417+0000', 'last_active': '2024-09-16T15:37:43.489547+0000', 'last_peered': '2024-09-16T15:37:43.489547+0000', 'last_clean': '2024-09-16T15:37:43.489547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:37:43.504417+0000', 'last_undegraded': '2024-09-16T15:37:43.504417+0000', 'last_fullsized': '2024-09-16T15:37:43.504417+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_clean_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-16T15:37:49.181 INFO:tasks.ceph.ceph_manager.ceph:PG 3.13 is not active+clean 2024-09-16T15:37:49.181 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-16T15:37:43.508570+0000', 'last_change': '2024-09-16T15:37:43.508570+0000', 'last_active': '2024-09-16T15:37:43.489547+0000', 'last_peered': '2024-09-16T15:37:43.489547+0000', 'last_clean': '2024-09-16T15:37:43.489547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:37:43.508570+0000', 'last_undegraded': '2024-09-16T15:37:43.508570+0000', 'last_fullsized': '2024-09-16T15:37:43.508570+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_clean_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-16T15:37:49.181 INFO:tasks.ceph.ceph_manager.ceph:PG 3.10 is not active+clean 2024-09-16T15:37:49.181 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-16T15:37:43.501758+0000', 'last_change': '2024-09-16T15:37:43.501758+0000', 'last_active': '2024-09-16T15:37:43.489547+0000', 'last_peered': '2024-09-16T15:37:43.489547+0000', 'last_clean': '2024-09-16T15:37:43.489547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:37:43.501758+0000', 'last_undegraded': '2024-09-16T15:37:43.501758+0000', 'last_fullsized': '2024-09-16T15:37:43.501758+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_clean_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-16T15:37:49.181 INFO:tasks.ceph.ceph_manager.ceph:PG 3.11 is not active+clean 2024-09-16T15:37:49.181 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-16T15:37:43.504309+0000', 'last_change': '2024-09-16T15:37:43.504309+0000', 'last_active': '2024-09-16T15:37:43.489547+0000', 'last_peered': '2024-09-16T15:37:43.489547+0000', 'last_clean': '2024-09-16T15:37:43.489547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:37:43.504309+0000', 'last_undegraded': '2024-09-16T15:37:43.504309+0000', 'last_fullsized': '2024-09-16T15:37:43.504309+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_clean_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-16T15:37:49.181 INFO:tasks.ceph.ceph_manager.ceph:PG 3.e is not active+clean 2024-09-16T15:37:49.181 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-16T15:37:43.503176+0000', 'last_change': '2024-09-16T15:37:43.503176+0000', 'last_active': '2024-09-16T15:37:43.489547+0000', 'last_peered': '2024-09-16T15:37:43.489547+0000', 'last_clean': '2024-09-16T15:37:43.489547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:37:43.503176+0000', 'last_undegraded': '2024-09-16T15:37:43.503176+0000', 'last_fullsized': '2024-09-16T15:37:43.503176+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_clean_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-16T15:37:49.181 INFO:tasks.ceph.ceph_manager.ceph:PG 3.f is not active+clean 2024-09-16T15:37:49.181 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-16T15:37:43.505682+0000', 'last_change': '2024-09-16T15:37:43.505682+0000', 'last_active': '2024-09-16T15:37:43.489547+0000', 'last_peered': '2024-09-16T15:37:43.489547+0000', 'last_clean': '2024-09-16T15:37:43.489547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:37:43.505682+0000', 'last_undegraded': '2024-09-16T15:37:43.505682+0000', 'last_fullsized': '2024-09-16T15:37:43.505682+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_clean_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-16T15:37:49.182 INFO:tasks.ceph.ceph_manager.ceph:PG 3.c is not active+clean 2024-09-16T15:37:49.182 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-16T15:37:43.505063+0000', 'last_change': '2024-09-16T15:37:43.505063+0000', 'last_active': '2024-09-16T15:37:43.489547+0000', 'last_peered': '2024-09-16T15:37:43.489547+0000', 'last_clean': '2024-09-16T15:37:43.489547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:37:43.505063+0000', 'last_undegraded': '2024-09-16T15:37:43.505063+0000', 'last_fullsized': '2024-09-16T15:37:43.505063+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_clean_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-16T15:37:49.182 INFO:tasks.ceph.ceph_manager.ceph:PG 3.d is not active+clean 2024-09-16T15:37:49.182 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-16T15:37:43.506168+0000', 'last_change': '2024-09-16T15:37:43.506168+0000', 'last_active': '2024-09-16T15:37:43.489547+0000', 'last_peered': '2024-09-16T15:37:43.489547+0000', 'last_clean': '2024-09-16T15:37:43.489547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:37:43.506168+0000', 'last_undegraded': '2024-09-16T15:37:43.506168+0000', 'last_fullsized': '2024-09-16T15:37:43.506168+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_clean_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-16T15:37:49.182 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2 is not active+clean 2024-09-16T15:37:49.182 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-16T15:37:43.507336+0000', 'last_change': '2024-09-16T15:37:43.507336+0000', 'last_active': '2024-09-16T15:37:43.489547+0000', 'last_peered': '2024-09-16T15:37:43.489547+0000', 'last_clean': '2024-09-16T15:37:43.489547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:37:43.507336+0000', 'last_undegraded': '2024-09-16T15:37:43.507336+0000', 'last_fullsized': '2024-09-16T15:37:43.507336+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_clean_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-16T15:37:49.182 INFO:tasks.ceph.ceph_manager.ceph:PG 3.0 is not active+clean 2024-09-16T15:37:49.182 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-16T15:37:43.505160+0000', 'last_change': '2024-09-16T15:37:43.505160+0000', 'last_active': '2024-09-16T15:37:43.489547+0000', 'last_peered': '2024-09-16T15:37:43.489547+0000', 'last_clean': '2024-09-16T15:37:43.489547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:37:43.505160+0000', 'last_undegraded': '2024-09-16T15:37:43.505160+0000', 'last_fullsized': '2024-09-16T15:37:43.505160+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_clean_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-16T15:37:49.182 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3 is not active+clean 2024-09-16T15:37:49.182 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-16T15:37:43.503500+0000', 'last_change': '2024-09-16T15:37:43.503500+0000', 'last_active': '2024-09-16T15:37:43.489547+0000', 'last_peered': '2024-09-16T15:37:43.489547+0000', 'last_clean': '2024-09-16T15:37:43.489547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:37:43.503500+0000', 'last_undegraded': '2024-09-16T15:37:43.503500+0000', 'last_fullsized': '2024-09-16T15:37:43.503500+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_clean_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-16T15:37:49.182 INFO:tasks.ceph.ceph_manager.ceph:PG 3.5 is not active+clean 2024-09-16T15:37:49.183 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-16T15:37:43.503364+0000', 'last_change': '2024-09-16T15:37:43.503364+0000', 'last_active': '2024-09-16T15:37:43.489547+0000', 'last_peered': '2024-09-16T15:37:43.489547+0000', 'last_clean': '2024-09-16T15:37:43.489547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:37:43.503364+0000', 'last_undegraded': '2024-09-16T15:37:43.503364+0000', 'last_fullsized': '2024-09-16T15:37:43.503364+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_clean_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-16T15:37:49.183 INFO:tasks.ceph.ceph_manager.ceph:PG 3.7 is not active+clean 2024-09-16T15:37:49.183 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-16T15:37:43.508877+0000', 'last_change': '2024-09-16T15:37:43.508877+0000', 'last_active': '2024-09-16T15:37:43.489547+0000', 'last_peered': '2024-09-16T15:37:43.489547+0000', 'last_clean': '2024-09-16T15:37:43.489547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:37:43.508877+0000', 'last_undegraded': '2024-09-16T15:37:43.508877+0000', 'last_fullsized': '2024-09-16T15:37:43.508877+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_clean_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-16T15:37:49.183 INFO:tasks.ceph.ceph_manager.ceph:PG 3.6 is not active+clean 2024-09-16T15:37:49.183 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-16T15:37:43.508507+0000', 'last_change': '2024-09-16T15:37:43.508507+0000', 'last_active': '2024-09-16T15:37:43.489547+0000', 'last_peered': '2024-09-16T15:37:43.489547+0000', 'last_clean': '2024-09-16T15:37:43.489547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:37:43.508507+0000', 'last_undegraded': '2024-09-16T15:37:43.508507+0000', 'last_fullsized': '2024-09-16T15:37:43.508507+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_clean_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-16T15:37:49.183 INFO:tasks.ceph.ceph_manager.ceph:PG 3.9 is not active+clean 2024-09-16T15:37:49.183 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-16T15:37:43.503358+0000', 'last_change': '2024-09-16T15:37:43.503358+0000', 'last_active': '2024-09-16T15:37:43.489547+0000', 'last_peered': '2024-09-16T15:37:43.489547+0000', 'last_clean': '2024-09-16T15:37:43.489547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:37:43.503358+0000', 'last_undegraded': '2024-09-16T15:37:43.503358+0000', 'last_fullsized': '2024-09-16T15:37:43.503358+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_clean_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-16T15:37:49.183 INFO:tasks.ceph.ceph_manager.ceph:PG 3.8 is not active+clean 2024-09-16T15:37:49.183 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-16T15:37:43.507353+0000', 'last_change': '2024-09-16T15:37:43.507353+0000', 'last_active': '2024-09-16T15:37:43.489547+0000', 'last_peered': '2024-09-16T15:37:43.489547+0000', 'last_clean': '2024-09-16T15:37:43.489547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:37:43.507353+0000', 'last_undegraded': '2024-09-16T15:37:43.507353+0000', 'last_fullsized': '2024-09-16T15:37:43.507353+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_clean_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-16T15:37:49.183 INFO:tasks.ceph.ceph_manager.ceph:PG 3.b is not active+clean 2024-09-16T15:37:49.183 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-16T15:37:43.510415+0000', 'last_change': '2024-09-16T15:37:43.510415+0000', 'last_active': '2024-09-16T15:37:43.489547+0000', 'last_peered': '2024-09-16T15:37:43.489547+0000', 'last_clean': '2024-09-16T15:37:43.489547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:37:43.510415+0000', 'last_undegraded': '2024-09-16T15:37:43.510415+0000', 'last_fullsized': '2024-09-16T15:37:43.510415+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_clean_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-16T15:37:49.184 INFO:tasks.ceph.ceph_manager.ceph:PG 3.a is not active+clean 2024-09-16T15:37:49.184 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-16T15:37:43.507703+0000', 'last_change': '2024-09-16T15:37:43.507703+0000', 'last_active': '2024-09-16T15:37:43.489547+0000', 'last_peered': '2024-09-16T15:37:43.489547+0000', 'last_clean': '2024-09-16T15:37:43.489547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:37:43.507703+0000', 'last_undegraded': '2024-09-16T15:37:43.507703+0000', 'last_fullsized': '2024-09-16T15:37:43.507703+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_clean_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-16T15:37:49.184 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1d is not active+clean 2024-09-16T15:37:49.184 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-16T15:37:43.507590+0000', 'last_change': '2024-09-16T15:37:43.507590+0000', 'last_active': '2024-09-16T15:37:43.489547+0000', 'last_peered': '2024-09-16T15:37:43.489547+0000', 'last_clean': '2024-09-16T15:37:43.489547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:37:43.507590+0000', 'last_undegraded': '2024-09-16T15:37:43.507590+0000', 'last_fullsized': '2024-09-16T15:37:43.507590+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_clean_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-16T15:37:49.184 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1c is not active+clean 2024-09-16T15:37:49.184 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-16T15:37:43.501832+0000', 'last_change': '2024-09-16T15:37:43.501832+0000', 'last_active': '2024-09-16T15:37:43.489547+0000', 'last_peered': '2024-09-16T15:37:43.489547+0000', 'last_clean': '2024-09-16T15:37:43.489547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:37:43.501832+0000', 'last_undegraded': '2024-09-16T15:37:43.501832+0000', 'last_fullsized': '2024-09-16T15:37:43.501832+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_clean_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-16T15:37:49.184 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1f is not active+clean 2024-09-16T15:37:49.184 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-16T15:37:43.506222+0000', 'last_change': '2024-09-16T15:37:43.506222+0000', 'last_active': '2024-09-16T15:37:43.489547+0000', 'last_peered': '2024-09-16T15:37:43.489547+0000', 'last_clean': '2024-09-16T15:37:43.489547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:37:43.506222+0000', 'last_undegraded': '2024-09-16T15:37:43.506222+0000', 'last_fullsized': '2024-09-16T15:37:43.506222+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_clean_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-16T15:37:49.184 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1e is not active+clean 2024-09-16T15:37:49.184 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-16T15:37:43.505396+0000', 'last_change': '2024-09-16T15:37:43.505396+0000', 'last_active': '2024-09-16T15:37:43.489547+0000', 'last_peered': '2024-09-16T15:37:43.489547+0000', 'last_clean': '2024-09-16T15:37:43.489547+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:37:43.505396+0000', 'last_undegraded': '2024-09-16T15:37:43.505396+0000', 'last_fullsized': '2024-09-16T15:37:43.505396+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'last_clean_scrub_stamp': '2024-09-16T15:37:43.489547+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-16T15:37:49.185 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T15:37:49.309 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.307+0000 7efcbab3d640 1 -- 172.21.15.98:0/3046816383 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efcb40b1b70 msgr2=0x7efcb40b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:49.309 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.307+0000 7efcbab3d640 1 --2- 172.21.15.98:0/3046816383 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efcb40b1b70 0x7efcb40b2000 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7efcac005fd0 tx=0x7efcac02aa90 comp rx=0 tx=0).stop 2024-09-16T15:37:49.309 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.307+0000 7efcbab3d640 1 -- 172.21.15.98:0/3046816383 shutdown_connections 2024-09-16T15:37:49.310 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.307+0000 7efcbab3d640 1 --2- 172.21.15.98:0/3046816383 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efcb40b1b70 0x7efcb40b2000 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:49.310 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.307+0000 7efcbab3d640 1 --2- 172.21.15.98:0/3046816383 >> v2:172.21.15.135:3300/0 conn(0x7efcb40d03a0 0x7efcb40d07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:49.310 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.307+0000 7efcbab3d640 1 -- 172.21.15.98:0/3046816383 >> 172.21.15.98:0/3046816383 conn(0x7efcb40d1dc0 msgr2=0x7efcb40d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:49.310 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.307+0000 7efcbab3d640 1 -- 172.21.15.98:0/3046816383 shutdown_connections 2024-09-16T15:37:49.310 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.307+0000 7efcbab3d640 1 -- 172.21.15.98:0/3046816383 wait complete. 2024-09-16T15:37:49.310 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.308+0000 7efcbab3d640 1 Processor -- start 2024-09-16T15:37:49.310 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.308+0000 7efcbab3d640 1 -- start start 2024-09-16T15:37:49.312 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.309+0000 7efcbab3d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efcb40b1b70 0x7efcb415bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:49.312 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.309+0000 7efcbab3d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efcb40d03a0 0x7efcb40b2b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:49.312 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.309+0000 7efcbab3d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efcb415f450 0x7efcb40c70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:49.313 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.309+0000 7efcbab3d640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7efcb40cd1b0 con 0x7efcb40b1b70 2024-09-16T15:37:49.313 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.309+0000 7efcbab3d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7efcb40d2bf0 con 0x7efcb40d03a0 2024-09-16T15:37:49.313 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.309+0000 7efcbab3d640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7efcb40b2540 con 0x7efcb415f450 2024-09-16T15:37:49.313 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.309+0000 7efcb88d9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efcb40b1b70 0x7efcb415bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:49.313 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.309+0000 7efcb88d9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efcb40b1b70 0x7efcb415bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59500/0 (socket says 172.21.15.98:59500) 2024-09-16T15:37:49.313 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.309+0000 7efcb88d9640 1 -- 172.21.15.98:0/932356256 learned_addr learned my addr 172.21.15.98:0/932356256 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:37:49.313 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.309+0000 7efcb3fff640 1 --2- 172.21.15.98:0/932356256 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efcb40d03a0 0x7efcb40b2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:49.313 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.309+0000 7efcb90da640 1 --2- 172.21.15.98:0/932356256 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efcb415f450 0x7efcb40c70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:49.313 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.309+0000 7efcb88d9640 1 -- 172.21.15.98:0/932356256 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efcb415f450 msgr2=0x7efcb40c70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:49.313 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.309+0000 7efcb88d9640 1 --2- 172.21.15.98:0/932356256 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efcb415f450 0x7efcb40c70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:49.313 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.309+0000 7efcb88d9640 1 -- 172.21.15.98:0/932356256 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efcb40d03a0 msgr2=0x7efcb40b2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:49.313 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.310+0000 7efcb88d9640 1 --2- 172.21.15.98:0/932356256 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efcb40d03a0 0x7efcb40b2b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:49.313 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.310+0000 7efcb88d9640 1 -- 172.21.15.98:0/932356256 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcb41f56c0 con 0x7efcb40b1b70 2024-09-16T15:37:49.314 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.310+0000 7efcb88d9640 1 --2- 172.21.15.98:0/932356256 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efcb40b1b70 0x7efcb415bc80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7efca400c370 tx=0x7efca400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:49.314 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.310+0000 7efcb17fa640 1 -- 172.21.15.98:0/932356256 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efca40052d0 con 0x7efcb40b1b70 2024-09-16T15:37:49.314 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.310+0000 7efcb17fa640 1 -- 172.21.15.98:0/932356256 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efca4007020 con 0x7efcb40b1b70 2024-09-16T15:37:49.314 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.310+0000 7efcbab3d640 1 -- 172.21.15.98:0/932356256 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcb40c5a70 con 0x7efcb40b1b70 2024-09-16T15:37:49.314 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.310+0000 7efcb17fa640 1 -- 172.21.15.98:0/932356256 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efca4007470 con 0x7efcb40b1b70 2024-09-16T15:37:49.314 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.310+0000 7efcbab3d640 1 -- 172.21.15.98:0/932356256 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcb40b3060 con 0x7efcb40b1b70 2024-09-16T15:37:49.315 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.311+0000 7efcbab3d640 1 -- 172.21.15.98:0/932356256 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcb415caa0 con 0x7efcb40b1b70 2024-09-16T15:37:49.315 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.311+0000 7efcb17fa640 1 -- 172.21.15.98:0/932356256 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7efca40067d0 con 0x7efcb40b1b70 2024-09-16T15:37:49.315 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.312+0000 7efcb17fa640 1 --2- 172.21.15.98:0/932356256 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7efca0078850 0x7efca007ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:49.315 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.312+0000 7efcb17fa640 1 -- 172.21.15.98:0/932356256 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7efca4099c70 con 0x7efcb40b1b70 2024-09-16T15:37:49.315 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.312+0000 7efcb3fff640 1 --2- 172.21.15.98:0/932356256 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7efca0078850 0x7efca007ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:49.315 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.313+0000 7efcb3fff640 1 --2- 172.21.15.98:0/932356256 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7efca0078850 0x7efca007ad10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7efca8009bd0 tx=0x7efca8005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:49.318 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.316+0000 7efcb17fa640 1 -- 172.21.15.98:0/932356256 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7efcb415caa0 con 0x7efcb40b1b70 2024-09-16T15:37:49.567 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.565+0000 7efcbab3d640 1 -- 172.21.15.98:0/932356256 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7efcb40b2000 con 0x7efcb40b1b70 2024-09-16T15:37:49.567 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.565+0000 7efcb17fa640 1 -- 172.21.15.98:0/932356256 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1074 (secure 0 0 0) 0x7efca4061d20 con 0x7efcb40b1b70 2024-09-16T15:37:49.567 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:37:49.567 INFO:teuthology.orchestra.run.smithi098.stdout:{"fsid":"52a38a45-21d2-4cb0-bb3a-4fb8be3a08df","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":29,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":23,"num_osds":8,"num_up_osds":8,"osd_up_since":1726501053,"num_in_osds":8,"osd_in_since":1726501043,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":57},{"state_name":"active+clean","count":40}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":224251904,"bytes_avail":772869861376,"bytes_total":773094113280,"inactive_pgs_ratio":0.58762884140014648},"fsmap":{"epoch":7,"btime":"2024-09-16T15:37:47:522910+0000","id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"c","status":"up:active","gid":4356}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-09-16T15:37:20.388745+0000","services":{}},"progress_events":{}} 2024-09-16T15:37:49.569 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.567+0000 7efcbab3d640 1 -- 172.21.15.98:0/932356256 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7efca0078850 msgr2=0x7efca007ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:49.569 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.567+0000 7efcbab3d640 1 --2- 172.21.15.98:0/932356256 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7efca0078850 0x7efca007ad10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7efca8009bd0 tx=0x7efca8005f90 comp rx=0 tx=0).stop 2024-09-16T15:37:49.569 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.567+0000 7efcbab3d640 1 -- 172.21.15.98:0/932356256 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efcb40b1b70 msgr2=0x7efcb415bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:49.570 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.567+0000 7efcbab3d640 1 --2- 172.21.15.98:0/932356256 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efcb40b1b70 0x7efcb415bc80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7efca400c370 tx=0x7efca400c830 comp rx=0 tx=0).stop 2024-09-16T15:37:49.570 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.567+0000 7efcbab3d640 1 -- 172.21.15.98:0/932356256 shutdown_connections 2024-09-16T15:37:49.570 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.567+0000 7efcbab3d640 1 --2- 172.21.15.98:0/932356256 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efcb415f450 0x7efcb40c70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:49.570 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.567+0000 7efcbab3d640 1 --2- 172.21.15.98:0/932356256 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7efca0078850 0x7efca007ad10 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:49.570 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.567+0000 7efcbab3d640 1 --2- 172.21.15.98:0/932356256 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efcb40d03a0 0x7efcb40b2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:49.570 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.567+0000 7efcbab3d640 1 --2- 172.21.15.98:0/932356256 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efcb40b1b70 0x7efcb415bc80 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:49.570 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.567+0000 7efcbab3d640 1 -- 172.21.15.98:0/932356256 >> 172.21.15.98:0/932356256 conn(0x7efcb40d1dc0 msgr2=0x7efcb415c390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:49.570 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.567+0000 7efcbab3d640 1 -- 172.21.15.98:0/932356256 shutdown_connections 2024-09-16T15:37:49.570 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.567+0000 7efcbab3d640 1 -- 172.21.15.98:0/932356256 wait complete. 2024-09-16T15:37:49.580 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-16T15:37:49.580 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T15:37:49.680 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.678+0000 7fe831f7d640 1 -- 172.21.15.98:0/2688459097 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe818004080 msgr2=0x7fe818004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:49.681 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.678+0000 7fe831f7d640 1 --2- 172.21.15.98:0/2688459097 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe818004080 0x7fe818004800 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe81400baf0 tx=0x7fe818005830 comp rx=0 tx=0).stop 2024-09-16T15:37:49.681 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.678+0000 7fe82bfff640 1 -- 172.21.15.98:0/2688459097 reap_dead start 2024-09-16T15:37:49.681 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.678+0000 7fe831f7d640 1 -- 172.21.15.98:0/2688459097 shutdown_connections 2024-09-16T15:37:49.681 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.678+0000 7fe831f7d640 1 -- 172.21.15.98:0/2688459097 >> 172.21.15.98:0/2688459097 conn(0x7fe82c0b2230 msgr2=0x7fe82c0b2610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:49.681 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.678+0000 7fe831f7d640 1 -- 172.21.15.98:0/2688459097 shutdown_connections 2024-09-16T15:37:49.681 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.678+0000 7fe831f7d640 1 -- 172.21.15.98:0/2688459097 wait complete. 2024-09-16T15:37:49.682 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.679+0000 7fe831f7d640 1 Processor -- start 2024-09-16T15:37:49.682 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.680+0000 7fe831f7d640 1 -- start start 2024-09-16T15:37:49.683 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.680+0000 7fe831f7d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe818004080 0x7fe82c15ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:49.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.680+0000 7fe831f7d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe82c0b3c70 0x7fe82c13df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:49.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.680+0000 7fe831f7d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe82c159fb0 0x7fe82c1f8060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:49.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.680+0000 7fe831f7d640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe82c068bc0 con 0x7fe82c0b3c70 2024-09-16T15:37:49.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.680+0000 7fe831f7d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe82c0cd920 con 0x7fe818004080 2024-09-16T15:37:49.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.680+0000 7fe831f7d640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fe82c073c20 con 0x7fe82c159fb0 2024-09-16T15:37:49.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.680+0000 7fe822ffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe82c0b3c70 0x7fe82c13df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:49.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.680+0000 7fe822ffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe82c0b3c70 0x7fe82c13df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59524/0 (socket says 172.21.15.98:59524) 2024-09-16T15:37:49.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.680+0000 7fe822ffd640 1 -- 172.21.15.98:0/3571740247 learned_addr learned my addr 172.21.15.98:0/3571740247 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:37:49.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.681+0000 7fe82b7fe640 1 --2- 172.21.15.98:0/3571740247 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe818004080 0x7fe82c15ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:49.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.681+0000 7fe82bfff640 1 --2- 172.21.15.98:0/3571740247 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe82c159fb0 0x7fe82c1f8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:49.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.681+0000 7fe822ffd640 1 -- 172.21.15.98:0/3571740247 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe82c159fb0 msgr2=0x7fe82c1f8060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:49.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.681+0000 7fe822ffd640 1 --2- 172.21.15.98:0/3571740247 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe82c159fb0 0x7fe82c1f8060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:49.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.681+0000 7fe822ffd640 1 -- 172.21.15.98:0/3571740247 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe818004080 msgr2=0x7fe82c15ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:49.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.681+0000 7fe822ffd640 1 --2- 172.21.15.98:0/3571740247 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe818004080 0x7fe82c15ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:49.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.681+0000 7fe822ffd640 1 -- 172.21.15.98:0/3571740247 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe82c15c110 con 0x7fe82c0b3c70 2024-09-16T15:37:49.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.681+0000 7fe822ffd640 1 --2- 172.21.15.98:0/3571740247 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe82c0b3c70 0x7fe82c13df70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe81400bb50 tx=0x7fe81400b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:49.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.681+0000 7fe828ff9640 1 -- 172.21.15.98:0/3571740247 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe814004230 con 0x7fe82c0b3c70 2024-09-16T15:37:49.686 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.681+0000 7fe828ff9640 1 -- 172.21.15.98:0/3571740247 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe8140043d0 con 0x7fe82c0b3c70 2024-09-16T15:37:49.686 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.681+0000 7fe831f7d640 1 -- 172.21.15.98:0/3571740247 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe82c143c50 con 0x7fe82c0b3c70 2024-09-16T15:37:49.686 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.681+0000 7fe828ff9640 1 -- 172.21.15.98:0/3571740247 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe81403c8a0 con 0x7fe82c0b3c70 2024-09-16T15:37:49.686 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.681+0000 7fe831f7d640 1 -- 172.21.15.98:0/3571740247 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe82c15a460 con 0x7fe82c0b3c70 2024-09-16T15:37:49.687 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.682+0000 7fe831f7d640 1 -- 172.21.15.98:0/3571740247 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe82c143a40 con 0x7fe82c0b3c70 2024-09-16T15:37:49.687 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.683+0000 7fe828ff9640 1 -- 172.21.15.98:0/3571740247 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7fe8140334a0 con 0x7fe82c0b3c70 2024-09-16T15:37:49.687 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.683+0000 7fe828ff9640 1 --2- 172.21.15.98:0/3571740247 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fe80c078880 0x7fe80c07ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:49.687 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.683+0000 7fe828ff9640 1 -- 172.21.15.98:0/3571740247 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fe8140bb260 con 0x7fe82c0b3c70 2024-09-16T15:37:49.687 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.683+0000 7fe82b7fe640 1 --2- 172.21.15.98:0/3571740247 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fe80c078880 0x7fe80c07ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:49.687 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.684+0000 7fe82b7fe640 1 --2- 172.21.15.98:0/3571740247 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fe80c078880 0x7fe80c07ad40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe81c0045b0 tx=0x7fe81c00d410 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:49.689 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.687+0000 7fe828ff9640 1 -- 172.21.15.98:0/3571740247 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7fe814083840 con 0x7fe82c0b3c70 2024-09-16T15:37:49.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.859+0000 7fe831f7d640 1 -- 172.21.15.98:0/3571740247 --> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe82c0b40f0 con 0x7fe80c078880 2024-09-16T15:37:49.865 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.864+0000 7fe828ff9640 1 -- 172.21.15.98:0/3571740247 <== mgr.4100 v2:172.21.15.135:6800/699234772 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247211 (secure 0 0 0) 0x7fe81c0038e0 con 0x7fe80c078880 2024-09-16T15:37:49.868 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:37:49.869 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2024-09-16T15:37:49.870 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.867+0000 7fe831f7d640 1 -- 172.21.15.98:0/3571740247 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fe80c078880 msgr2=0x7fe80c07ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:49.870 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.867+0000 7fe831f7d640 1 --2- 172.21.15.98:0/3571740247 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fe80c078880 0x7fe80c07ad40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe81c0045b0 tx=0x7fe81c00d410 comp rx=0 tx=0).stop 2024-09-16T15:37:49.871 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.867+0000 7fe831f7d640 1 -- 172.21.15.98:0/3571740247 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe82c0b3c70 msgr2=0x7fe82c13df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:49.871 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.867+0000 7fe831f7d640 1 --2- 172.21.15.98:0/3571740247 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe82c0b3c70 0x7fe82c13df70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe81400bb50 tx=0x7fe81400b6f0 comp rx=0 tx=0).stop 2024-09-16T15:37:49.871 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.867+0000 7fe831f7d640 1 -- 172.21.15.98:0/3571740247 shutdown_connections 2024-09-16T15:37:49.871 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.867+0000 7fe831f7d640 1 --2- 172.21.15.98:0/3571740247 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe82c159fb0 0x7fe82c1f8060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:49.871 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.867+0000 7fe831f7d640 1 --2- 172.21.15.98:0/3571740247 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe82c0b3c70 0x7fe82c13df70 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:49.871 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.867+0000 7fe831f7d640 1 --2- 172.21.15.98:0/3571740247 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fe80c078880 0x7fe80c07ad40 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:49.871 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.867+0000 7fe831f7d640 1 --2- 172.21.15.98:0/3571740247 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe818004080 0x7fe82c15ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:49.871 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.867+0000 7fe831f7d640 1 -- 172.21.15.98:0/3571740247 >> 172.21.15.98:0/3571740247 conn(0x7fe82c0b2230 msgr2=0x7fe82c0b0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:49.871 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.867+0000 7fe831f7d640 1 -- 172.21.15.98:0/3571740247 shutdown_connections 2024-09-16T15:37:49.871 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:49.867+0000 7fe831f7d640 1 -- 172.21.15.98:0/3571740247 wait complete. 2024-09-16T15:37:49.880 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-16T15:37:48.709658+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":7,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218996,"kb_used_data":2756,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755724,"statfs":{"total":773094113280,"available":772869861376,"internally_reserved":0,"allocated":2822144,"data_stored":1707716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001463"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.506408+0000","last_change":"2024-09-16T15:37:43.506408+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.506408+0000","last_undegraded":"2024-09-16T15:37:43.506408+0000","last_fullsized":"2024-09-16T15:37:43.506408+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.506105+0000","last_change":"2024-09-16T15:37:43.506105+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.506105+0000","last_undegraded":"2024-09-16T15:37:43.506105+0000","last_fullsized":"2024-09-16T15:37:43.506105+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.503720+0000","last_change":"2024-09-16T15:37:43.503720+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.503720+0000","last_undegraded":"2024-09-16T15:37:43.503720+0000","last_fullsized":"2024-09-16T15:37:43.503720+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.503566+0000","last_change":"2024-09-16T15:37:43.503566+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.503566+0000","last_undegraded":"2024-09-16T15:37:43.503566+0000","last_fullsized":"2024-09-16T15:37:43.503566+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.502948+0000","last_change":"2024-09-16T15:37:43.502948+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.502948+0000","last_undegraded":"2024-09-16T15:37:43.502948+0000","last_fullsized":"2024-09-16T15:37:43.502948+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.503197+0000","last_change":"2024-09-16T15:37:43.503197+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.503197+0000","last_undegraded":"2024-09-16T15:37:43.503197+0000","last_fullsized":"2024-09-16T15:37:43.503197+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.504333+0000","last_change":"2024-09-16T15:37:43.504333+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.504333+0000","last_undegraded":"2024-09-16T15:37:43.504333+0000","last_fullsized":"2024-09-16T15:37:43.504333+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.505582+0000","last_change":"2024-09-16T15:37:43.505582+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.505582+0000","last_undegraded":"2024-09-16T15:37:43.505582+0000","last_fullsized":"2024-09-16T15:37:43.505582+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.501405+0000","last_change":"2024-09-16T15:37:43.501405+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.501405+0000","last_undegraded":"2024-09-16T15:37:43.501405+0000","last_fullsized":"2024-09-16T15:37:43.501405+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.505383+0000","last_change":"2024-09-16T15:37:43.505383+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.505383+0000","last_undegraded":"2024-09-16T15:37:43.505383+0000","last_fullsized":"2024-09-16T15:37:43.505383+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.505413+0000","last_change":"2024-09-16T15:37:43.505413+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.505413+0000","last_undegraded":"2024-09-16T15:37:43.505413+0000","last_fullsized":"2024-09-16T15:37:43.505413+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.506807+0000","last_change":"2024-09-16T15:37:43.506807+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.506807+0000","last_undegraded":"2024-09-16T15:37:43.506807+0000","last_fullsized":"2024-09-16T15:37:43.506807+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.526086+0000","last_change":"2024-09-16T15:37:44.515572+0000","last_active":"2024-09-16T15:37:45.526086+0000","last_peered":"2024-09-16T15:37:45.526086+0000","last_clean":"2024-09-16T15:37:45.526086+0000","last_became_active":"2024-09-16T15:37:44.514667+0000","last_became_peered":"2024-09-16T15:37:44.514667+0000","last_unstale":"2024-09-16T15:37:45.526086+0000","last_undegraded":"2024-09-16T15:37:45.526086+0000","last_fullsized":"2024-09-16T15:37:45.526086+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:37:31.235473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.526350+0000","last_change":"2024-09-16T15:37:44.517134+0000","last_active":"2024-09-16T15:37:45.526350+0000","last_peered":"2024-09-16T15:37:45.526350+0000","last_clean":"2024-09-16T15:37:45.526350+0000","last_became_active":"2024-09-16T15:37:44.515946+0000","last_became_peered":"2024-09-16T15:37:44.515946+0000","last_unstale":"2024-09-16T15:37:45.526350+0000","last_undegraded":"2024-09-16T15:37:45.526350+0000","last_fullsized":"2024-09-16T15:37:45.526350+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:01:35.813267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.503610+0000","last_change":"2024-09-16T15:37:43.503610+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.503610+0000","last_undegraded":"2024-09-16T15:37:43.503610+0000","last_fullsized":"2024-09-16T15:37:43.503610+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.510644+0000","last_change":"2024-09-16T15:37:43.510644+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.510644+0000","last_undegraded":"2024-09-16T15:37:43.510644+0000","last_fullsized":"2024-09-16T15:37:43.510644+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.509791+0000","last_change":"2024-09-16T15:37:43.509791+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.509791+0000","last_undegraded":"2024-09-16T15:37:43.509791+0000","last_fullsized":"2024-09-16T15:37:43.509791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.509988+0000","last_change":"2024-09-16T15:37:43.509988+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.509988+0000","last_undegraded":"2024-09-16T15:37:43.509988+0000","last_fullsized":"2024-09-16T15:37:43.509988+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.508646+0000","last_change":"2024-09-16T15:37:43.508646+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.508646+0000","last_undegraded":"2024-09-16T15:37:43.508646+0000","last_fullsized":"2024-09-16T15:37:43.508646+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.506205+0000","last_change":"2024-09-16T15:37:43.506205+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.506205+0000","last_undegraded":"2024-09-16T15:37:43.506205+0000","last_fullsized":"2024-09-16T15:37:43.506205+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.508778+0000","last_change":"2024-09-16T15:37:43.508778+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.508778+0000","last_undegraded":"2024-09-16T15:37:43.508778+0000","last_fullsized":"2024-09-16T15:37:43.508778+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.502662+0000","last_change":"2024-09-16T15:37:43.502662+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.502662+0000","last_undegraded":"2024-09-16T15:37:43.502662+0000","last_fullsized":"2024-09-16T15:37:43.502662+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.502763+0000","last_change":"2024-09-16T15:37:43.502763+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.502763+0000","last_undegraded":"2024-09-16T15:37:43.502763+0000","last_fullsized":"2024-09-16T15:37:43.502763+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.506771+0000","last_change":"2024-09-16T15:37:43.506771+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.506771+0000","last_undegraded":"2024-09-16T15:37:43.506771+0000","last_fullsized":"2024-09-16T15:37:43.506771+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.507085+0000","last_change":"2024-09-16T15:37:43.507085+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.507085+0000","last_undegraded":"2024-09-16T15:37:43.507085+0000","last_fullsized":"2024-09-16T15:37:43.507085+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.504681+0000","last_change":"2024-09-16T15:37:43.504681+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.504681+0000","last_undegraded":"2024-09-16T15:37:43.504681+0000","last_fullsized":"2024-09-16T15:37:43.504681+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.526539+0000","last_change":"2024-09-16T15:37:44.519708+0000","last_active":"2024-09-16T15:37:45.526539+0000","last_peered":"2024-09-16T15:37:45.526539+0000","last_clean":"2024-09-16T15:37:45.526539+0000","last_became_active":"2024-09-16T15:37:44.519439+0000","last_became_peered":"2024-09-16T15:37:44.519439+0000","last_unstale":"2024-09-16T15:37:45.526539+0000","last_undegraded":"2024-09-16T15:37:45.526539+0000","last_fullsized":"2024-09-16T15:37:45.526539+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:56:40.956164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.526026+0000","last_change":"2024-09-16T15:37:44.518861+0000","last_active":"2024-09-16T15:37:45.526026+0000","last_peered":"2024-09-16T15:37:45.526026+0000","last_clean":"2024-09-16T15:37:45.526026+0000","last_became_active":"2024-09-16T15:37:44.518600+0000","last_became_peered":"2024-09-16T15:37:44.518600+0000","last_unstale":"2024-09-16T15:37:45.526026+0000","last_undegraded":"2024-09-16T15:37:45.526026+0000","last_fullsized":"2024-09-16T15:37:45.526026+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:52:07.454732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.504364+0000","last_change":"2024-09-16T15:37:43.504364+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.504364+0000","last_undegraded":"2024-09-16T15:37:43.504364+0000","last_fullsized":"2024-09-16T15:37:43.504364+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.508166+0000","last_change":"2024-09-16T15:37:43.508166+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.508166+0000","last_undegraded":"2024-09-16T15:37:43.508166+0000","last_fullsized":"2024-09-16T15:37:43.508166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.509609+0000","last_change":"2024-09-16T15:37:43.509609+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.509609+0000","last_undegraded":"2024-09-16T15:37:43.509609+0000","last_fullsized":"2024-09-16T15:37:43.509609+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.502933+0000","last_change":"2024-09-16T15:37:43.502933+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.502933+0000","last_undegraded":"2024-09-16T15:37:43.502933+0000","last_fullsized":"2024-09-16T15:37:43.502933+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.501835+0000","last_change":"2024-09-16T15:37:43.501835+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.501835+0000","last_undegraded":"2024-09-16T15:37:43.501835+0000","last_fullsized":"2024-09-16T15:37:43.501835+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.513635+0000","last_change":"2024-09-16T15:37:43.510897+0000","last_active":"2024-09-16T15:37:43.513635+0000","last_peered":"2024-09-16T15:37:43.513635+0000","last_clean":"2024-09-16T15:37:43.513635+0000","last_became_active":"2024-09-16T15:37:43.510468+0000","last_became_peered":"2024-09-16T15:37:43.510468+0000","last_unstale":"2024-09-16T15:37:43.513635+0000","last_undegraded":"2024-09-16T15:37:43.513635+0000","last_fullsized":"2024-09-16T15:37:43.513635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:58:36.781822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.507082+0000","last_change":"2024-09-16T15:37:43.507082+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.507082+0000","last_undegraded":"2024-09-16T15:37:43.507082+0000","last_fullsized":"2024-09-16T15:37:43.507082+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.523221+0000","last_change":"2024-09-16T15:37:43.521672+0000","last_active":"2024-09-16T15:37:43.523221+0000","last_peered":"2024-09-16T15:37:43.523221+0000","last_clean":"2024-09-16T15:37:43.523221+0000","last_became_active":"2024-09-16T15:37:43.521418+0000","last_became_peered":"2024-09-16T15:37:43.521418+0000","last_unstale":"2024-09-16T15:37:43.523221+0000","last_undegraded":"2024-09-16T15:37:43.523221+0000","last_fullsized":"2024-09-16T15:37:43.523221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:03:21.436525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.525828+0000","last_change":"2024-09-16T15:37:43.517465+0000","last_active":"2024-09-16T15:37:45.525828+0000","last_peered":"2024-09-16T15:37:45.525828+0000","last_clean":"2024-09-16T15:37:45.525828+0000","last_became_active":"2024-09-16T15:37:43.517177+0000","last_became_peered":"2024-09-16T15:37:43.517177+0000","last_unstale":"2024-09-16T15:37:45.525828+0000","last_undegraded":"2024-09-16T15:37:45.525828+0000","last_fullsized":"2024-09-16T15:37:45.525828+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T21:38:37.823375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.504239+0000","last_change":"2024-09-16T15:37:43.504239+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.504239+0000","last_undegraded":"2024-09-16T15:37:43.504239+0000","last_fullsized":"2024-09-16T15:37:43.504239+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.521219+0000","last_change":"2024-09-16T15:37:43.519319+0000","last_active":"2024-09-16T15:37:43.521219+0000","last_peered":"2024-09-16T15:37:43.521219+0000","last_clean":"2024-09-16T15:37:43.521219+0000","last_became_active":"2024-09-16T15:37:43.518711+0000","last_became_peered":"2024-09-16T15:37:43.518711+0000","last_unstale":"2024-09-16T15:37:43.521219+0000","last_undegraded":"2024-09-16T15:37:43.521219+0000","last_fullsized":"2024-09-16T15:37:43.521219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:25:01.970817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.507140+0000","last_change":"2024-09-16T15:37:43.507140+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.507140+0000","last_undegraded":"2024-09-16T15:37:43.507140+0000","last_fullsized":"2024-09-16T15:37:43.507140+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.516204+0000","last_change":"2024-09-16T15:37:43.514400+0000","last_active":"2024-09-16T15:37:43.516204+0000","last_peered":"2024-09-16T15:37:43.516204+0000","last_clean":"2024-09-16T15:37:43.516204+0000","last_became_active":"2024-09-16T15:37:43.514124+0000","last_became_peered":"2024-09-16T15:37:43.514124+0000","last_unstale":"2024-09-16T15:37:43.516204+0000","last_undegraded":"2024-09-16T15:37:43.516204+0000","last_fullsized":"2024-09-16T15:37:43.516204+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:58:36.781822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.504279+0000","last_change":"2024-09-16T15:37:43.504279+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.504279+0000","last_undegraded":"2024-09-16T15:37:43.504279+0000","last_fullsized":"2024-09-16T15:37:43.504279+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.517060+0000","last_change":"2024-09-16T15:37:43.515976+0000","last_active":"2024-09-16T15:37:43.517060+0000","last_peered":"2024-09-16T15:37:43.517060+0000","last_clean":"2024-09-16T15:37:43.517060+0000","last_became_active":"2024-09-16T15:37:43.515426+0000","last_became_peered":"2024-09-16T15:37:43.515426+0000","last_unstale":"2024-09-16T15:37:43.517060+0000","last_undegraded":"2024-09-16T15:37:43.517060+0000","last_fullsized":"2024-09-16T15:37:43.517060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T21:42:39.448578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.503121+0000","last_change":"2024-09-16T15:37:43.503121+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.503121+0000","last_undegraded":"2024-09-16T15:37:43.503121+0000","last_fullsized":"2024-09-16T15:37:43.503121+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.522596+0000","last_change":"2024-09-16T15:37:43.516257+0000","last_active":"2024-09-16T15:37:43.522596+0000","last_peered":"2024-09-16T15:37:43.522596+0000","last_clean":"2024-09-16T15:37:43.522596+0000","last_became_active":"2024-09-16T15:37:43.515944+0000","last_became_peered":"2024-09-16T15:37:43.515944+0000","last_unstale":"2024-09-16T15:37:43.522596+0000","last_undegraded":"2024-09-16T15:37:43.522596+0000","last_fullsized":"2024-09-16T15:37:43.522596+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:58:36.781822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.502789+0000","last_change":"2024-09-16T15:37:43.502789+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.502789+0000","last_undegraded":"2024-09-16T15:37:43.502789+0000","last_fullsized":"2024-09-16T15:37:43.502789+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.516162+0000","last_change":"2024-09-16T15:37:43.514513+0000","last_active":"2024-09-16T15:37:43.516162+0000","last_peered":"2024-09-16T15:37:43.516162+0000","last_clean":"2024-09-16T15:37:43.516162+0000","last_became_active":"2024-09-16T15:37:43.514196+0000","last_became_peered":"2024-09-16T15:37:43.514196+0000","last_unstale":"2024-09-16T15:37:43.516162+0000","last_undegraded":"2024-09-16T15:37:43.516162+0000","last_fullsized":"2024-09-16T15:37:43.516162+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:43:24.500518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.504417+0000","last_change":"2024-09-16T15:37:43.504417+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.504417+0000","last_undegraded":"2024-09-16T15:37:43.504417+0000","last_fullsized":"2024-09-16T15:37:43.504417+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.525199+0000","last_change":"2024-09-16T15:37:43.521768+0000","last_active":"2024-09-16T15:37:43.525199+0000","last_peered":"2024-09-16T15:37:43.525199+0000","last_clean":"2024-09-16T15:37:43.525199+0000","last_became_active":"2024-09-16T15:37:43.521541+0000","last_became_peered":"2024-09-16T15:37:43.521541+0000","last_unstale":"2024-09-16T15:37:43.525199+0000","last_undegraded":"2024-09-16T15:37:43.525199+0000","last_fullsized":"2024-09-16T15:37:43.525199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:24:48.654268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.526567+0000","last_change":"2024-09-16T15:37:44.520303+0000","last_active":"2024-09-16T15:37:45.526567+0000","last_peered":"2024-09-16T15:37:45.526567+0000","last_clean":"2024-09-16T15:37:45.526567+0000","last_became_active":"2024-09-16T15:37:44.520036+0000","last_became_peered":"2024-09-16T15:37:44.520036+0000","last_unstale":"2024-09-16T15:37:45.526567+0000","last_undegraded":"2024-09-16T15:37:45.526567+0000","last_fullsized":"2024-09-16T15:37:45.526567+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:02:45.771447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.521972+0000","last_change":"2024-09-16T15:37:43.519519+0000","last_active":"2024-09-16T15:37:43.521972+0000","last_peered":"2024-09-16T15:37:43.521972+0000","last_clean":"2024-09-16T15:37:43.521972+0000","last_became_active":"2024-09-16T15:37:43.518682+0000","last_became_peered":"2024-09-16T15:37:43.518682+0000","last_unstale":"2024-09-16T15:37:43.521972+0000","last_undegraded":"2024-09-16T15:37:43.521972+0000","last_fullsized":"2024-09-16T15:37:43.521972+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T21:23:32.133055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.508570+0000","last_change":"2024-09-16T15:37:43.508570+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.508570+0000","last_undegraded":"2024-09-16T15:37:43.508570+0000","last_fullsized":"2024-09-16T15:37:43.508570+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.521229+0000","last_change":"2024-09-16T15:37:43.519576+0000","last_active":"2024-09-16T15:37:43.521229+0000","last_peered":"2024-09-16T15:37:43.521229+0000","last_clean":"2024-09-16T15:37:43.521229+0000","last_became_active":"2024-09-16T15:37:43.517609+0000","last_became_peered":"2024-09-16T15:37:43.517609+0000","last_unstale":"2024-09-16T15:37:43.521229+0000","last_undegraded":"2024-09-16T15:37:43.521229+0000","last_fullsized":"2024-09-16T15:37:43.521229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:37:32.374134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.501758+0000","last_change":"2024-09-16T15:37:43.501758+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.501758+0000","last_undegraded":"2024-09-16T15:37:43.501758+0000","last_fullsized":"2024-09-16T15:37:43.501758+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.517876+0000","last_change":"2024-09-16T15:37:43.514266+0000","last_active":"2024-09-16T15:37:43.517876+0000","last_peered":"2024-09-16T15:37:43.517876+0000","last_clean":"2024-09-16T15:37:43.517876+0000","last_became_active":"2024-09-16T15:37:43.513980+0000","last_became_peered":"2024-09-16T15:37:43.513980+0000","last_unstale":"2024-09-16T15:37:43.517876+0000","last_undegraded":"2024-09-16T15:37:43.517876+0000","last_fullsized":"2024-09-16T15:37:43.517876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:24:48.654268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.504309+0000","last_change":"2024-09-16T15:37:43.504309+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.504309+0000","last_undegraded":"2024-09-16T15:37:43.504309+0000","last_fullsized":"2024-09-16T15:37:43.504309+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.521176+0000","last_change":"2024-09-16T15:37:43.518884+0000","last_active":"2024-09-16T15:37:43.521176+0000","last_peered":"2024-09-16T15:37:43.521176+0000","last_clean":"2024-09-16T15:37:43.521176+0000","last_became_active":"2024-09-16T15:37:43.517494+0000","last_became_peered":"2024-09-16T15:37:43.517494+0000","last_unstale":"2024-09-16T15:37:43.521176+0000","last_undegraded":"2024-09-16T15:37:43.521176+0000","last_fullsized":"2024-09-16T15:37:43.521176+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:45:09.277422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.503176+0000","last_change":"2024-09-16T15:37:43.503176+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.503176+0000","last_undegraded":"2024-09-16T15:37:43.503176+0000","last_fullsized":"2024-09-16T15:37:43.503176+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.517928+0000","last_change":"2024-09-16T15:37:43.514250+0000","last_active":"2024-09-16T15:37:43.517928+0000","last_peered":"2024-09-16T15:37:43.517928+0000","last_clean":"2024-09-16T15:37:43.517928+0000","last_became_active":"2024-09-16T15:37:43.513954+0000","last_became_peered":"2024-09-16T15:37:43.513954+0000","last_unstale":"2024-09-16T15:37:43.517928+0000","last_undegraded":"2024-09-16T15:37:43.517928+0000","last_fullsized":"2024-09-16T15:37:43.517928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:58:36.781822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.505682+0000","last_change":"2024-09-16T15:37:43.505682+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.505682+0000","last_undegraded":"2024-09-16T15:37:43.505682+0000","last_fullsized":"2024-09-16T15:37:43.505682+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.516491+0000","last_change":"2024-09-16T15:37:43.514330+0000","last_active":"2024-09-16T15:37:43.516491+0000","last_peered":"2024-09-16T15:37:43.516491+0000","last_clean":"2024-09-16T15:37:43.516491+0000","last_became_active":"2024-09-16T15:37:43.513900+0000","last_became_peered":"2024-09-16T15:37:43.513900+0000","last_unstale":"2024-09-16T15:37:43.516491+0000","last_undegraded":"2024-09-16T15:37:43.516491+0000","last_fullsized":"2024-09-16T15:37:43.516491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T23:50:34.279091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.505063+0000","last_change":"2024-09-16T15:37:43.505063+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.505063+0000","last_undegraded":"2024-09-16T15:37:43.505063+0000","last_fullsized":"2024-09-16T15:37:43.505063+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.526586+0000","last_change":"2024-09-16T15:37:43.520873+0000","last_active":"2024-09-16T15:37:45.526586+0000","last_peered":"2024-09-16T15:37:45.526586+0000","last_clean":"2024-09-16T15:37:45.526586+0000","last_became_active":"2024-09-16T15:37:43.520561+0000","last_became_peered":"2024-09-16T15:37:43.520561+0000","last_unstale":"2024-09-16T15:37:45.526586+0000","last_undegraded":"2024-09-16T15:37:45.526586+0000","last_fullsized":"2024-09-16T15:37:45.526586+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:08:30.145981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.506168+0000","last_change":"2024-09-16T15:37:43.506168+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.506168+0000","last_undegraded":"2024-09-16T15:37:43.506168+0000","last_fullsized":"2024-09-16T15:37:43.506168+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":107,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.498711+0000","last_change":"2024-09-16T15:37:37.258601+0000","last_active":"2024-09-16T15:37:43.498711+0000","last_peered":"2024-09-16T15:37:43.498711+0000","last_clean":"2024-09-16T15:37:43.498711+0000","last_became_active":"2024-09-16T15:37:37.257584+0000","last_became_peered":"2024-09-16T15:37:37.257584+0000","last_unstale":"2024-09-16T15:37:43.498711+0000","last_undegraded":"2024-09-16T15:37:43.498711+0000","last_fullsized":"2024-09-16T15:37:43.498711+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:35.447043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:35.447043+0000","last_clean_scrub_stamp":"2024-09-16T15:37:35.447043+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:43:17.464894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.513875+0000","last_change":"2024-09-16T15:37:43.510139+0000","last_active":"2024-09-16T15:37:43.513875+0000","last_peered":"2024-09-16T15:37:43.513875+0000","last_clean":"2024-09-16T15:37:43.513875+0000","last_became_active":"2024-09-16T15:37:43.509820+0000","last_became_peered":"2024-09-16T15:37:43.509820+0000","last_unstale":"2024-09-16T15:37:43.513875+0000","last_undegraded":"2024-09-16T15:37:43.513875+0000","last_fullsized":"2024-09-16T15:37:43.513875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:18:57.765147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.507336+0000","last_change":"2024-09-16T15:37:43.507336+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.507336+0000","last_undegraded":"2024-09-16T15:37:43.507336+0000","last_fullsized":"2024-09-16T15:37:43.507336+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.521246+0000","last_change":"2024-09-16T15:37:43.519442+0000","last_active":"2024-09-16T15:37:43.521246+0000","last_peered":"2024-09-16T15:37:43.521246+0000","last_clean":"2024-09-16T15:37:43.521246+0000","last_became_active":"2024-09-16T15:37:43.519204+0000","last_became_peered":"2024-09-16T15:37:43.519204+0000","last_unstale":"2024-09-16T15:37:43.521246+0000","last_undegraded":"2024-09-16T15:37:43.521246+0000","last_fullsized":"2024-09-16T15:37:43.521246+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:42:35.749344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.525649+0000","last_change":"2024-09-16T15:37:44.511988+0000","last_active":"2024-09-16T15:37:45.525649+0000","last_peered":"2024-09-16T15:37:45.525649+0000","last_clean":"2024-09-16T15:37:45.525649+0000","last_became_active":"2024-09-16T15:37:44.511679+0000","last_became_peered":"2024-09-16T15:37:44.511679+0000","last_unstale":"2024-09-16T15:37:45.525649+0000","last_undegraded":"2024-09-16T15:37:45.525649+0000","last_fullsized":"2024-09-16T15:37:45.525649+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:39:56.702467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.522564+0000","last_change":"2024-09-16T15:37:43.515953+0000","last_active":"2024-09-16T15:37:43.522564+0000","last_peered":"2024-09-16T15:37:43.522564+0000","last_clean":"2024-09-16T15:37:43.522564+0000","last_became_active":"2024-09-16T15:37:43.515662+0000","last_became_peered":"2024-09-16T15:37:43.515662+0000","last_unstale":"2024-09-16T15:37:43.522564+0000","last_undegraded":"2024-09-16T15:37:43.522564+0000","last_fullsized":"2024-09-16T15:37:43.522564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:18:57.765147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.505160+0000","last_change":"2024-09-16T15:37:43.505160+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.505160+0000","last_undegraded":"2024-09-16T15:37:43.505160+0000","last_fullsized":"2024-09-16T15:37:43.505160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.514888+0000","last_change":"2024-09-16T15:37:43.513231+0000","last_active":"2024-09-16T15:37:43.514888+0000","last_peered":"2024-09-16T15:37:43.514888+0000","last_clean":"2024-09-16T15:37:43.514888+0000","last_became_active":"2024-09-16T15:37:43.512954+0000","last_became_peered":"2024-09-16T15:37:43.512954+0000","last_unstale":"2024-09-16T15:37:43.514888+0000","last_undegraded":"2024-09-16T15:37:43.514888+0000","last_fullsized":"2024-09-16T15:37:43.514888+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:58:36.781822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.503500+0000","last_change":"2024-09-16T15:37:43.503500+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.503500+0000","last_undegraded":"2024-09-16T15:37:43.503500+0000","last_fullsized":"2024-09-16T15:37:43.503500+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.513599+0000","last_change":"2024-09-16T15:37:43.510480+0000","last_active":"2024-09-16T15:37:43.513599+0000","last_peered":"2024-09-16T15:37:43.513599+0000","last_clean":"2024-09-16T15:37:43.513599+0000","last_became_active":"2024-09-16T15:37:43.510223+0000","last_became_peered":"2024-09-16T15:37:43.510223+0000","last_unstale":"2024-09-16T15:37:43.513599+0000","last_undegraded":"2024-09-16T15:37:43.513599+0000","last_fullsized":"2024-09-16T15:37:43.513599+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:18:57.765147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.503364+0000","last_change":"2024-09-16T15:37:43.503364+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.503364+0000","last_undegraded":"2024-09-16T15:37:43.503364+0000","last_fullsized":"2024-09-16T15:37:43.503364+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.516668+0000","last_change":"2024-09-16T15:37:43.515757+0000","last_active":"2024-09-16T15:37:43.516668+0000","last_peered":"2024-09-16T15:37:43.516668+0000","last_clean":"2024-09-16T15:37:43.516668+0000","last_became_active":"2024-09-16T15:37:43.515199+0000","last_became_peered":"2024-09-16T15:37:43.515199+0000","last_unstale":"2024-09-16T15:37:43.516668+0000","last_undegraded":"2024-09-16T15:37:43.516668+0000","last_fullsized":"2024-09-16T15:37:43.516668+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T23:50:34.279091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.526573+0000","last_change":"2024-09-16T15:37:44.515147+0000","last_active":"2024-09-16T15:37:45.526573+0000","last_peered":"2024-09-16T15:37:45.526573+0000","last_clean":"2024-09-16T15:37:45.526573+0000","last_became_active":"2024-09-16T15:37:44.514518+0000","last_became_peered":"2024-09-16T15:37:44.514518+0000","last_unstale":"2024-09-16T15:37:45.526573+0000","last_undegraded":"2024-09-16T15:37:45.526573+0000","last_fullsized":"2024-09-16T15:37:45.526573+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:57:36.296851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.522756+0000","last_change":"2024-09-16T15:37:43.518081+0000","last_active":"2024-09-16T15:37:43.522756+0000","last_peered":"2024-09-16T15:37:43.522756+0000","last_clean":"2024-09-16T15:37:43.522756+0000","last_became_active":"2024-09-16T15:37:43.517744+0000","last_became_peered":"2024-09-16T15:37:43.517744+0000","last_unstale":"2024-09-16T15:37:43.522756+0000","last_undegraded":"2024-09-16T15:37:43.522756+0000","last_fullsized":"2024-09-16T15:37:43.522756+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:08:31.665964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.508877+0000","last_change":"2024-09-16T15:37:43.508877+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.508877+0000","last_undegraded":"2024-09-16T15:37:43.508877+0000","last_fullsized":"2024-09-16T15:37:43.508877+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.521293+0000","last_change":"2024-09-16T15:37:43.519357+0000","last_active":"2024-09-16T15:37:43.521293+0000","last_peered":"2024-09-16T15:37:43.521293+0000","last_clean":"2024-09-16T15:37:43.521293+0000","last_became_active":"2024-09-16T15:37:43.519050+0000","last_became_peered":"2024-09-16T15:37:43.519050+0000","last_unstale":"2024-09-16T15:37:43.521293+0000","last_undegraded":"2024-09-16T15:37:43.521293+0000","last_fullsized":"2024-09-16T15:37:43.521293+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:08:31.665964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.508507+0000","last_change":"2024-09-16T15:37:43.508507+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.508507+0000","last_undegraded":"2024-09-16T15:37:43.508507+0000","last_fullsized":"2024-09-16T15:37:43.508507+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.521054+0000","last_change":"2024-09-16T15:37:43.517924+0000","last_active":"2024-09-16T15:37:43.521054+0000","last_peered":"2024-09-16T15:37:43.521054+0000","last_clean":"2024-09-16T15:37:43.521054+0000","last_became_active":"2024-09-16T15:37:43.516036+0000","last_became_peered":"2024-09-16T15:37:43.516036+0000","last_unstale":"2024-09-16T15:37:43.521054+0000","last_undegraded":"2024-09-16T15:37:43.521054+0000","last_fullsized":"2024-09-16T15:37:43.521054+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T23:52:54.008046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.503358+0000","last_change":"2024-09-16T15:37:43.503358+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.503358+0000","last_undegraded":"2024-09-16T15:37:43.503358+0000","last_fullsized":"2024-09-16T15:37:43.503358+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.522744+0000","last_change":"2024-09-16T15:37:43.518084+0000","last_active":"2024-09-16T15:37:43.522744+0000","last_peered":"2024-09-16T15:37:43.522744+0000","last_clean":"2024-09-16T15:37:43.522744+0000","last_became_active":"2024-09-16T15:37:43.517773+0000","last_became_peered":"2024-09-16T15:37:43.517773+0000","last_unstale":"2024-09-16T15:37:43.522744+0000","last_undegraded":"2024-09-16T15:37:43.522744+0000","last_fullsized":"2024-09-16T15:37:43.522744+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:25:01.970817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.507353+0000","last_change":"2024-09-16T15:37:43.507353+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.507353+0000","last_undegraded":"2024-09-16T15:37:43.507353+0000","last_fullsized":"2024-09-16T15:37:43.507353+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.526487+0000","last_change":"2024-09-16T15:37:43.511936+0000","last_active":"2024-09-16T15:37:45.526487+0000","last_peered":"2024-09-16T15:37:45.526487+0000","last_clean":"2024-09-16T15:37:45.526487+0000","last_became_active":"2024-09-16T15:37:43.511709+0000","last_became_peered":"2024-09-16T15:37:43.511709+0000","last_unstale":"2024-09-16T15:37:45.526487+0000","last_undegraded":"2024-09-16T15:37:45.526487+0000","last_fullsized":"2024-09-16T15:37:45.526487+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:22:48.178297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.510415+0000","last_change":"2024-09-16T15:37:43.510415+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.510415+0000","last_undegraded":"2024-09-16T15:37:43.510415+0000","last_fullsized":"2024-09-16T15:37:43.510415+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.514961+0000","last_change":"2024-09-16T15:37:43.513406+0000","last_active":"2024-09-16T15:37:43.514961+0000","last_peered":"2024-09-16T15:37:43.514961+0000","last_clean":"2024-09-16T15:37:43.514961+0000","last_became_active":"2024-09-16T15:37:43.512994+0000","last_became_peered":"2024-09-16T15:37:43.512994+0000","last_unstale":"2024-09-16T15:37:43.514961+0000","last_undegraded":"2024-09-16T15:37:43.514961+0000","last_fullsized":"2024-09-16T15:37:43.514961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:24:48.654268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.507703+0000","last_change":"2024-09-16T15:37:43.507703+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.507703+0000","last_undegraded":"2024-09-16T15:37:43.507703+0000","last_fullsized":"2024-09-16T15:37:43.507703+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.507590+0000","last_change":"2024-09-16T15:37:43.507590+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.507590+0000","last_undegraded":"2024-09-16T15:37:43.507590+0000","last_fullsized":"2024-09-16T15:37:43.507590+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.517270+0000","last_change":"2024-09-16T15:37:43.512302+0000","last_active":"2024-09-16T15:37:43.517270+0000","last_peered":"2024-09-16T15:37:43.517270+0000","last_clean":"2024-09-16T15:37:43.517270+0000","last_became_active":"2024-09-16T15:37:43.511884+0000","last_became_peered":"2024-09-16T15:37:43.511884+0000","last_unstale":"2024-09-16T15:37:43.517270+0000","last_undegraded":"2024-09-16T15:37:43.517270+0000","last_fullsized":"2024-09-16T15:37:43.517270+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:43:24.500518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.501832+0000","last_change":"2024-09-16T15:37:43.501832+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.501832+0000","last_undegraded":"2024-09-16T15:37:43.501832+0000","last_fullsized":"2024-09-16T15:37:43.501832+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.521108+0000","last_change":"2024-09-16T15:37:43.518058+0000","last_active":"2024-09-16T15:37:43.521108+0000","last_peered":"2024-09-16T15:37:43.521108+0000","last_clean":"2024-09-16T15:37:43.521108+0000","last_became_active":"2024-09-16T15:37:43.517743+0000","last_became_peered":"2024-09-16T15:37:43.517743+0000","last_unstale":"2024-09-16T15:37:43.521108+0000","last_undegraded":"2024-09-16T15:37:43.521108+0000","last_fullsized":"2024-09-16T15:37:43.521108+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:44:54.808566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.506222+0000","last_change":"2024-09-16T15:37:43.506222+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.506222+0000","last_undegraded":"2024-09-16T15:37:43.506222+0000","last_fullsized":"2024-09-16T15:37:43.506222+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.515283+0000","last_change":"2024-09-16T15:37:43.513164+0000","last_active":"2024-09-16T15:37:43.515283+0000","last_peered":"2024-09-16T15:37:43.515283+0000","last_clean":"2024-09-16T15:37:43.515283+0000","last_became_active":"2024-09-16T15:37:43.512890+0000","last_became_peered":"2024-09-16T15:37:43.512890+0000","last_unstale":"2024-09-16T15:37:43.515283+0000","last_undegraded":"2024-09-16T15:37:43.515283+0000","last_fullsized":"2024-09-16T15:37:43.515283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:24:48.654268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-16T15:37:43.505396+0000","last_change":"2024-09-16T15:37:43.505396+0000","last_active":"2024-09-16T15:37:43.489547+0000","last_peered":"2024-09-16T15:37:43.489547+0000","last_clean":"2024-09-16T15:37:43.489547+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:37:43.505396+0000","last_undegraded":"2024-09-16T15:37:43.505396+0000","last_fullsized":"2024-09-16T15:37:43.505396+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:37:43.520386+0000","last_change":"2024-09-16T15:37:43.515725+0000","last_active":"2024-09-16T15:37:43.520386+0000","last_peered":"2024-09-16T15:37:43.520386+0000","last_clean":"2024-09-16T15:37:43.520386+0000","last_became_active":"2024-09-16T15:37:43.515461+0000","last_became_peered":"2024-09-16T15:37:43.515461+0000","last_unstale":"2024-09-16T15:37:43.520386+0000","last_undegraded":"2024-09-16T15:37:43.520386+0000","last_fullsized":"2024-09-16T15:37:43.520386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T23:50:34.279091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":790528,"data_stored":652253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509446,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":208896,"data_stored":68160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":802816,"data_stored":658528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":233472,"data_stored":81235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T15:37:50.019 INFO:tasks.ceph.mds.c.smithi098.stderr:2024-09-16T15:37:50.017+0000 7fac4e82e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-16T15:37:52.884 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T15:37:52.998 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:52.995+0000 7f0d1392b640 1 -- 172.21.15.98:0/2320302694 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0d0c15f1c0 msgr2=0x7f0d0c0cfdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:52.998 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:52.995+0000 7f0d1392b640 1 --2- 172.21.15.98:0/2320302694 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0d0c15f1c0 0x7f0d0c0cfdf0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c071ce0 tx=0x7f0cfc02a560 comp rx=0 tx=0).stop 2024-09-16T15:37:52.998 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:52.995+0000 7f0d1392b640 1 -- 172.21.15.98:0/2320302694 shutdown_connections 2024-09-16T15:37:52.998 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:52.995+0000 7f0d1392b640 1 --2- 172.21.15.98:0/2320302694 >> v2:172.21.15.135:3300/0 conn(0x7f0d0c0737d0 0x7f0d0c073c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:52.998 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:52.995+0000 7f0d1392b640 1 --2- 172.21.15.98:0/2320302694 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0d0c15f1c0 0x7f0d0c0cfdf0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:52.998 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:52.995+0000 7f0d1392b640 1 --2- 172.21.15.98:0/2320302694 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d0c15ede0 0x7f0d0c15be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:52.998 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:52.995+0000 7f0d1392b640 1 -- 172.21.15.98:0/2320302694 >> 172.21.15.98:0/2320302694 conn(0x7f0d0c0d0d40 msgr2=0x7f0d0c0d1150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:52.998 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:52.995+0000 7f0d1392b640 1 -- 172.21.15.98:0/2320302694 shutdown_connections 2024-09-16T15:37:52.998 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:52.995+0000 7f0d1392b640 1 -- 172.21.15.98:0/2320302694 wait complete. 2024-09-16T15:37:52.999 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:52.997+0000 7f0d1392b640 1 Processor -- start 2024-09-16T15:37:52.999 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:52.997+0000 7f0d1392b640 1 -- start start 2024-09-16T15:37:53.001 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:52.997+0000 7f0d1392b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d0c0737d0 0x7f0d0c150dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:53.001 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:52.997+0000 7f0d1392b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0d0c15ede0 0x7f0d0c14f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:53.001 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:52.997+0000 7f0d1392b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d0c15f1c0 0x7f0d0c1f5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:53.001 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:52.997+0000 7f0d1392b640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0d0c0aee00 con 0x7f0d0c15ede0 2024-09-16T15:37:53.001 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:52.997+0000 7f0d1392b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0d0c0aec80 con 0x7f0d0c0737d0 2024-09-16T15:37:53.001 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:52.997+0000 7f0d1392b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f0d0c0aef80 con 0x7f0d0c15f1c0 2024-09-16T15:37:53.001 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:52.998+0000 7f0d10ec6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0d0c15ede0 0x7f0d0c14f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:53.001 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:52.998+0000 7f0d10ec6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0d0c15ede0 0x7f0d0c14f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59544/0 (socket says 172.21.15.98:59544) 2024-09-16T15:37:53.001 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:52.998+0000 7f0d10ec6640 1 -- 172.21.15.98:0/3007843640 learned_addr learned my addr 172.21.15.98:0/3007843640 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:37:53.001 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:52.998+0000 7f0d116c7640 1 --2- 172.21.15.98:0/3007843640 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d0c0737d0 0x7f0d0c150dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:53.001 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:52.998+0000 7f0d11ec8640 1 --2- 172.21.15.98:0/3007843640 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d0c15f1c0 0x7f0d0c1f5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:53.001 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:52.998+0000 7f0d10ec6640 1 -- 172.21.15.98:0/3007843640 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d0c15f1c0 msgr2=0x7f0d0c1f5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:53.001 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:52.998+0000 7f0d10ec6640 1 --2- 172.21.15.98:0/3007843640 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d0c15f1c0 0x7f0d0c1f5d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:53.001 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:52.998+0000 7f0d10ec6640 1 -- 172.21.15.98:0/3007843640 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d0c0737d0 msgr2=0x7f0d0c150dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:53.002 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:52.998+0000 7f0d10ec6640 1 --2- 172.21.15.98:0/3007843640 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d0c0737d0 0x7f0d0c150dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:53.002 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:52.998+0000 7f0d10ec6640 1 -- 172.21.15.98:0/3007843640 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d0c09d710 con 0x7f0d0c15ede0 2024-09-16T15:37:53.002 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:52.998+0000 7f0d10ec6640 1 --2- 172.21.15.98:0/3007843640 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0d0c15ede0 0x7f0d0c14f7d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc034040 tx=0x7f0cfc0039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:53.002 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:52.998+0000 7f0d01ffb640 1 -- 172.21.15.98:0/3007843640 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cfc03e030 con 0x7f0d0c15ede0 2024-09-16T15:37:53.002 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:52.998+0000 7f0d01ffb640 1 -- 172.21.15.98:0/3007843640 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0cfc0047a0 con 0x7f0d0c15ede0 2024-09-16T15:37:53.002 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:52.998+0000 7f0d01ffb640 1 -- 172.21.15.98:0/3007843640 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cfc035040 con 0x7f0d0c15ede0 2024-09-16T15:37:53.002 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:52.998+0000 7f0d1392b640 1 -- 172.21.15.98:0/3007843640 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d0c09d9f0 con 0x7f0d0c15ede0 2024-09-16T15:37:53.002 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:52.999+0000 7f0d1392b640 1 -- 172.21.15.98:0/3007843640 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d0c09e290 con 0x7f0d0c15ede0 2024-09-16T15:37:53.003 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.000+0000 7f0d1392b640 1 -- 172.21.15.98:0/3007843640 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d0c09dde0 con 0x7f0d0c15ede0 2024-09-16T15:37:53.003 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.000+0000 7f0d01ffb640 1 -- 172.21.15.98:0/3007843640 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7f0cfc041030 con 0x7f0d0c15ede0 2024-09-16T15:37:53.003 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.000+0000 7f0d01ffb640 1 --2- 172.21.15.98:0/3007843640 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f0cf0078850 0x7f0cf007ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:53.003 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.001+0000 7f0d01ffb640 1 -- 172.21.15.98:0/3007843640 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f0cfc0baee0 con 0x7f0d0c15ede0 2024-09-16T15:37:53.003 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.001+0000 7f0d116c7640 1 --2- 172.21.15.98:0/3007843640 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f0cf0078850 0x7f0cf007ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:53.003 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.001+0000 7f0d116c7640 1 --2- 172.21.15.98:0/3007843640 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f0cf0078850 0x7f0cf007ad10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c155830 tx=0x7f0d0800b390 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:53.006 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.005+0000 7f0d01ffb640 1 -- 172.21.15.98:0/3007843640 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7f0cfc082f00 con 0x7f0d0c15ede0 2024-09-16T15:37:53.179 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.177+0000 7f0d1392b640 1 -- 172.21.15.98:0/3007843640 --> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0d0c071fd0 con 0x7f0cf0078850 2024-09-16T15:37:53.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.181+0000 7f0d01ffb640 1 -- 172.21.15.98:0/3007843640 <== mgr.4100 v2:172.21.15.135:6800/699234772 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251920 (secure 0 0 0) 0x7f0d0c071fd0 con 0x7f0cf0078850 2024-09-16T15:37:53.186 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:37:53.187 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2024-09-16T15:37:53.188 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.184+0000 7f0d1392b640 1 -- 172.21.15.98:0/3007843640 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f0cf0078850 msgr2=0x7f0cf007ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:53.189 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.184+0000 7f0d1392b640 1 --2- 172.21.15.98:0/3007843640 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f0cf0078850 0x7f0cf007ad10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c155830 tx=0x7f0d0800b390 comp rx=0 tx=0).stop 2024-09-16T15:37:53.189 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.184+0000 7f0d1392b640 1 -- 172.21.15.98:0/3007843640 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0d0c15ede0 msgr2=0x7f0d0c14f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:53.189 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.184+0000 7f0d1392b640 1 --2- 172.21.15.98:0/3007843640 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0d0c15ede0 0x7f0d0c14f7d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc034040 tx=0x7f0cfc0039e0 comp rx=0 tx=0).stop 2024-09-16T15:37:53.189 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.184+0000 7f0d1392b640 1 -- 172.21.15.98:0/3007843640 shutdown_connections 2024-09-16T15:37:53.189 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.184+0000 7f0d1392b640 1 --2- 172.21.15.98:0/3007843640 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0d0c15f1c0 0x7f0d0c1f5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:53.189 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.184+0000 7f0d1392b640 1 --2- 172.21.15.98:0/3007843640 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0d0c15ede0 0x7f0d0c14f7d0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:53.189 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.184+0000 7f0d1392b640 1 --2- 172.21.15.98:0/3007843640 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f0cf0078850 0x7f0cf007ad10 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:53.189 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.184+0000 7f0d1392b640 1 --2- 172.21.15.98:0/3007843640 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d0c0737d0 0x7f0d0c150dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:53.189 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.184+0000 7f0d1392b640 1 -- 172.21.15.98:0/3007843640 >> 172.21.15.98:0/3007843640 conn(0x7f0d0c0d0d40 msgr2=0x7f0d0c070a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:53.189 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.184+0000 7f0d1392b640 1 -- 172.21.15.98:0/3007843640 shutdown_connections 2024-09-16T15:37:53.189 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.184+0000 7f0d1392b640 1 -- 172.21.15.98:0/3007843640 wait complete. 2024-09-16T15:37:53.197 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2024-09-16T15:37:52.710710+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":170,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219288,"kb_used_data":3048,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755432,"statfs":{"total":773094113280,"available":772869562368,"internally_reserved":0,"allocated":3121152,"data_stored":1835436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.211772"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.157551+0000","last_change":"2024-09-16T15:37:44.522255+0000","last_active":"2024-09-16T15:37:47.157551+0000","last_peered":"2024-09-16T15:37:47.157551+0000","last_clean":"2024-09-16T15:37:47.157551+0000","last_became_active":"2024-09-16T15:37:44.521954+0000","last_became_peered":"2024-09-16T15:37:44.521954+0000","last_unstale":"2024-09-16T15:37:47.157551+0000","last_undegraded":"2024-09-16T15:37:47.157551+0000","last_fullsized":"2024-09-16T15:37:47.157551+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:04:08.210631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.295767+0000","last_change":"2024-09-16T15:37:44.521698+0000","last_active":"2024-09-16T15:37:47.295767+0000","last_peered":"2024-09-16T15:37:47.295767+0000","last_clean":"2024-09-16T15:37:47.295767+0000","last_became_active":"2024-09-16T15:37:44.521108+0000","last_became_peered":"2024-09-16T15:37:44.521108+0000","last_unstale":"2024-09-16T15:37:47.295767+0000","last_undegraded":"2024-09-16T15:37:47.295767+0000","last_fullsized":"2024-09-16T15:37:47.295767+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:36:30.703573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.295614+0000","last_change":"2024-09-16T15:37:44.526656+0000","last_active":"2024-09-16T15:37:47.295614+0000","last_peered":"2024-09-16T15:37:47.295614+0000","last_clean":"2024-09-16T15:37:47.295614+0000","last_became_active":"2024-09-16T15:37:44.526371+0000","last_became_peered":"2024-09-16T15:37:44.526371+0000","last_unstale":"2024-09-16T15:37:47.295614+0000","last_undegraded":"2024-09-16T15:37:47.295614+0000","last_fullsized":"2024-09-16T15:37:47.295614+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:58:21.450388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:46.943693+0000","last_change":"2024-09-16T15:37:44.512933+0000","last_active":"2024-09-16T15:37:46.943693+0000","last_peered":"2024-09-16T15:37:46.943693+0000","last_clean":"2024-09-16T15:37:46.943693+0000","last_became_active":"2024-09-16T15:37:44.512675+0000","last_became_peered":"2024-09-16T15:37:44.512675+0000","last_unstale":"2024-09-16T15:37:46.943693+0000","last_undegraded":"2024-09-16T15:37:46.943693+0000","last_fullsized":"2024-09-16T15:37:46.943693+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:13:55.812269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.157367+0000","last_change":"2024-09-16T15:37:44.519918+0000","last_active":"2024-09-16T15:37:47.157367+0000","last_peered":"2024-09-16T15:37:47.157367+0000","last_clean":"2024-09-16T15:37:47.157367+0000","last_became_active":"2024-09-16T15:37:44.519424+0000","last_became_peered":"2024-09-16T15:37:44.519424+0000","last_unstale":"2024-09-16T15:37:47.157367+0000","last_undegraded":"2024-09-16T15:37:47.157367+0000","last_fullsized":"2024-09-16T15:37:47.157367+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:14:56.128121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:46.943654+0000","last_change":"2024-09-16T15:37:44.515343+0000","last_active":"2024-09-16T15:37:46.943654+0000","last_peered":"2024-09-16T15:37:46.943654+0000","last_clean":"2024-09-16T15:37:46.943654+0000","last_became_active":"2024-09-16T15:37:44.515130+0000","last_became_peered":"2024-09-16T15:37:44.515130+0000","last_unstale":"2024-09-16T15:37:46.943654+0000","last_undegraded":"2024-09-16T15:37:46.943654+0000","last_fullsized":"2024-09-16T15:37:46.943654+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:57:47.143508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.157210+0000","last_change":"2024-09-16T15:37:44.522713+0000","last_active":"2024-09-16T15:37:47.157210+0000","last_peered":"2024-09-16T15:37:47.157210+0000","last_clean":"2024-09-16T15:37:47.157210+0000","last_became_active":"2024-09-16T15:37:44.522455+0000","last_became_peered":"2024-09-16T15:37:44.522455+0000","last_unstale":"2024-09-16T15:37:47.157210+0000","last_undegraded":"2024-09-16T15:37:47.157210+0000","last_fullsized":"2024-09-16T15:37:47.157210+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:34:32.134838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.295408+0000","last_change":"2024-09-16T15:37:44.530623+0000","last_active":"2024-09-16T15:37:47.295408+0000","last_peered":"2024-09-16T15:37:47.295408+0000","last_clean":"2024-09-16T15:37:47.295408+0000","last_became_active":"2024-09-16T15:37:44.530278+0000","last_became_peered":"2024-09-16T15:37:44.530278+0000","last_unstale":"2024-09-16T15:37:47.295408+0000","last_undegraded":"2024-09-16T15:37:47.295408+0000","last_fullsized":"2024-09-16T15:37:47.295408+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T23:12:12.374603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.850903+0000","last_change":"2024-09-16T15:37:44.526860+0000","last_active":"2024-09-16T15:37:45.850903+0000","last_peered":"2024-09-16T15:37:45.850903+0000","last_clean":"2024-09-16T15:37:45.850903+0000","last_became_active":"2024-09-16T15:37:44.526611+0000","last_became_peered":"2024-09-16T15:37:44.526611+0000","last_unstale":"2024-09-16T15:37:45.850903+0000","last_undegraded":"2024-09-16T15:37:45.850903+0000","last_fullsized":"2024-09-16T15:37:45.850903+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:10:17.354173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.157550+0000","last_change":"2024-09-16T15:37:44.519349+0000","last_active":"2024-09-16T15:37:47.157550+0000","last_peered":"2024-09-16T15:37:47.157550+0000","last_clean":"2024-09-16T15:37:47.157550+0000","last_became_active":"2024-09-16T15:37:44.519074+0000","last_became_peered":"2024-09-16T15:37:44.519074+0000","last_unstale":"2024-09-16T15:37:47.157550+0000","last_undegraded":"2024-09-16T15:37:47.157550+0000","last_fullsized":"2024-09-16T15:37:47.157550+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T21:46:25.013947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.157206+0000","last_change":"2024-09-16T15:37:44.520396+0000","last_active":"2024-09-16T15:37:47.157206+0000","last_peered":"2024-09-16T15:37:47.157206+0000","last_clean":"2024-09-16T15:37:47.157206+0000","last_became_active":"2024-09-16T15:37:44.520166+0000","last_became_peered":"2024-09-16T15:37:44.520166+0000","last_unstale":"2024-09-16T15:37:47.157206+0000","last_undegraded":"2024-09-16T15:37:47.157206+0000","last_fullsized":"2024-09-16T15:37:47.157206+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:19:57.119675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.157296+0000","last_change":"2024-09-16T15:37:44.517541+0000","last_active":"2024-09-16T15:37:47.157296+0000","last_peered":"2024-09-16T15:37:47.157296+0000","last_clean":"2024-09-16T15:37:47.157296+0000","last_became_active":"2024-09-16T15:37:44.517304+0000","last_became_peered":"2024-09-16T15:37:44.517304+0000","last_unstale":"2024-09-16T15:37:47.157296+0000","last_undegraded":"2024-09-16T15:37:47.157296+0000","last_fullsized":"2024-09-16T15:37:47.157296+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:40:14.841427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.526086+0000","last_change":"2024-09-16T15:37:44.515572+0000","last_active":"2024-09-16T15:37:45.526086+0000","last_peered":"2024-09-16T15:37:45.526086+0000","last_clean":"2024-09-16T15:37:45.526086+0000","last_became_active":"2024-09-16T15:37:44.514667+0000","last_became_peered":"2024-09-16T15:37:44.514667+0000","last_unstale":"2024-09-16T15:37:45.526086+0000","last_undegraded":"2024-09-16T15:37:45.526086+0000","last_fullsized":"2024-09-16T15:37:45.526086+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:37:31.235473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.526350+0000","last_change":"2024-09-16T15:37:44.517134+0000","last_active":"2024-09-16T15:37:45.526350+0000","last_peered":"2024-09-16T15:37:45.526350+0000","last_clean":"2024-09-16T15:37:45.526350+0000","last_became_active":"2024-09-16T15:37:44.515946+0000","last_became_peered":"2024-09-16T15:37:44.515946+0000","last_unstale":"2024-09-16T15:37:45.526350+0000","last_undegraded":"2024-09-16T15:37:45.526350+0000","last_fullsized":"2024-09-16T15:37:45.526350+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:01:35.813267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.295391+0000","last_change":"2024-09-16T15:37:44.530620+0000","last_active":"2024-09-16T15:37:47.295391+0000","last_peered":"2024-09-16T15:37:47.295391+0000","last_clean":"2024-09-16T15:37:47.295391+0000","last_became_active":"2024-09-16T15:37:44.530286+0000","last_became_peered":"2024-09-16T15:37:44.530286+0000","last_unstale":"2024-09-16T15:37:47.295391+0000","last_undegraded":"2024-09-16T15:37:47.295391+0000","last_fullsized":"2024-09-16T15:37:47.295391+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T23:21:00.721426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.522970+0000","last_change":"2024-09-16T15:37:44.524560+0000","last_active":"2024-09-16T15:37:45.522970+0000","last_peered":"2024-09-16T15:37:45.522970+0000","last_clean":"2024-09-16T15:37:45.522970+0000","last_became_active":"2024-09-16T15:37:44.524314+0000","last_became_peered":"2024-09-16T15:37:44.524314+0000","last_unstale":"2024-09-16T15:37:45.522970+0000","last_undegraded":"2024-09-16T15:37:45.522970+0000","last_fullsized":"2024-09-16T15:37:45.522970+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:36:30.703573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.523673+0000","last_change":"2024-09-16T15:37:44.528374+0000","last_active":"2024-09-16T15:37:45.523673+0000","last_peered":"2024-09-16T15:37:45.523673+0000","last_clean":"2024-09-16T15:37:45.523673+0000","last_became_active":"2024-09-16T15:37:44.528131+0000","last_became_peered":"2024-09-16T15:37:44.528131+0000","last_unstale":"2024-09-16T15:37:45.523673+0000","last_undegraded":"2024-09-16T15:37:45.523673+0000","last_fullsized":"2024-09-16T15:37:45.523673+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:58:17.522035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:46.570682+0000","last_change":"2024-09-16T15:37:44.526873+0000","last_active":"2024-09-16T15:37:46.570682+0000","last_peered":"2024-09-16T15:37:46.570682+0000","last_clean":"2024-09-16T15:37:46.570682+0000","last_became_active":"2024-09-16T15:37:44.526627+0000","last_became_peered":"2024-09-16T15:37:44.526627+0000","last_unstale":"2024-09-16T15:37:46.570682+0000","last_undegraded":"2024-09-16T15:37:46.570682+0000","last_fullsized":"2024-09-16T15:37:46.570682+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:59:08.559983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.523655+0000","last_change":"2024-09-16T15:37:44.528216+0000","last_active":"2024-09-16T15:37:45.523655+0000","last_peered":"2024-09-16T15:37:45.523655+0000","last_clean":"2024-09-16T15:37:45.523655+0000","last_became_active":"2024-09-16T15:37:44.527905+0000","last_became_peered":"2024-09-16T15:37:44.527905+0000","last_unstale":"2024-09-16T15:37:45.523655+0000","last_undegraded":"2024-09-16T15:37:45.523655+0000","last_fullsized":"2024-09-16T15:37:45.523655+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:05:13.190051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.157271+0000","last_change":"2024-09-16T15:37:44.516828+0000","last_active":"2024-09-16T15:37:47.157271+0000","last_peered":"2024-09-16T15:37:47.157271+0000","last_clean":"2024-09-16T15:37:47.157271+0000","last_became_active":"2024-09-16T15:37:44.516568+0000","last_became_peered":"2024-09-16T15:37:44.516568+0000","last_unstale":"2024-09-16T15:37:47.157271+0000","last_undegraded":"2024-09-16T15:37:47.157271+0000","last_fullsized":"2024-09-16T15:37:47.157271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:15:29.298840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.525704+0000","last_change":"2024-09-16T15:37:44.512013+0000","last_active":"2024-09-16T15:37:45.525704+0000","last_peered":"2024-09-16T15:37:45.525704+0000","last_clean":"2024-09-16T15:37:45.525704+0000","last_became_active":"2024-09-16T15:37:44.511686+0000","last_became_peered":"2024-09-16T15:37:44.511686+0000","last_unstale":"2024-09-16T15:37:45.525704+0000","last_undegraded":"2024-09-16T15:37:45.525704+0000","last_fullsized":"2024-09-16T15:37:45.525704+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:50:11.538129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.850574+0000","last_change":"2024-09-16T15:37:44.517626+0000","last_active":"2024-09-16T15:37:45.850574+0000","last_peered":"2024-09-16T15:37:45.850574+0000","last_clean":"2024-09-16T15:37:45.850574+0000","last_became_active":"2024-09-16T15:37:44.516514+0000","last_became_peered":"2024-09-16T15:37:44.516514+0000","last_unstale":"2024-09-16T15:37:45.850574+0000","last_undegraded":"2024-09-16T15:37:45.850574+0000","last_fullsized":"2024-09-16T15:37:45.850574+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:54:51.338019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.295511+0000","last_change":"2024-09-16T15:37:44.524190+0000","last_active":"2024-09-16T15:37:47.295511+0000","last_peered":"2024-09-16T15:37:47.295511+0000","last_clean":"2024-09-16T15:37:47.295511+0000","last_became_active":"2024-09-16T15:37:44.523875+0000","last_became_peered":"2024-09-16T15:37:44.523875+0000","last_unstale":"2024-09-16T15:37:47.295511+0000","last_undegraded":"2024-09-16T15:37:47.295511+0000","last_fullsized":"2024-09-16T15:37:47.295511+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:20:20.809747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.522981+0000","last_change":"2024-09-16T15:37:44.524747+0000","last_active":"2024-09-16T15:37:45.522981+0000","last_peered":"2024-09-16T15:37:45.522981+0000","last_clean":"2024-09-16T15:37:45.522981+0000","last_became_active":"2024-09-16T15:37:44.524500+0000","last_became_peered":"2024-09-16T15:37:44.524500+0000","last_unstale":"2024-09-16T15:37:45.522981+0000","last_undegraded":"2024-09-16T15:37:45.522981+0000","last_fullsized":"2024-09-16T15:37:45.522981+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:04:08.210631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.295685+0000","last_change":"2024-09-16T15:37:44.517306+0000","last_active":"2024-09-16T15:37:47.295685+0000","last_peered":"2024-09-16T15:37:47.295685+0000","last_clean":"2024-09-16T15:37:47.295685+0000","last_became_active":"2024-09-16T15:37:44.516741+0000","last_became_peered":"2024-09-16T15:37:44.516741+0000","last_unstale":"2024-09-16T15:37:47.295685+0000","last_undegraded":"2024-09-16T15:37:47.295685+0000","last_fullsized":"2024-09-16T15:37:47.295685+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:40:00.773616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:46.943914+0000","last_change":"2024-09-16T15:37:44.519625+0000","last_active":"2024-09-16T15:37:46.943914+0000","last_peered":"2024-09-16T15:37:46.943914+0000","last_clean":"2024-09-16T15:37:46.943914+0000","last_became_active":"2024-09-16T15:37:44.519337+0000","last_became_peered":"2024-09-16T15:37:44.519337+0000","last_unstale":"2024-09-16T15:37:46.943914+0000","last_undegraded":"2024-09-16T15:37:46.943914+0000","last_fullsized":"2024-09-16T15:37:46.943914+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T21:56:02.373459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.526539+0000","last_change":"2024-09-16T15:37:44.519708+0000","last_active":"2024-09-16T15:37:45.526539+0000","last_peered":"2024-09-16T15:37:45.526539+0000","last_clean":"2024-09-16T15:37:45.526539+0000","last_became_active":"2024-09-16T15:37:44.519439+0000","last_became_peered":"2024-09-16T15:37:44.519439+0000","last_unstale":"2024-09-16T15:37:45.526539+0000","last_undegraded":"2024-09-16T15:37:45.526539+0000","last_fullsized":"2024-09-16T15:37:45.526539+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:56:40.956164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.526026+0000","last_change":"2024-09-16T15:37:44.518861+0000","last_active":"2024-09-16T15:37:45.526026+0000","last_peered":"2024-09-16T15:37:45.526026+0000","last_clean":"2024-09-16T15:37:45.526026+0000","last_became_active":"2024-09-16T15:37:44.518600+0000","last_became_peered":"2024-09-16T15:37:44.518600+0000","last_unstale":"2024-09-16T15:37:45.526026+0000","last_undegraded":"2024-09-16T15:37:45.526026+0000","last_fullsized":"2024-09-16T15:37:45.526026+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:52:07.454732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.295825+0000","last_change":"2024-09-16T15:37:44.524203+0000","last_active":"2024-09-16T15:37:47.295825+0000","last_peered":"2024-09-16T15:37:47.295825+0000","last_clean":"2024-09-16T15:37:47.295825+0000","last_became_active":"2024-09-16T15:37:44.523934+0000","last_became_peered":"2024-09-16T15:37:44.523934+0000","last_unstale":"2024-09-16T15:37:47.295825+0000","last_undegraded":"2024-09-16T15:37:47.295825+0000","last_fullsized":"2024-09-16T15:37:47.295825+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:51:41.621542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.523056+0000","last_change":"2024-09-16T15:37:44.524033+0000","last_active":"2024-09-16T15:37:45.523056+0000","last_peered":"2024-09-16T15:37:45.523056+0000","last_clean":"2024-09-16T15:37:45.523056+0000","last_became_active":"2024-09-16T15:37:44.523487+0000","last_became_peered":"2024-09-16T15:37:44.523487+0000","last_unstale":"2024-09-16T15:37:45.523056+0000","last_undegraded":"2024-09-16T15:37:45.523056+0000","last_fullsized":"2024-09-16T15:37:45.523056+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:27:29.507738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:46.570433+0000","last_change":"2024-09-16T15:37:44.522595+0000","last_active":"2024-09-16T15:37:46.570433+0000","last_peered":"2024-09-16T15:37:46.570433+0000","last_clean":"2024-09-16T15:37:46.570433+0000","last_became_active":"2024-09-16T15:37:44.522271+0000","last_became_peered":"2024-09-16T15:37:44.522271+0000","last_unstale":"2024-09-16T15:37:46.570433+0000","last_undegraded":"2024-09-16T15:37:46.570433+0000","last_fullsized":"2024-09-16T15:37:46.570433+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:55:59.838134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:46.943654+0000","last_change":"2024-09-16T15:37:44.515292+0000","last_active":"2024-09-16T15:37:46.943654+0000","last_peered":"2024-09-16T15:37:46.943654+0000","last_clean":"2024-09-16T15:37:46.943654+0000","last_became_active":"2024-09-16T15:37:44.513909+0000","last_became_peered":"2024-09-16T15:37:44.513909+0000","last_unstale":"2024-09-16T15:37:46.943654+0000","last_undegraded":"2024-09-16T15:37:46.943654+0000","last_fullsized":"2024-09-16T15:37:46.943654+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:54:51.338019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.850677+0000","last_change":"2024-09-16T15:37:44.517890+0000","last_active":"2024-09-16T15:37:45.850677+0000","last_peered":"2024-09-16T15:37:45.850677+0000","last_clean":"2024-09-16T15:37:45.850677+0000","last_became_active":"2024-09-16T15:37:44.517373+0000","last_became_peered":"2024-09-16T15:37:44.517373+0000","last_unstale":"2024-09-16T15:37:45.850677+0000","last_undegraded":"2024-09-16T15:37:45.850677+0000","last_fullsized":"2024-09-16T15:37:45.850677+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:16:32.486922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.295709+0000","last_change":"2024-09-16T15:37:43.510897+0000","last_active":"2024-09-16T15:37:47.295709+0000","last_peered":"2024-09-16T15:37:47.295709+0000","last_clean":"2024-09-16T15:37:47.295709+0000","last_became_active":"2024-09-16T15:37:43.510468+0000","last_became_peered":"2024-09-16T15:37:43.510468+0000","last_unstale":"2024-09-16T15:37:47.295709+0000","last_undegraded":"2024-09-16T15:37:47.295709+0000","last_fullsized":"2024-09-16T15:37:47.295709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:48:05.099286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.525914+0000","last_change":"2024-09-16T15:37:44.517344+0000","last_active":"2024-09-16T15:37:45.525914+0000","last_peered":"2024-09-16T15:37:45.525914+0000","last_clean":"2024-09-16T15:37:45.525914+0000","last_became_active":"2024-09-16T15:37:44.516446+0000","last_became_peered":"2024-09-16T15:37:44.516446+0000","last_unstale":"2024-09-16T15:37:45.525914+0000","last_undegraded":"2024-09-16T15:37:45.525914+0000","last_fullsized":"2024-09-16T15:37:45.525914+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:07:19.107946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.523251+0000","last_change":"2024-09-16T15:37:43.521672+0000","last_active":"2024-09-16T15:37:45.523251+0000","last_peered":"2024-09-16T15:37:45.523251+0000","last_clean":"2024-09-16T15:37:45.523251+0000","last_became_active":"2024-09-16T15:37:43.521418+0000","last_became_peered":"2024-09-16T15:37:43.521418+0000","last_unstale":"2024-09-16T15:37:45.523251+0000","last_undegraded":"2024-09-16T15:37:45.523251+0000","last_fullsized":"2024-09-16T15:37:45.523251+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:16:31.480042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.525828+0000","last_change":"2024-09-16T15:37:43.517465+0000","last_active":"2024-09-16T15:37:45.525828+0000","last_peered":"2024-09-16T15:37:45.525828+0000","last_clean":"2024-09-16T15:37:45.525828+0000","last_became_active":"2024-09-16T15:37:43.517177+0000","last_became_peered":"2024-09-16T15:37:43.517177+0000","last_unstale":"2024-09-16T15:37:45.525828+0000","last_undegraded":"2024-09-16T15:37:45.525828+0000","last_fullsized":"2024-09-16T15:37:45.525828+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T21:38:37.823375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.295924+0000","last_change":"2024-09-16T15:37:44.522976+0000","last_active":"2024-09-16T15:37:47.295924+0000","last_peered":"2024-09-16T15:37:47.295924+0000","last_clean":"2024-09-16T15:37:47.295924+0000","last_became_active":"2024-09-16T15:37:44.522718+0000","last_became_peered":"2024-09-16T15:37:44.522718+0000","last_unstale":"2024-09-16T15:37:47.295924+0000","last_undegraded":"2024-09-16T15:37:47.295924+0000","last_fullsized":"2024-09-16T15:37:47.295924+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:44:42.608817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.523077+0000","last_change":"2024-09-16T15:37:43.519319+0000","last_active":"2024-09-16T15:37:45.523077+0000","last_peered":"2024-09-16T15:37:45.523077+0000","last_clean":"2024-09-16T15:37:45.523077+0000","last_became_active":"2024-09-16T15:37:43.518711+0000","last_became_peered":"2024-09-16T15:37:43.518711+0000","last_unstale":"2024-09-16T15:37:45.523077+0000","last_undegraded":"2024-09-16T15:37:45.523077+0000","last_fullsized":"2024-09-16T15:37:45.523077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:39:24.887816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.525985+0000","last_change":"2024-09-16T15:37:44.517222+0000","last_active":"2024-09-16T15:37:45.525985+0000","last_peered":"2024-09-16T15:37:45.525985+0000","last_clean":"2024-09-16T15:37:45.525985+0000","last_became_active":"2024-09-16T15:37:44.516380+0000","last_became_peered":"2024-09-16T15:37:44.516380+0000","last_unstale":"2024-09-16T15:37:45.525985+0000","last_undegraded":"2024-09-16T15:37:45.525985+0000","last_fullsized":"2024-09-16T15:37:45.525985+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T21:34:31.159339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.850923+0000","last_change":"2024-09-16T15:37:43.514400+0000","last_active":"2024-09-16T15:37:45.850923+0000","last_peered":"2024-09-16T15:37:45.850923+0000","last_clean":"2024-09-16T15:37:45.850923+0000","last_became_active":"2024-09-16T15:37:43.514124+0000","last_became_peered":"2024-09-16T15:37:43.514124+0000","last_unstale":"2024-09-16T15:37:45.850923+0000","last_undegraded":"2024-09-16T15:37:45.850923+0000","last_fullsized":"2024-09-16T15:37:45.850923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:24:48.654268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:46.943985+0000","last_change":"2024-09-16T15:37:44.519856+0000","last_active":"2024-09-16T15:37:46.943985+0000","last_peered":"2024-09-16T15:37:46.943985+0000","last_clean":"2024-09-16T15:37:46.943985+0000","last_became_active":"2024-09-16T15:37:44.519014+0000","last_became_peered":"2024-09-16T15:37:44.519014+0000","last_unstale":"2024-09-16T15:37:46.943985+0000","last_undegraded":"2024-09-16T15:37:46.943985+0000","last_fullsized":"2024-09-16T15:37:46.943985+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:08:42.429536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.157585+0000","last_change":"2024-09-16T15:37:43.515976+0000","last_active":"2024-09-16T15:37:47.157585+0000","last_peered":"2024-09-16T15:37:47.157585+0000","last_clean":"2024-09-16T15:37:47.157585+0000","last_became_active":"2024-09-16T15:37:43.515426+0000","last_became_peered":"2024-09-16T15:37:43.515426+0000","last_unstale":"2024-09-16T15:37:47.157585+0000","last_undegraded":"2024-09-16T15:37:47.157585+0000","last_fullsized":"2024-09-16T15:37:47.157585+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:45:27.227739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.296046+0000","last_change":"2024-09-16T15:37:44.526711+0000","last_active":"2024-09-16T15:37:47.296046+0000","last_peered":"2024-09-16T15:37:47.296046+0000","last_clean":"2024-09-16T15:37:47.296046+0000","last_became_active":"2024-09-16T15:37:44.526458+0000","last_became_peered":"2024-09-16T15:37:44.526458+0000","last_unstale":"2024-09-16T15:37:47.296046+0000","last_undegraded":"2024-09-16T15:37:47.296046+0000","last_fullsized":"2024-09-16T15:37:47.296046+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:04:08.210631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:46.570594+0000","last_change":"2024-09-16T15:37:43.516257+0000","last_active":"2024-09-16T15:37:46.570594+0000","last_peered":"2024-09-16T15:37:46.570594+0000","last_clean":"2024-09-16T15:37:46.570594+0000","last_became_active":"2024-09-16T15:37:43.515944+0000","last_became_peered":"2024-09-16T15:37:43.515944+0000","last_unstale":"2024-09-16T15:37:46.570594+0000","last_undegraded":"2024-09-16T15:37:46.570594+0000","last_fullsized":"2024-09-16T15:37:46.570594+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:25:01.970817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.523356+0000","last_change":"2024-09-16T15:37:44.519159+0000","last_active":"2024-09-16T15:37:45.523356+0000","last_peered":"2024-09-16T15:37:45.523356+0000","last_clean":"2024-09-16T15:37:45.523356+0000","last_became_active":"2024-09-16T15:37:44.518920+0000","last_became_peered":"2024-09-16T15:37:44.518920+0000","last_unstale":"2024-09-16T15:37:45.523356+0000","last_undegraded":"2024-09-16T15:37:45.523356+0000","last_fullsized":"2024-09-16T15:37:45.523356+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:59:53.751921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:46.943754+0000","last_change":"2024-09-16T15:37:43.514513+0000","last_active":"2024-09-16T15:37:46.943754+0000","last_peered":"2024-09-16T15:37:46.943754+0000","last_clean":"2024-09-16T15:37:46.943754+0000","last_became_active":"2024-09-16T15:37:43.514196+0000","last_became_peered":"2024-09-16T15:37:43.514196+0000","last_unstale":"2024-09-16T15:37:46.943754+0000","last_undegraded":"2024-09-16T15:37:46.943754+0000","last_fullsized":"2024-09-16T15:37:46.943754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T21:42:39.448578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.157298+0000","last_change":"2024-09-16T15:37:44.518597+0000","last_active":"2024-09-16T15:37:47.157298+0000","last_peered":"2024-09-16T15:37:47.157298+0000","last_clean":"2024-09-16T15:37:47.157298+0000","last_became_active":"2024-09-16T15:37:44.518334+0000","last_became_peered":"2024-09-16T15:37:44.518334+0000","last_unstale":"2024-09-16T15:37:47.157298+0000","last_undegraded":"2024-09-16T15:37:47.157298+0000","last_fullsized":"2024-09-16T15:37:47.157298+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:18:49.770991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:46.570525+0000","last_change":"2024-09-16T15:37:43.521768+0000","last_active":"2024-09-16T15:37:46.570525+0000","last_peered":"2024-09-16T15:37:46.570525+0000","last_clean":"2024-09-16T15:37:46.570525+0000","last_became_active":"2024-09-16T15:37:43.521541+0000","last_became_peered":"2024-09-16T15:37:43.521541+0000","last_unstale":"2024-09-16T15:37:46.570525+0000","last_undegraded":"2024-09-16T15:37:46.570525+0000","last_fullsized":"2024-09-16T15:37:46.570525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:48:05.099286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.526567+0000","last_change":"2024-09-16T15:37:44.520303+0000","last_active":"2024-09-16T15:37:45.526567+0000","last_peered":"2024-09-16T15:37:45.526567+0000","last_clean":"2024-09-16T15:37:45.526567+0000","last_became_active":"2024-09-16T15:37:44.520036+0000","last_became_peered":"2024-09-16T15:37:44.520036+0000","last_unstale":"2024-09-16T15:37:45.526567+0000","last_undegraded":"2024-09-16T15:37:45.526567+0000","last_fullsized":"2024-09-16T15:37:45.526567+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:02:45.771447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.523462+0000","last_change":"2024-09-16T15:37:43.519519+0000","last_active":"2024-09-16T15:37:45.523462+0000","last_peered":"2024-09-16T15:37:45.523462+0000","last_clean":"2024-09-16T15:37:45.523462+0000","last_became_active":"2024-09-16T15:37:43.518682+0000","last_became_peered":"2024-09-16T15:37:43.518682+0000","last_unstale":"2024-09-16T15:37:45.523462+0000","last_undegraded":"2024-09-16T15:37:45.523462+0000","last_fullsized":"2024-09-16T15:37:45.523462+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:02:59.404804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.523248+0000","last_change":"2024-09-16T15:37:44.526644+0000","last_active":"2024-09-16T15:37:45.523248+0000","last_peered":"2024-09-16T15:37:45.523248+0000","last_clean":"2024-09-16T15:37:45.523248+0000","last_became_active":"2024-09-16T15:37:44.526382+0000","last_became_peered":"2024-09-16T15:37:44.526382+0000","last_unstale":"2024-09-16T15:37:45.523248+0000","last_undegraded":"2024-09-16T15:37:45.523248+0000","last_fullsized":"2024-09-16T15:37:45.523248+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:10:42.230703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.157113+0000","last_change":"2024-09-16T15:37:43.519576+0000","last_active":"2024-09-16T15:37:47.157113+0000","last_peered":"2024-09-16T15:37:47.157113+0000","last_clean":"2024-09-16T15:37:47.157113+0000","last_became_active":"2024-09-16T15:37:43.517609+0000","last_became_peered":"2024-09-16T15:37:43.517609+0000","last_unstale":"2024-09-16T15:37:47.157113+0000","last_undegraded":"2024-09-16T15:37:47.157113+0000","last_fullsized":"2024-09-16T15:37:47.157113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:54:50.331139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.850548+0000","last_change":"2024-09-16T15:37:44.525100+0000","last_active":"2024-09-16T15:37:45.850548+0000","last_peered":"2024-09-16T15:37:45.850548+0000","last_clean":"2024-09-16T15:37:45.850548+0000","last_became_active":"2024-09-16T15:37:44.524811+0000","last_became_peered":"2024-09-16T15:37:44.524811+0000","last_unstale":"2024-09-16T15:37:45.850548+0000","last_undegraded":"2024-09-16T15:37:45.850548+0000","last_fullsized":"2024-09-16T15:37:45.850548+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:51:54.814659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.525619+0000","last_change":"2024-09-16T15:37:43.514266+0000","last_active":"2024-09-16T15:37:45.525619+0000","last_peered":"2024-09-16T15:37:45.525619+0000","last_clean":"2024-09-16T15:37:45.525619+0000","last_became_active":"2024-09-16T15:37:43.513980+0000","last_became_peered":"2024-09-16T15:37:43.513980+0000","last_unstale":"2024-09-16T15:37:45.525619+0000","last_undegraded":"2024-09-16T15:37:45.525619+0000","last_fullsized":"2024-09-16T15:37:45.525619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:03:21.436525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.523013+0000","last_change":"2024-09-16T15:37:44.518537+0000","last_active":"2024-09-16T15:37:45.523013+0000","last_peered":"2024-09-16T15:37:45.523013+0000","last_clean":"2024-09-16T15:37:45.523013+0000","last_became_active":"2024-09-16T15:37:44.518264+0000","last_became_peered":"2024-09-16T15:37:44.518264+0000","last_unstale":"2024-09-16T15:37:45.523013+0000","last_undegraded":"2024-09-16T15:37:45.523013+0000","last_fullsized":"2024-09-16T15:37:45.523013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:03:18.944435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.157740+0000","last_change":"2024-09-16T15:37:43.518884+0000","last_active":"2024-09-16T15:37:47.157740+0000","last_peered":"2024-09-16T15:37:47.157740+0000","last_clean":"2024-09-16T15:37:47.157740+0000","last_became_active":"2024-09-16T15:37:43.517494+0000","last_became_peered":"2024-09-16T15:37:43.517494+0000","last_unstale":"2024-09-16T15:37:47.157740+0000","last_undegraded":"2024-09-16T15:37:47.157740+0000","last_fullsized":"2024-09-16T15:37:47.157740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:51:53.807779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:46.944015+0000","last_change":"2024-09-16T15:37:44.513568+0000","last_active":"2024-09-16T15:37:46.944015+0000","last_peered":"2024-09-16T15:37:46.944015+0000","last_clean":"2024-09-16T15:37:46.944015+0000","last_became_active":"2024-09-16T15:37:44.513308+0000","last_became_peered":"2024-09-16T15:37:44.513308+0000","last_unstale":"2024-09-16T15:37:46.944015+0000","last_undegraded":"2024-09-16T15:37:46.944015+0000","last_fullsized":"2024-09-16T15:37:46.944015+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:58:10.612197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.526185+0000","last_change":"2024-09-16T15:37:43.514250+0000","last_active":"2024-09-16T15:37:45.526185+0000","last_peered":"2024-09-16T15:37:45.526185+0000","last_clean":"2024-09-16T15:37:45.526185+0000","last_became_active":"2024-09-16T15:37:43.513954+0000","last_became_peered":"2024-09-16T15:37:43.513954+0000","last_unstale":"2024-09-16T15:37:45.526185+0000","last_undegraded":"2024-09-16T15:37:45.526185+0000","last_fullsized":"2024-09-16T15:37:45.526185+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:57:46.136628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.157747+0000","last_change":"2024-09-16T15:37:44.515874+0000","last_active":"2024-09-16T15:37:47.157747+0000","last_peered":"2024-09-16T15:37:47.157747+0000","last_clean":"2024-09-16T15:37:47.157747+0000","last_became_active":"2024-09-16T15:37:44.515608+0000","last_became_peered":"2024-09-16T15:37:44.515608+0000","last_unstale":"2024-09-16T15:37:47.157747+0000","last_undegraded":"2024-09-16T15:37:47.157747+0000","last_fullsized":"2024-09-16T15:37:47.157747+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:09:09.464477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.295751+0000","last_change":"2024-09-16T15:37:43.514330+0000","last_active":"2024-09-16T15:37:47.295751+0000","last_peered":"2024-09-16T15:37:47.295751+0000","last_clean":"2024-09-16T15:37:47.295751+0000","last_became_active":"2024-09-16T15:37:43.513900+0000","last_became_peered":"2024-09-16T15:37:43.513900+0000","last_unstale":"2024-09-16T15:37:47.295751+0000","last_undegraded":"2024-09-16T15:37:47.295751+0000","last_fullsized":"2024-09-16T15:37:47.295751+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:45:27.227739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.157504+0000","last_change":"2024-09-16T15:37:44.523100+0000","last_active":"2024-09-16T15:37:47.157504+0000","last_peered":"2024-09-16T15:37:47.157504+0000","last_clean":"2024-09-16T15:37:47.157504+0000","last_became_active":"2024-09-16T15:37:44.522300+0000","last_became_peered":"2024-09-16T15:37:44.522300+0000","last_unstale":"2024-09-16T15:37:47.157504+0000","last_undegraded":"2024-09-16T15:37:47.157504+0000","last_fullsized":"2024-09-16T15:37:47.157504+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:46:13.128386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.526586+0000","last_change":"2024-09-16T15:37:43.520873+0000","last_active":"2024-09-16T15:37:45.526586+0000","last_peered":"2024-09-16T15:37:45.526586+0000","last_clean":"2024-09-16T15:37:45.526586+0000","last_became_active":"2024-09-16T15:37:43.520561+0000","last_became_peered":"2024-09-16T15:37:43.520561+0000","last_unstale":"2024-09-16T15:37:45.526586+0000","last_undegraded":"2024-09-16T15:37:45.526586+0000","last_fullsized":"2024-09-16T15:37:45.526586+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:08:30.145981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.523562+0000","last_change":"2024-09-16T15:37:44.521919+0000","last_active":"2024-09-16T15:37:45.523562+0000","last_peered":"2024-09-16T15:37:45.523562+0000","last_clean":"2024-09-16T15:37:45.523562+0000","last_became_active":"2024-09-16T15:37:44.521672+0000","last_became_peered":"2024-09-16T15:37:44.521672+0000","last_unstale":"2024-09-16T15:37:45.523562+0000","last_undegraded":"2024-09-16T15:37:45.523562+0000","last_fullsized":"2024-09-16T15:37:45.523562+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:50:08.196173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":111,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.850562+0000","last_change":"2024-09-16T15:37:37.258601+0000","last_active":"2024-09-16T15:37:45.850562+0000","last_peered":"2024-09-16T15:37:45.850562+0000","last_clean":"2024-09-16T15:37:45.850562+0000","last_became_active":"2024-09-16T15:37:37.257584+0000","last_became_peered":"2024-09-16T15:37:37.257584+0000","last_unstale":"2024-09-16T15:37:45.850562+0000","last_undegraded":"2024-09-16T15:37:45.850562+0000","last_fullsized":"2024-09-16T15:37:45.850562+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:35.447043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:35.447043+0000","last_clean_scrub_stamp":"2024-09-16T15:37:35.447043+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:43:17.464894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.523369+0000","last_change":"2024-09-16T15:37:43.510139+0000","last_active":"2024-09-16T15:37:45.523369+0000","last_peered":"2024-09-16T15:37:45.523369+0000","last_clean":"2024-09-16T15:37:45.523369+0000","last_became_active":"2024-09-16T15:37:43.509820+0000","last_became_peered":"2024-09-16T15:37:43.509820+0000","last_unstale":"2024-09-16T15:37:45.523369+0000","last_undegraded":"2024-09-16T15:37:45.523369+0000","last_fullsized":"2024-09-16T15:37:45.523369+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:59:50.127383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.526700+0000","last_change":"2024-09-16T15:37:44.513059+0000","last_active":"2024-09-16T15:37:45.526700+0000","last_peered":"2024-09-16T15:37:45.526700+0000","last_clean":"2024-09-16T15:37:45.526700+0000","last_became_active":"2024-09-16T15:37:44.511241+0000","last_became_peered":"2024-09-16T15:37:44.511241+0000","last_unstale":"2024-09-16T15:37:45.526700+0000","last_undegraded":"2024-09-16T15:37:45.526700+0000","last_fullsized":"2024-09-16T15:37:45.526700+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:34:32.134838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.523129+0000","last_change":"2024-09-16T15:37:43.519442+0000","last_active":"2024-09-16T15:37:45.523129+0000","last_peered":"2024-09-16T15:37:45.523129+0000","last_clean":"2024-09-16T15:37:45.523129+0000","last_became_active":"2024-09-16T15:37:43.519204+0000","last_became_peered":"2024-09-16T15:37:43.519204+0000","last_unstale":"2024-09-16T15:37:45.523129+0000","last_undegraded":"2024-09-16T15:37:45.523129+0000","last_fullsized":"2024-09-16T15:37:45.523129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:29:35.721810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.525649+0000","last_change":"2024-09-16T15:37:44.511988+0000","last_active":"2024-09-16T15:37:45.525649+0000","last_peered":"2024-09-16T15:37:45.525649+0000","last_clean":"2024-09-16T15:37:45.525649+0000","last_became_active":"2024-09-16T15:37:44.511679+0000","last_became_peered":"2024-09-16T15:37:44.511679+0000","last_unstale":"2024-09-16T15:37:45.525649+0000","last_undegraded":"2024-09-16T15:37:45.525649+0000","last_fullsized":"2024-09-16T15:37:45.525649+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:39:56.702467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:46.570381+0000","last_change":"2024-09-16T15:37:43.515953+0000","last_active":"2024-09-16T15:37:46.570381+0000","last_peered":"2024-09-16T15:37:46.570381+0000","last_clean":"2024-09-16T15:37:46.570381+0000","last_became_active":"2024-09-16T15:37:43.515662+0000","last_became_peered":"2024-09-16T15:37:43.515662+0000","last_unstale":"2024-09-16T15:37:46.570381+0000","last_undegraded":"2024-09-16T15:37:46.570381+0000","last_fullsized":"2024-09-16T15:37:46.570381+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:45:09.277422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.295900+0000","last_change":"2024-09-16T15:37:44.525005+0000","last_active":"2024-09-16T15:37:47.295900+0000","last_peered":"2024-09-16T15:37:47.295900+0000","last_clean":"2024-09-16T15:37:47.295900+0000","last_became_active":"2024-09-16T15:37:44.524613+0000","last_became_peered":"2024-09-16T15:37:44.524613+0000","last_unstale":"2024-09-16T15:37:47.295900+0000","last_undegraded":"2024-09-16T15:37:47.295900+0000","last_fullsized":"2024-09-16T15:37:47.295900+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T23:33:15.012052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.523530+0000","last_change":"2024-09-16T15:37:43.513231+0000","last_active":"2024-09-16T15:37:45.523530+0000","last_peered":"2024-09-16T15:37:45.523530+0000","last_clean":"2024-09-16T15:37:45.523530+0000","last_became_active":"2024-09-16T15:37:43.512954+0000","last_became_peered":"2024-09-16T15:37:43.512954+0000","last_unstale":"2024-09-16T15:37:45.523530+0000","last_undegraded":"2024-09-16T15:37:45.523530+0000","last_fullsized":"2024-09-16T15:37:45.523530+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:50:40.599021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.157434+0000","last_change":"2024-09-16T15:37:44.513200+0000","last_active":"2024-09-16T15:37:47.157434+0000","last_peered":"2024-09-16T15:37:47.157434+0000","last_clean":"2024-09-16T15:37:47.157434+0000","last_became_active":"2024-09-16T15:37:44.512855+0000","last_became_peered":"2024-09-16T15:37:44.512855+0000","last_unstale":"2024-09-16T15:37:47.157434+0000","last_undegraded":"2024-09-16T15:37:47.157434+0000","last_fullsized":"2024-09-16T15:37:47.157434+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:05:31.763584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.295589+0000","last_change":"2024-09-16T15:37:43.510480+0000","last_active":"2024-09-16T15:37:47.295589+0000","last_peered":"2024-09-16T15:37:47.295589+0000","last_clean":"2024-09-16T15:37:47.295589+0000","last_became_active":"2024-09-16T15:37:43.510223+0000","last_became_peered":"2024-09-16T15:37:43.510223+0000","last_unstale":"2024-09-16T15:37:47.295589+0000","last_undegraded":"2024-09-16T15:37:47.295589+0000","last_fullsized":"2024-09-16T15:37:47.295589+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:37:32.374134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:46.943843+0000","last_change":"2024-09-16T15:37:44.516105+0000","last_active":"2024-09-16T15:37:46.943843+0000","last_peered":"2024-09-16T15:37:46.943843+0000","last_clean":"2024-09-16T15:37:46.943843+0000","last_became_active":"2024-09-16T15:37:44.515864+0000","last_became_peered":"2024-09-16T15:37:44.515864+0000","last_unstale":"2024-09-16T15:37:46.943843+0000","last_undegraded":"2024-09-16T15:37:46.943843+0000","last_fullsized":"2024-09-16T15:37:46.943843+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:59:08.559983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.523657+0000","last_change":"2024-09-16T15:37:43.515757+0000","last_active":"2024-09-16T15:37:45.523657+0000","last_peered":"2024-09-16T15:37:45.523657+0000","last_clean":"2024-09-16T15:37:45.523657+0000","last_became_active":"2024-09-16T15:37:43.515199+0000","last_became_peered":"2024-09-16T15:37:43.515199+0000","last_unstale":"2024-09-16T15:37:45.523657+0000","last_undegraded":"2024-09-16T15:37:45.523657+0000","last_fullsized":"2024-09-16T15:37:45.523657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:42:43.736513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.526573+0000","last_change":"2024-09-16T15:37:44.515147+0000","last_active":"2024-09-16T15:37:45.526573+0000","last_peered":"2024-09-16T15:37:45.526573+0000","last_clean":"2024-09-16T15:37:45.526573+0000","last_became_active":"2024-09-16T15:37:44.514518+0000","last_became_peered":"2024-09-16T15:37:44.514518+0000","last_unstale":"2024-09-16T15:37:45.526573+0000","last_undegraded":"2024-09-16T15:37:45.526573+0000","last_fullsized":"2024-09-16T15:37:45.526573+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:57:36.296851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.526280+0000","last_change":"2024-09-16T15:37:43.518081+0000","last_active":"2024-09-16T15:37:45.526280+0000","last_peered":"2024-09-16T15:37:45.526280+0000","last_clean":"2024-09-16T15:37:45.526280+0000","last_became_active":"2024-09-16T15:37:43.517744+0000","last_became_peered":"2024-09-16T15:37:43.517744+0000","last_unstale":"2024-09-16T15:37:45.526280+0000","last_undegraded":"2024-09-16T15:37:45.526280+0000","last_fullsized":"2024-09-16T15:37:45.526280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:55:58.831254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.526362+0000","last_change":"2024-09-16T15:37:44.518787+0000","last_active":"2024-09-16T15:37:45.526362+0000","last_peered":"2024-09-16T15:37:45.526362+0000","last_clean":"2024-09-16T15:37:45.526362+0000","last_became_active":"2024-09-16T15:37:44.517824+0000","last_became_peered":"2024-09-16T15:37:44.517824+0000","last_unstale":"2024-09-16T15:37:45.526362+0000","last_undegraded":"2024-09-16T15:37:45.526362+0000","last_fullsized":"2024-09-16T15:37:45.526362+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:19:57.119675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.523623+0000","last_change":"2024-09-16T15:37:43.519357+0000","last_active":"2024-09-16T15:37:45.523623+0000","last_peered":"2024-09-16T15:37:45.523623+0000","last_clean":"2024-09-16T15:37:45.523623+0000","last_became_active":"2024-09-16T15:37:43.519050+0000","last_became_peered":"2024-09-16T15:37:43.519050+0000","last_unstale":"2024-09-16T15:37:45.523623+0000","last_undegraded":"2024-09-16T15:37:45.523623+0000","last_fullsized":"2024-09-16T15:37:45.523623+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:10:16.347293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.526124+0000","last_change":"2024-09-16T15:37:44.523372+0000","last_active":"2024-09-16T15:37:45.526124+0000","last_peered":"2024-09-16T15:37:45.526124+0000","last_clean":"2024-09-16T15:37:45.526124+0000","last_became_active":"2024-09-16T15:37:44.522397+0000","last_became_peered":"2024-09-16T15:37:44.522397+0000","last_unstale":"2024-09-16T15:37:45.526124+0000","last_undegraded":"2024-09-16T15:37:45.526124+0000","last_fullsized":"2024-09-16T15:37:45.526124+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:32:42.496551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.156909+0000","last_change":"2024-09-16T15:37:43.517924+0000","last_active":"2024-09-16T15:37:47.156909+0000","last_peered":"2024-09-16T15:37:47.156909+0000","last_clean":"2024-09-16T15:37:47.156909+0000","last_became_active":"2024-09-16T15:37:43.516036+0000","last_became_peered":"2024-09-16T15:37:43.516036+0000","last_unstale":"2024-09-16T15:37:47.156909+0000","last_undegraded":"2024-09-16T15:37:47.156909+0000","last_fullsized":"2024-09-16T15:37:47.156909+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:48:05.099286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.523076+0000","last_change":"2024-09-16T15:37:44.527377+0000","last_active":"2024-09-16T15:37:45.523076+0000","last_peered":"2024-09-16T15:37:45.523076+0000","last_clean":"2024-09-16T15:37:45.523076+0000","last_became_active":"2024-09-16T15:37:44.527133+0000","last_became_peered":"2024-09-16T15:37:44.527133+0000","last_unstale":"2024-09-16T15:37:45.523076+0000","last_undegraded":"2024-09-16T15:37:45.523076+0000","last_fullsized":"2024-09-16T15:37:45.523076+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T23:21:37.513059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.525961+0000","last_change":"2024-09-16T15:37:43.518084+0000","last_active":"2024-09-16T15:37:45.525961+0000","last_peered":"2024-09-16T15:37:45.525961+0000","last_clean":"2024-09-16T15:37:45.525961+0000","last_became_active":"2024-09-16T15:37:43.517773+0000","last_became_peered":"2024-09-16T15:37:43.517773+0000","last_unstale":"2024-09-16T15:37:45.525961+0000","last_undegraded":"2024-09-16T15:37:45.525961+0000","last_fullsized":"2024-09-16T15:37:45.525961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:42:35.749344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.525550+0000","last_change":"2024-09-16T15:37:44.519969+0000","last_active":"2024-09-16T15:37:45.525550+0000","last_peered":"2024-09-16T15:37:45.525550+0000","last_clean":"2024-09-16T15:37:45.525550+0000","last_became_active":"2024-09-16T15:37:44.519683+0000","last_became_peered":"2024-09-16T15:37:44.519683+0000","last_unstale":"2024-09-16T15:37:45.525550+0000","last_undegraded":"2024-09-16T15:37:45.525550+0000","last_fullsized":"2024-09-16T15:37:45.525550+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:36:49.054590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.526487+0000","last_change":"2024-09-16T15:37:43.511936+0000","last_active":"2024-09-16T15:37:45.526487+0000","last_peered":"2024-09-16T15:37:45.526487+0000","last_clean":"2024-09-16T15:37:45.526487+0000","last_became_active":"2024-09-16T15:37:43.511709+0000","last_became_peered":"2024-09-16T15:37:43.511709+0000","last_unstale":"2024-09-16T15:37:45.526487+0000","last_undegraded":"2024-09-16T15:37:45.526487+0000","last_fullsized":"2024-09-16T15:37:45.526487+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:22:48.178297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:46.570568+0000","last_change":"2024-09-16T15:37:44.522219+0000","last_active":"2024-09-16T15:37:46.570568+0000","last_peered":"2024-09-16T15:37:46.570568+0000","last_clean":"2024-09-16T15:37:46.570568+0000","last_became_active":"2024-09-16T15:37:44.521913+0000","last_became_peered":"2024-09-16T15:37:44.521913+0000","last_unstale":"2024-09-16T15:37:46.570568+0000","last_undegraded":"2024-09-16T15:37:46.570568+0000","last_fullsized":"2024-09-16T15:37:46.570568+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:13:55.812269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.523265+0000","last_change":"2024-09-16T15:37:43.513406+0000","last_active":"2024-09-16T15:37:45.523265+0000","last_peered":"2024-09-16T15:37:45.523265+0000","last_clean":"2024-09-16T15:37:45.523265+0000","last_became_active":"2024-09-16T15:37:43.512994+0000","last_became_peered":"2024-09-16T15:37:43.512994+0000","last_unstale":"2024-09-16T15:37:45.523265+0000","last_undegraded":"2024-09-16T15:37:45.523265+0000","last_fullsized":"2024-09-16T15:37:45.523265+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:54:50.331139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.523228+0000","last_change":"2024-09-16T15:37:44.521192+0000","last_active":"2024-09-16T15:37:45.523228+0000","last_peered":"2024-09-16T15:37:45.523228+0000","last_clean":"2024-09-16T15:37:45.523228+0000","last_became_active":"2024-09-16T15:37:44.520988+0000","last_became_peered":"2024-09-16T15:37:44.520988+0000","last_unstale":"2024-09-16T15:37:45.523228+0000","last_undegraded":"2024-09-16T15:37:45.523228+0000","last_fullsized":"2024-09-16T15:37:45.523228+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:02:40.289746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.523437+0000","last_change":"2024-09-16T15:37:44.528502+0000","last_active":"2024-09-16T15:37:45.523437+0000","last_peered":"2024-09-16T15:37:45.523437+0000","last_clean":"2024-09-16T15:37:45.523437+0000","last_became_active":"2024-09-16T15:37:44.528265+0000","last_became_peered":"2024-09-16T15:37:44.528265+0000","last_unstale":"2024-09-16T15:37:45.523437+0000","last_undegraded":"2024-09-16T15:37:45.523437+0000","last_fullsized":"2024-09-16T15:37:45.523437+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:19:22.804930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.157531+0000","last_change":"2024-09-16T15:37:43.512302+0000","last_active":"2024-09-16T15:37:47.157531+0000","last_peered":"2024-09-16T15:37:47.157531+0000","last_clean":"2024-09-16T15:37:47.157531+0000","last_became_active":"2024-09-16T15:37:43.511884+0000","last_became_peered":"2024-09-16T15:37:43.511884+0000","last_unstale":"2024-09-16T15:37:47.157531+0000","last_undegraded":"2024-09-16T15:37:47.157531+0000","last_fullsized":"2024-09-16T15:37:47.157531+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:16:31.480042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.850781+0000","last_change":"2024-09-16T15:37:44.520291+0000","last_active":"2024-09-16T15:37:45.850781+0000","last_peered":"2024-09-16T15:37:45.850781+0000","last_clean":"2024-09-16T15:37:45.850781+0000","last_became_active":"2024-09-16T15:37:44.519962+0000","last_became_peered":"2024-09-16T15:37:44.519962+0000","last_unstale":"2024-09-16T15:37:45.850781+0000","last_undegraded":"2024-09-16T15:37:45.850781+0000","last_fullsized":"2024-09-16T15:37:45.850781+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:59:51.134263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.157381+0000","last_change":"2024-09-16T15:37:43.518058+0000","last_active":"2024-09-16T15:37:47.157381+0000","last_peered":"2024-09-16T15:37:47.157381+0000","last_clean":"2024-09-16T15:37:47.157381+0000","last_became_active":"2024-09-16T15:37:43.517743+0000","last_became_peered":"2024-09-16T15:37:43.517743+0000","last_unstale":"2024-09-16T15:37:47.157381+0000","last_undegraded":"2024-09-16T15:37:47.157381+0000","last_fullsized":"2024-09-16T15:37:47.157381+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:49:24.257772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.295758+0000","last_change":"2024-09-16T15:37:44.517004+0000","last_active":"2024-09-16T15:37:47.295758+0000","last_peered":"2024-09-16T15:37:47.295758+0000","last_clean":"2024-09-16T15:37:47.295758+0000","last_became_active":"2024-09-16T15:37:44.516403+0000","last_became_peered":"2024-09-16T15:37:44.516403+0000","last_unstale":"2024-09-16T15:37:47.295758+0000","last_undegraded":"2024-09-16T15:37:47.295758+0000","last_fullsized":"2024-09-16T15:37:47.295758+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:52:48.483425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.296053+0000","last_change":"2024-09-16T15:37:43.513164+0000","last_active":"2024-09-16T15:37:47.296053+0000","last_peered":"2024-09-16T15:37:47.296053+0000","last_clean":"2024-09-16T15:37:47.296053+0000","last_became_active":"2024-09-16T15:37:43.512890+0000","last_became_peered":"2024-09-16T15:37:43.512890+0000","last_unstale":"2024-09-16T15:37:47.296053+0000","last_undegraded":"2024-09-16T15:37:47.296053+0000","last_fullsized":"2024-09-16T15:37:47.296053+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:49:24.257772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.295838+0000","last_change":"2024-09-16T15:37:44.521379+0000","last_active":"2024-09-16T15:37:47.295838+0000","last_peered":"2024-09-16T15:37:47.295838+0000","last_clean":"2024-09-16T15:37:47.295838+0000","last_became_active":"2024-09-16T15:37:44.520724+0000","last_became_peered":"2024-09-16T15:37:44.520724+0000","last_unstale":"2024-09-16T15:37:47.295838+0000","last_undegraded":"2024-09-16T15:37:47.295838+0000","last_fullsized":"2024-09-16T15:37:47.295838+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:40:14.841427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.526555+0000","last_change":"2024-09-16T15:37:43.515725+0000","last_active":"2024-09-16T15:37:45.526555+0000","last_peered":"2024-09-16T15:37:45.526555+0000","last_clean":"2024-09-16T15:37:45.526555+0000","last_became_active":"2024-09-16T15:37:43.515461+0000","last_became_peered":"2024-09-16T15:37:43.515461+0000","last_unstale":"2024-09-16T15:37:45.526555+0000","last_undegraded":"2024-09-16T15:37:45.526555+0000","last_fullsized":"2024-09-16T15:37:45.526555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T21:23:32.133055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":241664,"data_stored":81359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509446,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":835584,"data_stored":671695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":253952,"data_stored":83519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":237568,"data_stored":81817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":245760,"data_stored":82847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27840,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344000,"statfs":{"total":96636764160,"available":96608256000,"internally_reserved":0,"allocated":831488,"data_stored":671673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":241664,"data_stored":81291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":233472,"data_stored":81235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T15:37:53.201 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-16T15:37:53.201 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-16T15:37:53.201 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-16T15:37:53.340 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.338+0000 7fa1d0d24640 1 -- 172.21.15.98:0/1269770623 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa1cc071260 msgr2=0x7fa1cc0cea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:53.340 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.338+0000 7fa1d0d24640 1 --2- 172.21.15.98:0/1269770623 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa1cc071260 0x7fa1cc0cea60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa1b4005fd0 tx=0x7fa1b402a540 comp rx=0 tx=0).stop 2024-09-16T15:37:53.340 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.338+0000 7fa1d0d24640 1 -- 172.21.15.98:0/1269770623 shutdown_connections 2024-09-16T15:37:53.340 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.338+0000 7fa1d0d24640 1 --2- 172.21.15.98:0/1269770623 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa1cc071260 0x7fa1cc0cea60 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:53.340 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.338+0000 7fa1d0d24640 1 --2- 172.21.15.98:0/1269770623 >> v2:172.21.15.135:3300/0 conn(0x7fa1cc0b73c0 0x7fa1cc071bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:53.340 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.338+0000 7fa1d0d24640 1 -- 172.21.15.98:0/1269770623 >> 172.21.15.98:0/1269770623 conn(0x7fa1cc06d230 msgr2=0x7fa1cc0688b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:53.340 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.338+0000 7fa1d0d24640 1 -- 172.21.15.98:0/1269770623 shutdown_connections 2024-09-16T15:37:53.341 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.338+0000 7fa1d0d24640 1 -- 172.21.15.98:0/1269770623 wait complete. 2024-09-16T15:37:53.341 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.339+0000 7fa1d0d24640 1 Processor -- start 2024-09-16T15:37:53.341 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.339+0000 7fa1d0d24640 1 -- start start 2024-09-16T15:37:53.343 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.340+0000 7fa1d0d24640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1cc071260 0x7fa1cc0ca5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:53.343 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.340+0000 7fa1d0d24640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1cc0b73c0 0x7fa1cc150780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:53.343 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.340+0000 7fa1d0d24640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa1cc0cefa0 0x7fa1cc158ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:53.343 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.340+0000 7fa1d0d24640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa1cc0b7920 con 0x7fa1cc071260 2024-09-16T15:37:53.343 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.340+0000 7fa1d0d24640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa1cc0b77a0 con 0x7fa1cc0b73c0 2024-09-16T15:37:53.343 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.340+0000 7fa1d0d24640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fa1cc0d2350 con 0x7fa1cc0cefa0 2024-09-16T15:37:53.343 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.340+0000 7fa1ca59c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1cc071260 0x7fa1cc0ca5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:53.343 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.340+0000 7fa1ca59c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1cc071260 0x7fa1cc0ca5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59546/0 (socket says 172.21.15.98:59546) 2024-09-16T15:37:53.343 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.340+0000 7fa1ca59c640 1 -- 172.21.15.98:0/273221256 learned_addr learned my addr 172.21.15.98:0/273221256 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:37:53.343 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.340+0000 7fa1c1d9b640 1 --2- 172.21.15.98:0/273221256 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1cc0b73c0 0x7fa1cc150780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:53.343 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.340+0000 7fa1cad9d640 1 --2- 172.21.15.98:0/273221256 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa1cc0cefa0 0x7fa1cc158ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:53.343 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.340+0000 7fa1ca59c640 1 -- 172.21.15.98:0/273221256 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa1cc0cefa0 msgr2=0x7fa1cc158ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:53.343 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.340+0000 7fa1ca59c640 1 --2- 172.21.15.98:0/273221256 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa1cc0cefa0 0x7fa1cc158ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:53.344 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.340+0000 7fa1ca59c640 1 -- 172.21.15.98:0/273221256 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1cc0b73c0 msgr2=0x7fa1cc150780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:53.344 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.340+0000 7fa1ca59c640 1 --2- 172.21.15.98:0/273221256 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1cc0b73c0 0x7fa1cc150780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:53.344 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.340+0000 7fa1ca59c640 1 -- 172.21.15.98:0/273221256 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1cc150cc0 con 0x7fa1cc071260 2024-09-16T15:37:53.344 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.340+0000 7fa1c1d9b640 1 --2- 172.21.15.98:0/273221256 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1cc0b73c0 0x7fa1cc150780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T15:37:53.344 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.340+0000 7fa1ca59c640 1 --2- 172.21.15.98:0/273221256 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1cc071260 0x7fa1cc0ca5d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc00ea90 tx=0x7fa1bc00ef50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:53.344 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.341+0000 7fa1c37fe640 1 -- 172.21.15.98:0/273221256 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1bc00ce40 con 0x7fa1cc071260 2024-09-16T15:37:53.344 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.341+0000 7fa1d0d24640 1 -- 172.21.15.98:0/273221256 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1cc06fc70 con 0x7fa1cc071260 2024-09-16T15:37:53.344 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.341+0000 7fa1c37fe640 1 -- 172.21.15.98:0/273221256 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa1bc004020 con 0x7fa1cc071260 2024-09-16T15:37:53.344 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.341+0000 7fa1c37fe640 1 -- 172.21.15.98:0/273221256 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1bc004470 con 0x7fa1cc071260 2024-09-16T15:37:53.344 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.341+0000 7fa1d0d24640 1 -- 172.21.15.98:0/273221256 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1cc0cba90 con 0x7fa1cc071260 2024-09-16T15:37:53.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.342+0000 7fa1d0d24640 1 -- 172.21.15.98:0/273221256 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1cc0d28e0 con 0x7fa1cc071260 2024-09-16T15:37:53.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.342+0000 7fa1c37fe640 1 -- 172.21.15.98:0/273221256 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7fa1bc0035f0 con 0x7fa1cc071260 2024-09-16T15:37:53.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.343+0000 7fa1c37fe640 1 --2- 172.21.15.98:0/273221256 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fa1ac078850 0x7fa1ac07ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:53.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.343+0000 7fa1c37fe640 1 -- 172.21.15.98:0/273221256 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fa1bc09b3a0 con 0x7fa1cc071260 2024-09-16T15:37:53.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.343+0000 7fa1c1d9b640 1 --2- 172.21.15.98:0/273221256 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fa1ac078850 0x7fa1ac07ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:53.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.343+0000 7fa1c1d9b640 1 --2- 172.21.15.98:0/273221256 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fa1ac078850 0x7fa1ac07ad10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa1b4033000 tx=0x7fa1b4004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:53.349 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.347+0000 7fa1c37fe640 1 -- 172.21.15.98:0/273221256 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7fa1bc063990 con 0x7fa1cc071260 2024-09-16T15:37:53.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.521+0000 7fa1d0d24640 1 -- 172.21.15.98:0/273221256 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7fa1cc06fe90 con 0x7fa1cc071260 2024-09-16T15:37:53.524 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.522+0000 7fa1c37fe640 1 -- 172.21.15.98:0/273221256 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v27) ==== 86+0+160 (secure 0 0 0) 0x7fa1bc063290 con 0x7fa1cc071260 2024-09-16T15:37:53.524 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:37:53.526 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.524+0000 7fa1d0d24640 1 -- 172.21.15.98:0/273221256 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fa1ac078850 msgr2=0x7fa1ac07ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:53.526 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.524+0000 7fa1d0d24640 1 --2- 172.21.15.98:0/273221256 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fa1ac078850 0x7fa1ac07ad10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa1b4033000 tx=0x7fa1b4004730 comp rx=0 tx=0).stop 2024-09-16T15:37:53.526 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.524+0000 7fa1d0d24640 1 -- 172.21.15.98:0/273221256 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1cc071260 msgr2=0x7fa1cc0ca5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:53.527 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.524+0000 7fa1d0d24640 1 --2- 172.21.15.98:0/273221256 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1cc071260 0x7fa1cc0ca5d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc00ea90 tx=0x7fa1bc00ef50 comp rx=0 tx=0).stop 2024-09-16T15:37:53.527 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.524+0000 7fa1d0d24640 1 -- 172.21.15.98:0/273221256 shutdown_connections 2024-09-16T15:37:53.527 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.524+0000 7fa1d0d24640 1 --2- 172.21.15.98:0/273221256 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa1cc0cefa0 0x7fa1cc158ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:53.527 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.524+0000 7fa1d0d24640 1 --2- 172.21.15.98:0/273221256 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fa1ac078850 0x7fa1ac07ad10 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:53.527 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.524+0000 7fa1d0d24640 1 --2- 172.21.15.98:0/273221256 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1cc0b73c0 0x7fa1cc150780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:53.527 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.524+0000 7fa1d0d24640 1 --2- 172.21.15.98:0/273221256 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa1cc071260 0x7fa1cc0ca5d0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:53.527 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.524+0000 7fa1d0d24640 1 -- 172.21.15.98:0/273221256 >> 172.21.15.98:0/273221256 conn(0x7fa1cc06d230 msgr2=0x7fa1cc0d1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:53.527 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.524+0000 7fa1d0d24640 1 -- 172.21.15.98:0/273221256 shutdown_connections 2024-09-16T15:37:53.527 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.524+0000 7fa1d0d24640 1 -- 172.21.15.98:0/273221256 wait complete. 2024-09-16T15:37:53.536 INFO:teuthology.orchestra.run.smithi098.stdout:[{"version":27,"timestamp":"2024-09-16T15:37:32.842874+0000","name":"","changes":[{"name":"osd.2/osd_mclock_max_capacity_iops_ssd","new_value":"6047.607760"}]}] 2024-09-16T15:37:53.537 INFO:tasks.ceph_manager:config epoch is 27 2024-09-16T15:37:53.537 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-16T15:37:53.537 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-16T15:37:53.537 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-16T15:37:53.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.636+0000 7f66962ef640 1 -- 172.21.15.98:0/513943046 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6678004800 msgr2=0x7f6678004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:53.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.636+0000 7f66962ef640 1 --2- 172.21.15.98:0/513943046 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6678004800 0x7f6678004c80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6684001690 tx=0x7f6678005830 comp rx=0 tx=0).stop 2024-09-16T15:37:53.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.636+0000 7f66962ef640 1 -- 172.21.15.98:0/513943046 shutdown_connections 2024-09-16T15:37:53.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.636+0000 7f66962ef640 1 --2- 172.21.15.98:0/513943046 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6678004800 0x7f6678004c80 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:53.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.636+0000 7f66962ef640 1 -- 172.21.15.98:0/513943046 >> 172.21.15.98:0/513943046 conn(0x7f66900b2230 msgr2=0x7f66900b2610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:53.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.636+0000 7f66962ef640 1 -- 172.21.15.98:0/513943046 shutdown_connections 2024-09-16T15:37:53.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.636+0000 7f66962ef640 1 -- 172.21.15.98:0/513943046 wait complete. 2024-09-16T15:37:53.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.637+0000 7f66962ef640 1 Processor -- start 2024-09-16T15:37:53.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.637+0000 7f66962ef640 1 -- start start 2024-09-16T15:37:53.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.638+0000 7f66962ef640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6678004800 0x7f66901f53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:53.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.638+0000 7f66962ef640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f66900cf6d0 0x7f66900ced90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:53.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.638+0000 7f66962ef640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66900cdd40 0x7f66900ce1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:53.642 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.638+0000 7f66962ef640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f66900736b0 con 0x7f6678004800 2024-09-16T15:37:53.642 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.638+0000 7f66962ef640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6690073530 con 0x7f66900cdd40 2024-09-16T15:37:53.642 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.638+0000 7f66962ef640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f6690073830 con 0x7f66900cf6d0 2024-09-16T15:37:53.642 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.638+0000 7f668ffff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6678004800 0x7f66901f53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:53.642 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.638+0000 7f668ffff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6678004800 0x7f66901f53b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59562/0 (socket says 172.21.15.98:59562) 2024-09-16T15:37:53.642 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.638+0000 7f668ffff640 1 -- 172.21.15.98:0/706725813 learned_addr learned my addr 172.21.15.98:0/706725813 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:37:53.642 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.638+0000 7f668ffff640 1 -- 172.21.15.98:0/706725813 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f66900cf6d0 msgr2=0x7f66900ced90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:53.642 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.638+0000 7f668f7fe640 1 --2- 172.21.15.98:0/706725813 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f66900cf6d0 0x7f66900ced90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:53.642 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.638+0000 7f669488c640 1 --2- 172.21.15.98:0/706725813 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66900cdd40 0x7f66900ce1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:53.642 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.638+0000 7f668ffff640 1 --2- 172.21.15.98:0/706725813 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f66900cf6d0 0x7f66900ced90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:53.642 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.638+0000 7f668ffff640 1 -- 172.21.15.98:0/706725813 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66900cdd40 msgr2=0x7f66900ce1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:53.642 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.638+0000 7f668ffff640 1 --2- 172.21.15.98:0/706725813 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66900cdd40 0x7f66900ce1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:53.642 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.638+0000 7f668ffff640 1 -- 172.21.15.98:0/706725813 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66900cfe40 con 0x7f6678004800 2024-09-16T15:37:53.643 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.639+0000 7f668ffff640 1 --2- 172.21.15.98:0/706725813 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6678004800 0x7f66901f53b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6680000fb0 tx=0x7f668000ea20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:53.643 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.639+0000 7f668cff9640 1 -- 172.21.15.98:0/706725813 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6680015070 con 0x7f6678004800 2024-09-16T15:37:53.643 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.639+0000 7f668cff9640 1 -- 172.21.15.98:0/706725813 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6680010980 con 0x7f6678004800 2024-09-16T15:37:53.643 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.639+0000 7f66962ef640 1 -- 172.21.15.98:0/706725813 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66900d0120 con 0x7f6678004800 2024-09-16T15:37:53.643 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.639+0000 7f668cff9640 1 -- 172.21.15.98:0/706725813 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6680010db0 con 0x7f6678004800 2024-09-16T15:37:53.643 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.639+0000 7f66962ef640 1 -- 172.21.15.98:0/706725813 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6690154320 con 0x7f6678004800 2024-09-16T15:37:53.643 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.640+0000 7f66962ef640 1 -- 172.21.15.98:0/706725813 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66900b3de0 con 0x7f6678004800 2024-09-16T15:37:53.644 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.640+0000 7f668cff9640 1 -- 172.21.15.98:0/706725813 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7f6680018070 con 0x7f6678004800 2024-09-16T15:37:53.644 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.641+0000 7f668cff9640 1 --2- 172.21.15.98:0/706725813 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f667c078850 0x7f667c07ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:53.644 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.641+0000 7f668cff9640 1 -- 172.21.15.98:0/706725813 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f668009ad70 con 0x7f6678004800 2024-09-16T15:37:53.644 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.641+0000 7f668f7fe640 1 --2- 172.21.15.98:0/706725813 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f667c078850 0x7f667c07ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:53.644 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.642+0000 7f668f7fe640 1 --2- 172.21.15.98:0/706725813 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f667c078850 0x7f667c07ad10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6684032000 tx=0x7f6684001190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:53.647 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.645+0000 7f668cff9640 1 -- 172.21.15.98:0/706725813 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7f6680063360 con 0x7f6678004800 2024-09-16T15:37:53.874 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.872+0000 7f66962ef640 1 -- 172.21.15.98:0/706725813 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f66900008d0 con 0x7f6678004800 2024-09-16T15:37:53.876 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.875+0000 7f668cff9640 1 -- 172.21.15.98:0/706725813 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+194345 (secure 0 0 0) 0x7f6680062c60 con 0x7f6678004800 2024-09-16T15:37:53.879 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:37:53.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.877+0000 7f66962ef640 1 -- 172.21.15.98:0/706725813 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f667c078850 msgr2=0x7f667c07ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:53.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.877+0000 7f66962ef640 1 --2- 172.21.15.98:0/706725813 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f667c078850 0x7f667c07ad10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6684032000 tx=0x7f6684001190 comp rx=0 tx=0).stop 2024-09-16T15:37:53.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.877+0000 7f66962ef640 1 -- 172.21.15.98:0/706725813 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6678004800 msgr2=0x7f66901f53b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:53.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.877+0000 7f66962ef640 1 --2- 172.21.15.98:0/706725813 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6678004800 0x7f66901f53b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6680000fb0 tx=0x7f668000ea20 comp rx=0 tx=0).stop 2024-09-16T15:37:53.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.877+0000 7f66962ef640 1 -- 172.21.15.98:0/706725813 shutdown_connections 2024-09-16T15:37:53.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.877+0000 7f66962ef640 1 --2- 172.21.15.98:0/706725813 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f667c078850 0x7f667c07ad10 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:53.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.877+0000 7f66962ef640 1 --2- 172.21.15.98:0/706725813 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f66900cdd40 0x7f66900ce1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:53.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.877+0000 7f66962ef640 1 --2- 172.21.15.98:0/706725813 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f66900cf6d0 0x7f66900ced90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:53.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.877+0000 7f66962ef640 1 --2- 172.21.15.98:0/706725813 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6678004800 0x7f66901f53b0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:53.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.877+0000 7f66962ef640 1 -- 172.21.15.98:0/706725813 >> 172.21.15.98:0/706725813 conn(0x7f66900b2230 msgr2=0x7f669006f4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:53.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.878+0000 7f66962ef640 1 -- 172.21.15.98:0/706725813 shutdown_connections 2024-09-16T15:37:53.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.878+0000 7f66962ef640 1 -- 172.21.15.98:0/706725813 wait complete. 2024-09-16T15:37:53.890 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":5,"flags":0,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":699234772},{"type":"v1","addr":"172.21.15.135:6801","nonce":699234772}]},"active_addr":"172.21.15.135:6801/699234772","active_change":"2024-09-16T15:37:24.701224+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4106,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.135:0","nonce":2172983147}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.135:0","nonce":1362861509}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.135:0","nonce":2719932678}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.135:0","nonce":3241303294}]}]} 2024-09-16T15:37:53.894 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-16T15:37:53.894 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-16T15:37:53.894 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T15:37:53.995 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.993+0000 7fe90e756640 1 -- 172.21.15.98:0/3173009130 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe8f0003a30 msgr2=0x7fe8f0003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:53.995 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.993+0000 7fe90e756640 1 --2- 172.21.15.98:0/3173009130 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe8f0003a30 0x7fe8f0003e50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe8f80016c0 tx=0x7fe8f0005830 comp rx=0 tx=0).stop 2024-09-16T15:37:53.995 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.993+0000 7fe90ccf3640 1 -- 172.21.15.98:0/3173009130 reap_dead start 2024-09-16T15:37:53.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.993+0000 7fe90e756640 1 -- 172.21.15.98:0/3173009130 shutdown_connections 2024-09-16T15:37:53.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.993+0000 7fe90e756640 1 -- 172.21.15.98:0/3173009130 >> 172.21.15.98:0/3173009130 conn(0x7fe9080d3fe0 msgr2=0x7fe9080d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:53.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.993+0000 7fe90e756640 1 -- 172.21.15.98:0/3173009130 shutdown_connections 2024-09-16T15:37:53.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.993+0000 7fe90e756640 1 -- 172.21.15.98:0/3173009130 wait complete. 2024-09-16T15:37:53.998 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.994+0000 7fe90e756640 1 Processor -- start 2024-09-16T15:37:53.998 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.994+0000 7fe90e756640 1 -- start start 2024-09-16T15:37:53.998 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.995+0000 7fe90e756640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe8f0003a30 0x7fe9080ca230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:53.998 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.995+0000 7fe90e756640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe908155a50 0x7fe908155eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:53.998 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.995+0000 7fe90e756640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe90815abb0 0x7fe90815b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:53.998 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.995+0000 7fe90e756640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe908166e70 con 0x7fe8f0003a30 2024-09-16T15:37:53.998 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.995+0000 7fe90e756640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe908166cf0 con 0x7fe90815abb0 2024-09-16T15:37:53.998 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.995+0000 7fe90e756640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fe908166ff0 con 0x7fe908155a50 2024-09-16T15:37:53.998 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.995+0000 7fe907fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe8f0003a30 0x7fe9080ca230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:53.999 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.995+0000 7fe907fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe8f0003a30 0x7fe9080ca230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59576/0 (socket says 172.21.15.98:59576) 2024-09-16T15:37:53.999 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.995+0000 7fe907fff640 1 -- 172.21.15.98:0/1957961602 learned_addr learned my addr 172.21.15.98:0/1957961602 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:37:53.999 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.995+0000 7fe9077fe640 1 --2- 172.21.15.98:0/1957961602 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe908155a50 0x7fe908155eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:53.999 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.995+0000 7fe90ccf3640 1 --2- 172.21.15.98:0/1957961602 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe90815abb0 0x7fe90815b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:53.999 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.995+0000 7fe907fff640 1 -- 172.21.15.98:0/1957961602 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe908155a50 msgr2=0x7fe908155eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:53.999 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.995+0000 7fe907fff640 1 --2- 172.21.15.98:0/1957961602 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe908155a50 0x7fe908155eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:53.999 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.995+0000 7fe907fff640 1 -- 172.21.15.98:0/1957961602 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe90815abb0 msgr2=0x7fe90815b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:53.999 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.995+0000 7fe907fff640 1 --2- 172.21.15.98:0/1957961602 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe90815abb0 0x7fe90815b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:53.999 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.995+0000 7fe907fff640 1 -- 172.21.15.98:0/1957961602 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe908156780 con 0x7fe8f0003a30 2024-09-16T15:37:53.999 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.995+0000 7fe907fff640 1 --2- 172.21.15.98:0/1957961602 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe8f0003a30 0x7fe9080ca230 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe8f80017e0 tx=0x7fe8f8006360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:53.999 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.995+0000 7fe904ff9640 1 -- 172.21.15.98:0/1957961602 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f8041070 con 0x7fe8f0003a30 2024-09-16T15:37:53.999 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.996+0000 7fe904ff9640 1 -- 172.21.15.98:0/1957961602 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe8f8003af0 con 0x7fe8f0003a30 2024-09-16T15:37:53.999 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.996+0000 7fe90e756640 1 -- 172.21.15.98:0/1957961602 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe908156a60 con 0x7fe8f0003a30 2024-09-16T15:37:54.000 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.996+0000 7fe904ff9640 1 -- 172.21.15.98:0/1957961602 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f8038070 con 0x7fe8f0003a30 2024-09-16T15:37:54.000 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.996+0000 7fe90e756640 1 -- 172.21.15.98:0/1957961602 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe908157020 con 0x7fe8f0003a30 2024-09-16T15:37:54.000 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.997+0000 7fe90e756640 1 -- 172.21.15.98:0/1957961602 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9080d09c0 con 0x7fe8f0003a30 2024-09-16T15:37:54.001 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.997+0000 7fe904ff9640 1 -- 172.21.15.98:0/1957961602 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7fe8f8044070 con 0x7fe8f0003a30 2024-09-16T15:37:54.001 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.998+0000 7fe904ff9640 1 --2- 172.21.15.98:0/1957961602 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fe8f4078880 0x7fe8f407ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:54.001 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.998+0000 7fe904ff9640 1 -- 172.21.15.98:0/1957961602 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fe8f80b9ef0 con 0x7fe8f0003a30 2024-09-16T15:37:54.001 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.998+0000 7fe9077fe640 1 --2- 172.21.15.98:0/1957961602 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fe8f4078880 0x7fe8f407ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:54.001 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:53.998+0000 7fe9077fe640 1 --2- 172.21.15.98:0/1957961602 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fe8f4078880 0x7fe8f407ad40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc001eb0 tx=0x7fe8fc001130 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:54.004 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.002+0000 7fe904ff9640 1 -- 172.21.15.98:0/1957961602 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7fe8f8082560 con 0x7fe8f0003a30 2024-09-16T15:37:54.179 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.177+0000 7fe90e756640 1 -- 172.21.15.98:0/1957961602 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe90815c710 con 0x7fe8f0003a30 2024-09-16T15:37:54.180 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.178+0000 7fe904ff9640 1 -- 172.21.15.98:0/1957961602 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16681 (secure 0 0 0) 0x7fe8f8081e60 con 0x7fe8f0003a30 2024-09-16T15:37:54.180 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:37:54.180 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":23,"fsid":"52a38a45-21d2-4cb0-bb3a-4fb8be3a08df","created":"2024-09-16T15:37:20.387654+0000","modified":"2024-09-16T15:37:45.512714+0000","last_up_change":"2024-09-16T15:37:33.417470+0000","last_in_change":"2024-09-16T15:37:23.430578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T15:37:34.725090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-16T15:37:42.223874+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-16T15:37:42.808291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a2d61df4-2577-47e6-a4ac-c36bbb85ab8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1967099790},{"type":"v1","addr":"172.21.15.98:6825","nonce":1967099790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1967099790},{"type":"v1","addr":"172.21.15.98:6827","nonce":1967099790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":1967099790},{"type":"v1","addr":"172.21.15.98:6831","nonce":1967099790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1967099790},{"type":"v1","addr":"172.21.15.98:6829","nonce":1967099790}]},"public_addr":"172.21.15.98:6825/1967099790","cluster_addr":"172.21.15.98:6827/1967099790","heartbeat_back_addr":"172.21.15.98:6831/1967099790","heartbeat_front_addr":"172.21.15.98:6829/1967099790","state":["exists","up"]},{"osd":1,"uuid":"bb3a68a5-c22f-442b-b292-7c272fe01ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":3571460482},{"type":"v1","addr":"172.21.15.98:6809","nonce":3571460482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":3571460482},{"type":"v1","addr":"172.21.15.98:6811","nonce":3571460482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":3571460482},{"type":"v1","addr":"172.21.15.98:6815","nonce":3571460482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":3571460482},{"type":"v1","addr":"172.21.15.98:6813","nonce":3571460482}]},"public_addr":"172.21.15.98:6809/3571460482","cluster_addr":"172.21.15.98:6811/3571460482","heartbeat_back_addr":"172.21.15.98:6815/3571460482","heartbeat_front_addr":"172.21.15.98:6813/3571460482","state":["exists","up"]},{"osd":2,"uuid":"c8429195-a480-409b-8e5f-8dc4c6abc0a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":2573210695},{"type":"v1","addr":"172.21.15.98:6801","nonce":2573210695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":2573210695},{"type":"v1","addr":"172.21.15.98:6803","nonce":2573210695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":2573210695},{"type":"v1","addr":"172.21.15.98:6807","nonce":2573210695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":2573210695},{"type":"v1","addr":"172.21.15.98:6805","nonce":2573210695}]},"public_addr":"172.21.15.98:6801/2573210695","cluster_addr":"172.21.15.98:6803/2573210695","heartbeat_back_addr":"172.21.15.98:6807/2573210695","heartbeat_front_addr":"172.21.15.98:6805/2573210695","state":["exists","up"]},{"osd":3,"uuid":"0e800d7b-096f-4f65-b3cc-c7cda3870de4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":3951374837},{"type":"v1","addr":"172.21.15.98:6817","nonce":3951374837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":3951374837},{"type":"v1","addr":"172.21.15.98:6819","nonce":3951374837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":3951374837},{"type":"v1","addr":"172.21.15.98:6823","nonce":3951374837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":3951374837},{"type":"v1","addr":"172.21.15.98:6821","nonce":3951374837}]},"public_addr":"172.21.15.98:6817/3951374837","cluster_addr":"172.21.15.98:6819/3951374837","heartbeat_back_addr":"172.21.15.98:6823/3951374837","heartbeat_front_addr":"172.21.15.98:6821/3951374837","state":["exists","up"]},{"osd":4,"uuid":"c7822e9b-8e29-48d9-b92a-e8f9c7bc5247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":724302036},{"type":"v1","addr":"172.21.15.135:6811","nonce":724302036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":724302036},{"type":"v1","addr":"172.21.15.135:6813","nonce":724302036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":724302036},{"type":"v1","addr":"172.21.15.135:6817","nonce":724302036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":724302036},{"type":"v1","addr":"172.21.15.135:6815","nonce":724302036}]},"public_addr":"172.21.15.135:6811/724302036","cluster_addr":"172.21.15.135:6813/724302036","heartbeat_back_addr":"172.21.15.135:6817/724302036","heartbeat_front_addr":"172.21.15.135:6815/724302036","state":["exists","up"]},{"osd":5,"uuid":"35805e02-484a-4404-a78f-aa44f4daa41f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3083482635},{"type":"v1","addr":"172.21.15.135:6803","nonce":3083482635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3083482635},{"type":"v1","addr":"172.21.15.135:6805","nonce":3083482635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3083482635},{"type":"v1","addr":"172.21.15.135:6809","nonce":3083482635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3083482635},{"type":"v1","addr":"172.21.15.135:6807","nonce":3083482635}]},"public_addr":"172.21.15.135:6803/3083482635","cluster_addr":"172.21.15.135:6805/3083482635","heartbeat_back_addr":"172.21.15.135:6809/3083482635","heartbeat_front_addr":"172.21.15.135:6807/3083482635","state":["exists","up"]},{"osd":6,"uuid":"6327ba84-aaeb-41fa-9717-188988ff2c4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3376376340},{"type":"v1","addr":"172.21.15.135:6819","nonce":3376376340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3376376340},{"type":"v1","addr":"172.21.15.135:6821","nonce":3376376340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":3376376340},{"type":"v1","addr":"172.21.15.135:6825","nonce":3376376340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3376376340},{"type":"v1","addr":"172.21.15.135:6823","nonce":3376376340}]},"public_addr":"172.21.15.135:6819/3376376340","cluster_addr":"172.21.15.135:6821/3376376340","heartbeat_back_addr":"172.21.15.135:6825/3376376340","heartbeat_front_addr":"172.21.15.135:6823/3376376340","state":["exists","up"]},{"osd":7,"uuid":"392d0958-dff9-4248-b3d8-a1201c10f354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2559837727},{"type":"v1","addr":"172.21.15.135:6827","nonce":2559837727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2559837727},{"type":"v1","addr":"172.21.15.135:6829","nonce":2559837727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":2559837727},{"type":"v1","addr":"172.21.15.135:6833","nonce":2559837727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2559837727},{"type":"v1","addr":"172.21.15.135:6831","nonce":2559837727}]},"public_addr":"172.21.15.135:6827/2559837727","cluster_addr":"172.21.15.135:6829/2559837727","heartbeat_back_addr":"172.21.15.135:6833/2559837727","heartbeat_front_addr":"172.21.15.135:6831/2559837727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.939904+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.717296+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.785817+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:30.211718+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.973359+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:30.250109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.699327+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:30.173063+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T15:37:54.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.180+0000 7fe90e756640 1 -- 172.21.15.98:0/1957961602 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fe8f4078880 msgr2=0x7fe8f407ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:54.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.180+0000 7fe90e756640 1 --2- 172.21.15.98:0/1957961602 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fe8f4078880 0x7fe8f407ad40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc001eb0 tx=0x7fe8fc001130 comp rx=0 tx=0).stop 2024-09-16T15:37:54.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.180+0000 7fe90e756640 1 -- 172.21.15.98:0/1957961602 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe8f0003a30 msgr2=0x7fe9080ca230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:54.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.180+0000 7fe90e756640 1 --2- 172.21.15.98:0/1957961602 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe8f0003a30 0x7fe9080ca230 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe8f80017e0 tx=0x7fe8f8006360 comp rx=0 tx=0).stop 2024-09-16T15:37:54.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.180+0000 7fe90e756640 1 -- 172.21.15.98:0/1957961602 shutdown_connections 2024-09-16T15:37:54.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.180+0000 7fe90e756640 1 --2- 172.21.15.98:0/1957961602 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fe8f4078880 0x7fe8f407ad40 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:54.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.180+0000 7fe90e756640 1 --2- 172.21.15.98:0/1957961602 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe90815abb0 0x7fe90815b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:54.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.180+0000 7fe90e756640 1 --2- 172.21.15.98:0/1957961602 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe908155a50 0x7fe908155eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:54.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.180+0000 7fe90e756640 1 --2- 172.21.15.98:0/1957961602 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe8f0003a30 0x7fe9080ca230 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:54.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.180+0000 7fe90e756640 1 -- 172.21.15.98:0/1957961602 >> 172.21.15.98:0/1957961602 conn(0x7fe9080d3fe0 msgr2=0x7fe9080b84e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:54.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.180+0000 7fe90e756640 1 -- 172.21.15.98:0/1957961602 shutdown_connections 2024-09-16T15:37:54.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.180+0000 7fe90e756640 1 -- 172.21.15.98:0/1957961602 wait complete. 2024-09-16T15:37:54.193 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-16T15:37:54.193 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T15:37:54.294 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.292+0000 7fcb5029b640 1 -- 172.21.15.98:0/4116221491 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcb480cf300 msgr2=0x7fcb480729a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:54.294 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.292+0000 7fcb5029b640 1 --2- 172.21.15.98:0/4116221491 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcb480cf300 0x7fcb480729a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c009900 tx=0x7fcb3c02a610 comp rx=0 tx=0).stop 2024-09-16T15:37:54.294 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.292+0000 7fcb5029b640 1 -- 172.21.15.98:0/4116221491 shutdown_connections 2024-09-16T15:37:54.294 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.292+0000 7fcb5029b640 1 --2- 172.21.15.98:0/4116221491 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcb480cf300 0x7fcb480729a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:54.294 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.292+0000 7fcb5029b640 1 -- 172.21.15.98:0/4116221491 >> 172.21.15.98:0/4116221491 conn(0x7fcb480b1950 msgr2=0x7fcb480b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:54.294 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.292+0000 7fcb5029b640 1 -- 172.21.15.98:0/4116221491 shutdown_connections 2024-09-16T15:37:54.295 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.292+0000 7fcb5029b640 1 -- 172.21.15.98:0/4116221491 wait complete. 2024-09-16T15:37:54.295 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.293+0000 7fcb5029b640 1 Processor -- start 2024-09-16T15:37:54.295 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.293+0000 7fcb5029b640 1 -- start start 2024-09-16T15:37:54.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.294+0000 7fcb5029b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb480ccfd0 0x7fcb4815eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:54.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.294+0000 7fcb5029b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcb480cf300 0x7fcb48072910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:54.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.294+0000 7fcb5029b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcb481445d0 0x7fcb48072e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:54.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.294+0000 7fcb5029b640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fcb480735f0 con 0x7fcb481445d0 2024-09-16T15:37:54.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.294+0000 7fcb5029b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fcb480b4f60 con 0x7fcb480ccfd0 2024-09-16T15:37:54.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.294+0000 7fcb5029b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fcb48073770 con 0x7fcb480cf300 2024-09-16T15:37:54.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.294+0000 7fcb4e838640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcb481445d0 0x7fcb48072e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:54.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.294+0000 7fcb4e838640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcb481445d0 0x7fcb48072e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59592/0 (socket says 172.21.15.98:59592) 2024-09-16T15:37:54.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.294+0000 7fcb4e838640 1 -- 172.21.15.98:0/1859530141 learned_addr learned my addr 172.21.15.98:0/1859530141 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:37:54.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.294+0000 7fcb4e037640 1 --2- 172.21.15.98:0/1859530141 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb480ccfd0 0x7fcb4815eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:54.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.294+0000 7fcb4d836640 1 --2- 172.21.15.98:0/1859530141 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcb480cf300 0x7fcb48072910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:54.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.294+0000 7fcb4e838640 1 -- 172.21.15.98:0/1859530141 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcb480cf300 msgr2=0x7fcb48072910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:54.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.294+0000 7fcb4e838640 1 --2- 172.21.15.98:0/1859530141 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcb480cf300 0x7fcb48072910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:54.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.294+0000 7fcb4e838640 1 -- 172.21.15.98:0/1859530141 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb480ccfd0 msgr2=0x7fcb4815eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:54.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.294+0000 7fcb4e838640 1 --2- 172.21.15.98:0/1859530141 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb480ccfd0 0x7fcb4815eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:54.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.294+0000 7fcb4e838640 1 -- 172.21.15.98:0/1859530141 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb481f2dd0 con 0x7fcb481445d0 2024-09-16T15:37:54.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.295+0000 7fcb4e838640 1 --2- 172.21.15.98:0/1859530141 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcb481445d0 0x7fcb48072e50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fcb4000c440 tx=0x7fcb4000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:54.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.295+0000 7fcb46ffd640 1 -- 172.21.15.98:0/1859530141 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb40011790 con 0x7fcb481445d0 2024-09-16T15:37:54.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.295+0000 7fcb46ffd640 1 -- 172.21.15.98:0/1859530141 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcb40017070 con 0x7fcb481445d0 2024-09-16T15:37:54.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.295+0000 7fcb46ffd640 1 -- 172.21.15.98:0/1859530141 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb40011cc0 con 0x7fcb481445d0 2024-09-16T15:37:54.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.295+0000 7fcb5029b640 1 -- 172.21.15.98:0/1859530141 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb481f30b0 con 0x7fcb481445d0 2024-09-16T15:37:54.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.295+0000 7fcb5029b640 1 -- 172.21.15.98:0/1859530141 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb481f3670 con 0x7fcb481445d0 2024-09-16T15:37:54.299 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.296+0000 7fcb5029b640 1 -- 172.21.15.98:0/1859530141 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb48073c20 con 0x7fcb481445d0 2024-09-16T15:37:54.299 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.296+0000 7fcb46ffd640 1 -- 172.21.15.98:0/1859530141 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7fcb4001c460 con 0x7fcb481445d0 2024-09-16T15:37:54.299 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.297+0000 7fcb46ffd640 1 --2- 172.21.15.98:0/1859530141 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fcb34078850 0x7fcb3407ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:54.299 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.297+0000 7fcb46ffd640 1 -- 172.21.15.98:0/1859530141 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fcb4009a530 con 0x7fcb481445d0 2024-09-16T15:37:54.299 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.297+0000 7fcb4e037640 1 --2- 172.21.15.98:0/1859530141 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fcb34078850 0x7fcb3407ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:54.300 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.298+0000 7fcb4e037640 1 --2- 172.21.15.98:0/1859530141 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fcb34078850 0x7fcb3407ad10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcb38001e20 tx=0x7fcb38009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:54.303 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.301+0000 7fcb46ffd640 1 -- 172.21.15.98:0/1859530141 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7fcb400625e0 con 0x7fcb481445d0 2024-09-16T15:37:54.479 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.477+0000 7fcb5029b640 1 -- 172.21.15.98:0/1859530141 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcb48070a20 con 0x7fcb481445d0 2024-09-16T15:37:54.480 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.478+0000 7fcb46ffd640 1 -- 172.21.15.98:0/1859530141 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16681 (secure 0 0 0) 0x7fcb40067010 con 0x7fcb481445d0 2024-09-16T15:37:54.480 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:37:54.480 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":23,"fsid":"52a38a45-21d2-4cb0-bb3a-4fb8be3a08df","created":"2024-09-16T15:37:20.387654+0000","modified":"2024-09-16T15:37:45.512714+0000","last_up_change":"2024-09-16T15:37:33.417470+0000","last_in_change":"2024-09-16T15:37:23.430578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T15:37:34.725090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-16T15:37:42.223874+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-16T15:37:42.808291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a2d61df4-2577-47e6-a4ac-c36bbb85ab8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1967099790},{"type":"v1","addr":"172.21.15.98:6825","nonce":1967099790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1967099790},{"type":"v1","addr":"172.21.15.98:6827","nonce":1967099790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":1967099790},{"type":"v1","addr":"172.21.15.98:6831","nonce":1967099790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1967099790},{"type":"v1","addr":"172.21.15.98:6829","nonce":1967099790}]},"public_addr":"172.21.15.98:6825/1967099790","cluster_addr":"172.21.15.98:6827/1967099790","heartbeat_back_addr":"172.21.15.98:6831/1967099790","heartbeat_front_addr":"172.21.15.98:6829/1967099790","state":["exists","up"]},{"osd":1,"uuid":"bb3a68a5-c22f-442b-b292-7c272fe01ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":3571460482},{"type":"v1","addr":"172.21.15.98:6809","nonce":3571460482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":3571460482},{"type":"v1","addr":"172.21.15.98:6811","nonce":3571460482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":3571460482},{"type":"v1","addr":"172.21.15.98:6815","nonce":3571460482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":3571460482},{"type":"v1","addr":"172.21.15.98:6813","nonce":3571460482}]},"public_addr":"172.21.15.98:6809/3571460482","cluster_addr":"172.21.15.98:6811/3571460482","heartbeat_back_addr":"172.21.15.98:6815/3571460482","heartbeat_front_addr":"172.21.15.98:6813/3571460482","state":["exists","up"]},{"osd":2,"uuid":"c8429195-a480-409b-8e5f-8dc4c6abc0a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":2573210695},{"type":"v1","addr":"172.21.15.98:6801","nonce":2573210695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":2573210695},{"type":"v1","addr":"172.21.15.98:6803","nonce":2573210695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":2573210695},{"type":"v1","addr":"172.21.15.98:6807","nonce":2573210695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":2573210695},{"type":"v1","addr":"172.21.15.98:6805","nonce":2573210695}]},"public_addr":"172.21.15.98:6801/2573210695","cluster_addr":"172.21.15.98:6803/2573210695","heartbeat_back_addr":"172.21.15.98:6807/2573210695","heartbeat_front_addr":"172.21.15.98:6805/2573210695","state":["exists","up"]},{"osd":3,"uuid":"0e800d7b-096f-4f65-b3cc-c7cda3870de4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":3951374837},{"type":"v1","addr":"172.21.15.98:6817","nonce":3951374837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":3951374837},{"type":"v1","addr":"172.21.15.98:6819","nonce":3951374837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":3951374837},{"type":"v1","addr":"172.21.15.98:6823","nonce":3951374837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":3951374837},{"type":"v1","addr":"172.21.15.98:6821","nonce":3951374837}]},"public_addr":"172.21.15.98:6817/3951374837","cluster_addr":"172.21.15.98:6819/3951374837","heartbeat_back_addr":"172.21.15.98:6823/3951374837","heartbeat_front_addr":"172.21.15.98:6821/3951374837","state":["exists","up"]},{"osd":4,"uuid":"c7822e9b-8e29-48d9-b92a-e8f9c7bc5247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":724302036},{"type":"v1","addr":"172.21.15.135:6811","nonce":724302036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":724302036},{"type":"v1","addr":"172.21.15.135:6813","nonce":724302036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":724302036},{"type":"v1","addr":"172.21.15.135:6817","nonce":724302036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":724302036},{"type":"v1","addr":"172.21.15.135:6815","nonce":724302036}]},"public_addr":"172.21.15.135:6811/724302036","cluster_addr":"172.21.15.135:6813/724302036","heartbeat_back_addr":"172.21.15.135:6817/724302036","heartbeat_front_addr":"172.21.15.135:6815/724302036","state":["exists","up"]},{"osd":5,"uuid":"35805e02-484a-4404-a78f-aa44f4daa41f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3083482635},{"type":"v1","addr":"172.21.15.135:6803","nonce":3083482635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3083482635},{"type":"v1","addr":"172.21.15.135:6805","nonce":3083482635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3083482635},{"type":"v1","addr":"172.21.15.135:6809","nonce":3083482635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3083482635},{"type":"v1","addr":"172.21.15.135:6807","nonce":3083482635}]},"public_addr":"172.21.15.135:6803/3083482635","cluster_addr":"172.21.15.135:6805/3083482635","heartbeat_back_addr":"172.21.15.135:6809/3083482635","heartbeat_front_addr":"172.21.15.135:6807/3083482635","state":["exists","up"]},{"osd":6,"uuid":"6327ba84-aaeb-41fa-9717-188988ff2c4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3376376340},{"type":"v1","addr":"172.21.15.135:6819","nonce":3376376340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3376376340},{"type":"v1","addr":"172.21.15.135:6821","nonce":3376376340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":3376376340},{"type":"v1","addr":"172.21.15.135:6825","nonce":3376376340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3376376340},{"type":"v1","addr":"172.21.15.135:6823","nonce":3376376340}]},"public_addr":"172.21.15.135:6819/3376376340","cluster_addr":"172.21.15.135:6821/3376376340","heartbeat_back_addr":"172.21.15.135:6825/3376376340","heartbeat_front_addr":"172.21.15.135:6823/3376376340","state":["exists","up"]},{"osd":7,"uuid":"392d0958-dff9-4248-b3d8-a1201c10f354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2559837727},{"type":"v1","addr":"172.21.15.135:6827","nonce":2559837727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2559837727},{"type":"v1","addr":"172.21.15.135:6829","nonce":2559837727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":2559837727},{"type":"v1","addr":"172.21.15.135:6833","nonce":2559837727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2559837727},{"type":"v1","addr":"172.21.15.135:6831","nonce":2559837727}]},"public_addr":"172.21.15.135:6827/2559837727","cluster_addr":"172.21.15.135:6829/2559837727","heartbeat_back_addr":"172.21.15.135:6833/2559837727","heartbeat_front_addr":"172.21.15.135:6831/2559837727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.939904+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.717296+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.785817+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:30.211718+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.973359+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:30.250109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.699327+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:30.173063+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T15:37:54.482 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.480+0000 7fcb5029b640 1 -- 172.21.15.98:0/1859530141 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fcb34078850 msgr2=0x7fcb3407ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:54.482 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.480+0000 7fcb5029b640 1 --2- 172.21.15.98:0/1859530141 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fcb34078850 0x7fcb3407ad10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcb38001e20 tx=0x7fcb38009040 comp rx=0 tx=0).stop 2024-09-16T15:37:54.482 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.480+0000 7fcb5029b640 1 -- 172.21.15.98:0/1859530141 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcb481445d0 msgr2=0x7fcb48072e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:54.482 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.480+0000 7fcb5029b640 1 --2- 172.21.15.98:0/1859530141 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcb481445d0 0x7fcb48072e50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fcb4000c440 tx=0x7fcb4000c900 comp rx=0 tx=0).stop 2024-09-16T15:37:54.482 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.480+0000 7fcb5029b640 1 -- 172.21.15.98:0/1859530141 shutdown_connections 2024-09-16T15:37:54.483 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.480+0000 7fcb5029b640 1 --2- 172.21.15.98:0/1859530141 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcb481445d0 0x7fcb48072e50 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:54.483 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.480+0000 7fcb5029b640 1 --2- 172.21.15.98:0/1859530141 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcb480cf300 0x7fcb48072910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:54.483 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.480+0000 7fcb5029b640 1 --2- 172.21.15.98:0/1859530141 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fcb34078850 0x7fcb3407ad10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:54.483 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.480+0000 7fcb5029b640 1 --2- 172.21.15.98:0/1859530141 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb480ccfd0 0x7fcb4815eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:54.483 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.480+0000 7fcb5029b640 1 -- 172.21.15.98:0/1859530141 >> 172.21.15.98:0/1859530141 conn(0x7fcb480b1950 msgr2=0x7fcb4806f9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:54.483 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.480+0000 7fcb5029b640 1 -- 172.21.15.98:0/1859530141 shutdown_connections 2024-09-16T15:37:54.483 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.480+0000 7fcb5029b640 1 -- 172.21.15.98:0/1859530141 wait complete. 2024-09-16T15:37:54.493 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-16T15:37:54.494 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-16T15:37:54.494 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-16T15:37:54.494 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-16T15:37:54.495 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-16T15:37:54.495 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-16T15:37:54.495 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-16T15:37:54.496 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-16T15:37:54.667 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.665+0000 7feb177fe640 1 -- 172.21.15.98:0/253844059 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb10036400 con 0x7feb180cf080 2024-09-16T15:37:54.668 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.666+0000 7f7cf02ef640 1 -- 172.21.15.98:0/52691987 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7ce815e0d0 msgr2=0x7f7ce80d09c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:54.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.666+0000 7f7cf02ef640 1 --2- 172.21.15.98:0/52691987 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7ce815e0d0 0x7f7ce80d09c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7cd8009830 tx=0x7f7cd802a480 comp rx=0 tx=0).stop 2024-09-16T15:37:54.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.666+0000 7f7cf02ef640 1 -- 172.21.15.98:0/52691987 shutdown_connections 2024-09-16T15:37:54.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.666+0000 7f7cf02ef640 1 --2- 172.21.15.98:0/52691987 >> v2:172.21.15.98:3300/0 conn(0x7f7ce80d1610 0x7f7ce80cecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:54.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.666+0000 7f7cf02ef640 1 --2- 172.21.15.98:0/52691987 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7ce815e0d0 0x7f7ce80d09c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:54.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.666+0000 7f7cf02ef640 1 -- 172.21.15.98:0/52691987 >> 172.21.15.98:0/52691987 conn(0x7f7ce80d3fe0 msgr2=0x7f7ce80d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:54.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.666+0000 7f7cf02ef640 1 -- 172.21.15.98:0/52691987 shutdown_connections 2024-09-16T15:37:54.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.666+0000 7f7cf02ef640 1 -- 172.21.15.98:0/52691987 wait complete. 2024-09-16T15:37:54.670 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.666+0000 7feb1efda640 1 -- 172.21.15.98:0/253844059 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feb180cf080 msgr2=0x7feb180b3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:54.670 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.666+0000 7feb1efda640 1 --2- 172.21.15.98:0/253844059 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feb180cf080 0x7feb180b3040 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7feb10005fd0 tx=0x7feb1002aaa0 comp rx=0 tx=0).stop 2024-09-16T15:37:54.670 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.666+0000 7feb1efda640 1 -- 172.21.15.98:0/253844059 shutdown_connections 2024-09-16T15:37:54.670 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.666+0000 7feb1efda640 1 --2- 172.21.15.98:0/253844059 >> v2:172.21.15.135:3300/0 conn(0x7feb1813d200 0x7feb180cfd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:54.670 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.666+0000 7feb1efda640 1 --2- 172.21.15.98:0/253844059 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feb180cf080 0x7feb180b3040 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:54.670 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.666+0000 7feb1efda640 1 -- 172.21.15.98:0/253844059 >> 172.21.15.98:0/253844059 conn(0x7feb1806cd50 msgr2=0x7feb1806d160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:54.671 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.666+0000 7f10fb7fe640 1 -- 172.21.15.98:0/4098202092 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f402fe00 con 0x7f10fc1662e0 2024-09-16T15:37:54.671 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.666+0000 7feb1efda640 1 -- 172.21.15.98:0/253844059 shutdown_connections 2024-09-16T15:37:54.671 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.667+0000 7f1102b5d640 1 -- 172.21.15.98:0/4098202092 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10fc1662e0 msgr2=0x7f10fc0d2b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:54.671 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.667+0000 7f1102b5d640 1 --2- 172.21.15.98:0/4098202092 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10fc1662e0 0x7f10fc0d2b70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f10f4005fd0 tx=0x7f10f402aa00 comp rx=0 tx=0).stop 2024-09-16T15:37:54.671 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.667+0000 7f1102b5d640 1 -- 172.21.15.98:0/4098202092 shutdown_connections 2024-09-16T15:37:54.671 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.667+0000 7f1102b5d640 1 --2- 172.21.15.98:0/4098202092 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f10fc0d30b0 0x7f10fc0d3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:54.671 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.667+0000 7f1102b5d640 1 --2- 172.21.15.98:0/4098202092 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10fc1662e0 0x7f10fc0d2b70 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:54.672 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.667+0000 7f1102b5d640 1 -- 172.21.15.98:0/4098202092 >> 172.21.15.98:0/4098202092 conn(0x7f10fc0d0a40 msgr2=0x7f10fc0d0e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:54.672 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.667+0000 7feb1efda640 1 -- 172.21.15.98:0/253844059 wait complete. 2024-09-16T15:37:54.672 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.667+0000 7f1102b5d640 1 -- 172.21.15.98:0/4098202092 shutdown_connections 2024-09-16T15:37:54.672 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.667+0000 7f1102b5d640 1 -- 172.21.15.98:0/4098202092 wait complete. 2024-09-16T15:37:54.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.667+0000 7f7cd4356640 1 -- 172.21.15.98:0/3003681257 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7ccc073840 msgr2=0x7f7ccc15bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:54.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.667+0000 7f7cd4356640 1 --2- 172.21.15.98:0/3003681257 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7ccc073840 0x7f7ccc15bb90 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7cc8005fd0 tx=0x7f7cc802a4d0 comp rx=0 tx=0).stop 2024-09-16T15:37:54.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.667+0000 7f9b27216640 1 -- 172.21.15.98:0/2976759834 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b200ccd00 msgr2=0x7f9b200b3f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:54.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.667+0000 7f9b27216640 1 --2- 172.21.15.98:0/2976759834 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b200ccd00 0x7f9b200b3f00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9b18005fd0 tx=0x7f9b1802a8a0 comp rx=0 tx=0).stop 2024-09-16T15:37:54.674 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.668+0000 7f7cf02ef640 1 Processor -- start 2024-09-16T15:37:54.674 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.668+0000 7f9b27216640 1 -- 172.21.15.98:0/2976759834 shutdown_connections 2024-09-16T15:37:54.674 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.668+0000 7f7cf02ef640 1 -- start start 2024-09-16T15:37:54.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.668+0000 7f9b27216640 1 --2- 172.21.15.98:0/2976759834 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9b20070920 0x7f9b2006f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:54.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.668+0000 7f9b27216640 1 --2- 172.21.15.98:0/2976759834 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b200ccd00 0x7f9b200b3f00 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:54.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.668+0000 7f9b27216640 1 -- 172.21.15.98:0/2976759834 >> 172.21.15.98:0/2976759834 conn(0x7f9b200b1950 msgr2=0x7f9b200b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:54.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.668+0000 7eff76e60640 1 -- 172.21.15.98:0/1509961020 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff58004800 msgr2=0x7eff58004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:54.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.668+0000 7eff76e60640 1 --2- 172.21.15.98:0/1509961020 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff58004800 0x7eff58004c80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7eff580057a0 tx=0x7eff58005830 comp rx=0 tx=0).stop 2024-09-16T15:37:54.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.668+0000 7eff76e60640 1 -- 172.21.15.98:0/1509961020 shutdown_connections 2024-09-16T15:37:54.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.668+0000 7eff76e60640 1 --2- 172.21.15.98:0/1509961020 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff58004800 0x7eff58004c80 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:54.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.668+0000 7eff76e60640 1 -- 172.21.15.98:0/1509961020 >> 172.21.15.98:0/1509961020 conn(0x7eff700d3fc0 msgr2=0x7eff700d43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:54.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.668+0000 7f7cd4356640 1 -- 172.21.15.98:0/3003681257 shutdown_connections 2024-09-16T15:37:54.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.668+0000 7f7cd4356640 1 --2- 172.21.15.98:0/3003681257 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7ccc073c20 0x7f7ccc15e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:54.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.668+0000 7f7cd4356640 1 --2- 172.21.15.98:0/3003681257 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7ccc073840 0x7f7ccc15bb90 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:54.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.668+0000 7f7cd4356640 1 -- 172.21.15.98:0/3003681257 >> 172.21.15.98:0/3003681257 conn(0x7f7ccc0d0cb0 msgr2=0x7f7ccc0d10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:54.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.668+0000 7f9b27216640 1 -- 172.21.15.98:0/2976759834 shutdown_connections 2024-09-16T15:37:54.677 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.668+0000 7f7cd4356640 1 -- 172.21.15.98:0/3003681257 shutdown_connections 2024-09-16T15:37:54.677 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.668+0000 7f7cd4356640 1 -- 172.21.15.98:0/3003681257 wait complete. 2024-09-16T15:37:54.677 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.668+0000 7feb1efda640 1 Processor -- start 2024-09-16T15:37:54.677 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.669+0000 7eff76e60640 1 -- 172.21.15.98:0/1509961020 shutdown_connections 2024-09-16T15:37:54.678 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.669+0000 7feb1efda640 1 -- start start 2024-09-16T15:37:54.678 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.669+0000 7eff76e60640 1 -- 172.21.15.98:0/1509961020 wait complete. 2024-09-16T15:37:54.678 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.669+0000 7f1102b5d640 1 Processor -- start 2024-09-16T15:37:54.678 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.669+0000 7fe41cd91640 1 -- 172.21.15.98:0/2467966007 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe41806f740 msgr2=0x7fe41806d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:54.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.669+0000 7fe41cd91640 1 --2- 172.21.15.98:0/2467966007 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe41806f740 0x7fe41806d6f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe408009860 tx=0x7fe40802a540 comp rx=0 tx=0).stop 2024-09-16T15:37:54.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.669+0000 7f7cf02ef640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7ce80d1610 0x7f7ce80cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:54.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.669+0000 7fe41cd91640 1 -- 172.21.15.98:0/2467966007 shutdown_connections 2024-09-16T15:37:54.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.669+0000 7fe41cd91640 1 --2- 172.21.15.98:0/2467966007 >> v2:172.21.15.135:3300/0 conn(0x7fe4180d1620 0x7fe4180736e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:54.680 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.669+0000 7fe41cd91640 1 --2- 172.21.15.98:0/2467966007 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe41806f740 0x7fe41806d6f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:54.680 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.669+0000 7fe41cd91640 1 -- 172.21.15.98:0/2467966007 >> 172.21.15.98:0/2467966007 conn(0x7fe4180d0b30 msgr2=0x7fe4180d0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:54.680 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.669+0000 7fe41cd91640 1 -- 172.21.15.98:0/2467966007 shutdown_connections 2024-09-16T15:37:54.680 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.669+0000 7f7cf02ef640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7ce80d2050 0x7f7ce81f8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:54.680 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.668+0000 7f9b27216640 1 -- 172.21.15.98:0/2976759834 wait complete. 2024-09-16T15:37:54.681 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.669+0000 7f7cee08b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7ce80d1610 0x7f7ce80cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:54.681 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.669+0000 7f7cee08b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7ce80d1610 0x7f7ce80cdbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.98:34850/0 (socket says 172.21.15.98:34850) 2024-09-16T15:37:54.681 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.669+0000 7fe41cd91640 1 -- 172.21.15.98:0/2467966007 wait complete. 2024-09-16T15:37:54.682 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.669+0000 7f7ced88a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7ce80d2050 0x7f7ce81f8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:54.682 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.670+0000 7f7ced88a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7ce80d2050 0x7f7ce81f8180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59632/0 (socket says 172.21.15.98:59632) 2024-09-16T15:37:54.682 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.670+0000 7f7cee08b640 1 -- 172.21.15.98:0/2273382413 learned_addr learned my addr 172.21.15.98:0/2273382413 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:37:54.682 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.670+0000 7f7cf02ef640 1 --2- 172.21.15.98:0/2273382413 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ce815e0d0 0x7f7ce80b93b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:54.682 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.670+0000 7f7cf02ef640 1 -- 172.21.15.98:0/2273382413 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7ce80cf5e0 con 0x7f7ce80d2050 2024-09-16T15:37:54.682 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.670+0000 7f7cf02ef640 1 -- 172.21.15.98:0/2273382413 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7ce80cf460 con 0x7f7ce815e0d0 2024-09-16T15:37:54.682 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.670+0000 7f7cf02ef640 1 -- 172.21.15.98:0/2273382413 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f7ce80cf760 con 0x7f7ce80d1610 2024-09-16T15:37:54.682 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.670+0000 7f7cee88c640 1 --2- 172.21.15.98:0/2273382413 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ce815e0d0 0x7f7ce80b93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:54.683 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.670+0000 7feb1efda640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb180cf080 0x7feb181f5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:54.683 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.670+0000 7f7ced88a640 1 -- 172.21.15.98:0/2273382413 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7ce80d1610 msgr2=0x7f7ce80cdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:54.683 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.670+0000 7feb1efda640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feb180d0290 0x7feb181f7b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:54.683 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.670+0000 7f7ced88a640 1 --2- 172.21.15.98:0/2273382413 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7ce80d1610 0x7f7ce80cdbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:54.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.670+0000 7f9b27216640 1 Processor -- start 2024-09-16T15:37:54.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.670+0000 7eff76e60640 1 Processor -- start 2024-09-16T15:37:54.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.670+0000 7f7ced88a640 1 -- 172.21.15.98:0/2273382413 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ce815e0d0 msgr2=0x7f7ce80b93b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:54.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.670+0000 7f7ced88a640 1 --2- 172.21.15.98:0/2273382413 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ce815e0d0 0x7f7ce80b93b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:54.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.670+0000 7f7ced88a640 1 -- 172.21.15.98:0/2273382413 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ce80b5b40 con 0x7f7ce80d2050 2024-09-16T15:37:54.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.670+0000 7feb1cd76640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb180cf080 0x7feb181f5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:54.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.670+0000 7feb1cd76640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb180cf080 0x7feb181f5000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.98:38398/0 (socket says 172.21.15.98:38398) 2024-09-16T15:37:54.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.670+0000 7eff76e60640 1 -- start start 2024-09-16T15:37:54.686 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.670+0000 7f7cee08b640 1 --2- 172.21.15.98:0/2273382413 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7ce80d1610 0x7f7ce80cdbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T15:37:54.686 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.670+0000 7feb17fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feb180d0290 0x7feb181f7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:54.686 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.669+0000 7f1102b5d640 1 -- start start 2024-09-16T15:37:54.686 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.670+0000 7feb17fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feb180d0290 0x7feb181f7b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59638/0 (socket says 172.21.15.98:59638) 2024-09-16T15:37:54.687 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.670+0000 7f1102b5d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f10fc0d30b0 0x7f10fc1fcd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:54.687 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.670+0000 7f7cd4356640 1 Processor -- start 2024-09-16T15:37:54.687 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.670+0000 7feb1cd76640 1 -- 172.21.15.98:0/3026911518 learned_addr learned my addr 172.21.15.98:0/3026911518 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:37:54.688 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.670+0000 7feb1efda640 1 --2- 172.21.15.98:0/3026911518 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feb1813d200 0x7feb1813d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:54.688 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.670+0000 7f7ced88a640 1 --2- 172.21.15.98:0/2273382413 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7ce80d2050 0x7f7ce81f8180 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7ce000caf0 tx=0x7f7ce00020c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:54.688 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.671+0000 7f7cd4356640 1 -- start start 2024-09-16T15:37:54.688 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.671+0000 7f1102b5d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10fc165f00 0x7f10fc15b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:54.689 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.671+0000 7feb1efda640 1 -- 172.21.15.98:0/3026911518 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7feb180706f0 con 0x7feb180d0290 2024-09-16T15:37:54.689 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.671+0000 7feb1efda640 1 -- 172.21.15.98:0/3026911518 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7feb180b3790 con 0x7feb180cf080 2024-09-16T15:37:54.689 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.671+0000 7feb1efda640 1 -- 172.21.15.98:0/3026911518 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7feb18070870 con 0x7feb1813d200 2024-09-16T15:37:54.689 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.671+0000 7f7cdeffd640 1 -- 172.21.15.98:0/2273382413 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce0017070 con 0x7f7ce80d2050 2024-09-16T15:37:54.690 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.671+0000 7f11008f9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f10fc0d30b0 0x7f10fc1fcd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:54.690 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.671+0000 7f11008f9640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f10fc0d30b0 0x7f10fc1fcd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.98:34866/0 (socket says 172.21.15.98:34866) 2024-09-16T15:37:54.690 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.671+0000 7f10fbfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10fc165f00 0x7f10fc15b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:54.690 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.671+0000 7f10fbfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10fc165f00 0x7f10fc15b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.98:38408/0 (socket says 172.21.15.98:38408) 2024-09-16T15:37:54.690 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.671+0000 7f7cdeffd640 1 -- 172.21.15.98:0/2273382413 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7ce0003c80 con 0x7f7ce80d2050 2024-09-16T15:37:54.690 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.671+0000 7f11008f9640 1 -- 172.21.15.98:0/169125813 learned_addr learned my addr 172.21.15.98:0/169125813 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:37:54.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.671+0000 7feb1d577640 1 --2- 172.21.15.98:0/3026911518 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feb1813d200 0x7feb1813d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:54.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.671+0000 7f7cf02ef640 1 -- 172.21.15.98:0/2273382413 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ce80b52a0 con 0x7f7ce80d2050 2024-09-16T15:37:54.692 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.671+0000 7f1102b5d640 1 --2- 172.21.15.98:0/169125813 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10fc1662e0 0x7f10fc15bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:54.692 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.671+0000 7f1102b5d640 1 -- 172.21.15.98:0/169125813 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f10fc0d26f0 con 0x7f10fc1662e0 2024-09-16T15:37:54.692 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.671+0000 7f1102b5d640 1 -- 172.21.15.98:0/169125813 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f10fc0d2570 con 0x7f10fc165f00 2024-09-16T15:37:54.692 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.671+0000 7f1102b5d640 1 -- 172.21.15.98:0/169125813 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f10fc09d630 con 0x7f10fc0d30b0 2024-09-16T15:37:54.692 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.671+0000 7f7cf02ef640 1 -- 172.21.15.98:0/2273382413 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ce80b5860 con 0x7f7ce80d2050 2024-09-16T15:37:54.692 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.671+0000 7f7cdeffd640 1 -- 172.21.15.98:0/2273382413 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce000a960 con 0x7f7ce80d2050 2024-09-16T15:37:54.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.671+0000 7f11008f9640 1 -- 172.21.15.98:0/169125813 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10fc165f00 msgr2=0x7f10fc15b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:54.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.671+0000 7f11008f9640 1 --2- 172.21.15.98:0/169125813 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10fc165f00 0x7f10fc15b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:54.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.671+0000 7f11008f9640 1 -- 172.21.15.98:0/169125813 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10fc1662e0 msgr2=0x7f10fc15bec0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-16T15:37:54.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.672+0000 7f11010fa640 1 --2- 172.21.15.98:0/169125813 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10fc1662e0 0x7f10fc15bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:54.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.672+0000 7f7cd4356640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7ccc073840 0x7f7ccc0ca120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:54.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.672+0000 7f11008f9640 1 --2- 172.21.15.98:0/169125813 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10fc1662e0 0x7f10fc15bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:54.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.672+0000 7f11008f9640 1 -- 172.21.15.98:0/169125813 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10fc1fd2d0 con 0x7f10fc0d30b0 2024-09-16T15:37:54.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.672+0000 7eff76e60640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff58004800 0x7eff70160f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:54.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.672+0000 7eff76e60640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff700a1810 0x7eff7015b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:54.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.672+0000 7eff76e60640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff701f7d80 0x7eff701f8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:54.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.672+0000 7f11010fa640 1 --2- 172.21.15.98:0/169125813 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10fc1662e0 0x7f10fc15bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T15:37:54.695 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.672+0000 7eff76e60640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7eff700cec50 con 0x7eff701f7d80 2024-09-16T15:37:54.695 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.672+0000 7eff76e60640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7eff700cead0 con 0x7eff700a1810 2024-09-16T15:37:54.695 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.672+0000 7eff76e60640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7eff700cedd0 con 0x7eff58004800 2024-09-16T15:37:54.695 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.672+0000 7eff6ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff700a1810 0x7eff7015b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:54.695 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.672+0000 7eff74bfc640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff58004800 0x7eff70160f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:54.695 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.672+0000 7f7cd4356640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7ccc073c20 0x7f7ccc0c7130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:54.695 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.672+0000 7f11008f9640 1 --2- 172.21.15.98:0/169125813 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f10fc0d30b0 0x7f10fc1fcd90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f10f000c480 tx=0x7f10f000c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:54.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.671+0000 7feb1d577640 1 -- 172.21.15.98:0/3026911518 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb180cf080 msgr2=0x7feb181f5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:54.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.671+0000 7feb1d577640 1 --2- 172.21.15.98:0/3026911518 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb180cf080 0x7feb181f5000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:54.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.671+0000 7feb1d577640 1 -- 172.21.15.98:0/3026911518 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feb180d0290 msgr2=0x7feb181f7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:54.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.672+0000 7f7cd20f2640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7ccc073840 0x7f7ccc0ca120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:54.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.672+0000 7f7cd20f2640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7ccc073840 0x7f7ccc0ca120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.98:34906/0 (socket says 172.21.15.98:34906) 2024-09-16T15:37:54.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.672+0000 7eff74bfc640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff58004800 0x7eff70160f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.98:34882/0 (socket says 172.21.15.98:34882) 2024-09-16T15:37:54.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.672+0000 7eff74bfc640 1 -- 172.21.15.98:0/517574483 learned_addr learned my addr 172.21.15.98:0/517574483 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:37:54.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.672+0000 7f7cd20f2640 1 -- 172.21.15.98:0/1502919520 learned_addr learned my addr 172.21.15.98:0/1502919520 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:37:54.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.672+0000 7f10f97fa640 1 -- 172.21.15.98:0/169125813 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f0016020 con 0x7f10fc0d30b0 2024-09-16T15:37:54.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.672+0000 7f7cf02ef640 1 -- 172.21.15.98:0/2273382413 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7ce80cb530 con 0x7f7ce80d2050 2024-09-16T15:37:54.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.670+0000 7f9b27216640 1 -- start start 2024-09-16T15:37:54.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.672+0000 7f7cd4356640 1 --2- 172.21.15.98:0/1502919520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ccc15ec90 0x7f7ccc145120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:54.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.672+0000 7f7cd4356640 1 -- 172.21.15.98:0/1502919520 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7ccc0cd000 con 0x7f7ccc073c20 2024-09-16T15:37:54.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.672+0000 7f9b27216640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9b20070920 0x7f9b200b1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:54.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.672+0000 7f9b27216640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b200ccd00 0x7f9b200af310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:54.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.672+0000 7f9b27216640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b201438b0 0x7f9b201581a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:54.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.672+0000 7f9b27216640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9b20070390 con 0x7f9b200ccd00 2024-09-16T15:37:54.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.672+0000 7f9b27216640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9b20070210 con 0x7f9b201438b0 2024-09-16T15:37:54.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.672+0000 7f9b27216640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f9b200b4440 con 0x7f9b20070920 2024-09-16T15:37:54.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.672+0000 7f7cd4356640 1 -- 172.21.15.98:0/1502919520 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7ccc0d04a0 con 0x7f7ccc15ec90 2024-09-16T15:37:54.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.673+0000 7f7cd4356640 1 -- 172.21.15.98:0/1502919520 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f7ccc0cd180 con 0x7f7ccc073840 2024-09-16T15:37:54.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.673+0000 7f1102b5d640 1 -- 172.21.15.98:0/169125813 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10fc0ccdb0 con 0x7f10fc0d30b0 2024-09-16T15:37:54.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.672+0000 7f9b24fb2640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9b20070920 0x7f9b200b1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:54.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.672+0000 7f9b24fb2640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9b20070920 0x7f9b200b1080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.98:34880/0 (socket says 172.21.15.98:34880) 2024-09-16T15:37:54.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.672+0000 7f9b24fb2640 1 -- 172.21.15.98:0/4055155904 learned_addr learned my addr 172.21.15.98:0/4055155904 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:37:54.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.673+0000 7feb1d577640 1 --2- 172.21.15.98:0/3026911518 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feb180d0290 0x7feb181f7b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:54.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.673+0000 7feb1d577640 1 -- 172.21.15.98:0/3026911518 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb181f4580 con 0x7feb1813d200 2024-09-16T15:37:54.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.673+0000 7f1102b5d640 1 -- 172.21.15.98:0/169125813 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f10fc0cd370 con 0x7f10fc0d30b0 2024-09-16T15:37:54.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.673+0000 7feb17fff640 1 --2- 172.21.15.98:0/3026911518 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feb180d0290 0x7feb181f7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T15:37:54.701 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.673+0000 7f7cd28f3640 1 --2- 172.21.15.98:0/1502919520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ccc15ec90 0x7f7ccc145120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:54.701 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.673+0000 7eff6ffff640 1 -- 172.21.15.98:0/517574483 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff58004800 msgr2=0x7eff70160f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:54.701 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.673+0000 7eff6ffff640 1 --2- 172.21.15.98:0/517574483 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff58004800 0x7eff70160f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:54.701 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.673+0000 7eff6ffff640 1 -- 172.21.15.98:0/517574483 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff701f7d80 msgr2=0x7eff701f8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:54.701 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.673+0000 7eff6ffff640 1 --2- 172.21.15.98:0/517574483 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff701f7d80 0x7eff701f8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:54.702 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.673+0000 7f10f97fa640 1 -- 172.21.15.98:0/169125813 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f10f0012920 con 0x7f10fc0d30b0 2024-09-16T15:37:54.702 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.673+0000 7f9b24fb2640 1 -- 172.21.15.98:0/4055155904 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b201438b0 msgr2=0x7f9b201581a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-16T15:37:54.702 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.673+0000 7f9b24fb2640 1 --2- 172.21.15.98:0/4055155904 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b201438b0 0x7f9b201581a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:54.702 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.673+0000 7eff6ffff640 1 -- 172.21.15.98:0/517574483 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff701f8c50 con 0x7eff700a1810 2024-09-16T15:37:54.702 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.673+0000 7f10f97fa640 1 -- 172.21.15.98:0/169125813 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f0012db0 con 0x7f10fc0d30b0 2024-09-16T15:37:54.703 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.673+0000 7fe41cd91640 1 Processor -- start 2024-09-16T15:37:54.703 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.673+0000 7f9b24fb2640 1 -- 172.21.15.98:0/4055155904 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b200ccd00 msgr2=0x7f9b200af310 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-16T15:37:54.703 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.673+0000 7f9b1ffff640 1 --2- 172.21.15.98:0/4055155904 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b200ccd00 0x7f9b200af310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:54.703 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.673+0000 7f9b24fb2640 1 --2- 172.21.15.98:0/4055155904 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b200ccd00 0x7f9b200af310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:54.703 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.673+0000 7fcf8994b640 1 -- 172.21.15.98:0/1114247591 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf7c036550 msgr2=0x7fcf7c009a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:54.704 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.673+0000 7eff6ffff640 1 --2- 172.21.15.98:0/517574483 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff700a1810 0x7eff7015b3a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7eff5800c6d0 tx=0x7eff60032c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:54.704 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.673+0000 7f9b24fb2640 1 -- 172.21.15.98:0/4055155904 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b20072830 con 0x7f9b20070920 2024-09-16T15:37:54.704 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.673+0000 7fe41cd91640 1 -- start start 2024-09-16T15:37:54.704 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.673+0000 7fcf8994b640 1 --2- 172.21.15.98:0/1114247591 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf7c036550 0x7fcf7c009a80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcf84052430 tx=0x7fcf840a5cd0 comp rx=0 tx=0).stop 2024-09-16T15:37:54.705 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.673+0000 7f7cd20f2640 1 -- 172.21.15.98:0/1502919520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ccc15ec90 msgr2=0x7f7ccc145120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:54.705 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.673+0000 7eff6d7fa640 1 -- 172.21.15.98:0/517574483 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff60037050 con 0x7eff700a1810 2024-09-16T15:37:54.705 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.674+0000 7eff6d7fa640 1 -- 172.21.15.98:0/517574483 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7eff60043070 con 0x7eff700a1810 2024-09-16T15:37:54.705 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.674+0000 7eff6d7fa640 1 -- 172.21.15.98:0/517574483 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff60009450 con 0x7eff700a1810 2024-09-16T15:37:54.705 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.674+0000 7eff76e60640 1 -- 172.21.15.98:0/517574483 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff70161560 con 0x7eff700a1810 2024-09-16T15:37:54.706 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.674+0000 7fcf8994b640 1 -- 172.21.15.98:0/1114247591 shutdown_connections 2024-09-16T15:37:54.706 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.674+0000 7fcf8994b640 1 --2- 172.21.15.98:0/1114247591 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcf7c005a90 0x7fcf7c036010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:54.706 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.674+0000 7fcf8994b640 1 --2- 172.21.15.98:0/1114247591 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf7c036550 0x7fcf7c009a80 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:54.706 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.674+0000 7fcf8994b640 1 -- 172.21.15.98:0/1114247591 >> 172.21.15.98:0/1114247591 conn(0x7fcf7c054590 msgr2=0x7fcf7c054970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:54.706 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.673+0000 7f7cd20f2640 1 --2- 172.21.15.98:0/1502919520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ccc15ec90 0x7f7ccc145120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:54.706 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.674+0000 7f7cd20f2640 1 -- 172.21.15.98:0/1502919520 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7ccc073c20 msgr2=0x7f7ccc0c7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:54.706 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.674+0000 7f7cd20f2640 1 --2- 172.21.15.98:0/1502919520 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7ccc073c20 0x7f7ccc0c7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:54.706 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.674+0000 7f7cd20f2640 1 -- 172.21.15.98:0/1502919520 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ccc0c9980 con 0x7f7ccc073840 2024-09-16T15:37:54.706 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.673+0000 7feb1d577640 1 --2- 172.21.15.98:0/3026911518 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feb1813d200 0x7feb1813d670 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7feb0c00c3f0 tx=0x7feb0c00c7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:54.706 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.674+0000 7feb157fa640 1 -- 172.21.15.98:0/3026911518 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb0c017070 con 0x7feb1813d200 2024-09-16T15:37:54.707 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.674+0000 7feb157fa640 1 -- 172.21.15.98:0/3026911518 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feb0c0053c0 con 0x7feb1813d200 2024-09-16T15:37:54.707 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.674+0000 7feb157fa640 1 -- 172.21.15.98:0/3026911518 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb0c003850 con 0x7feb1813d200 2024-09-16T15:37:54.707 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.674+0000 7feb1efda640 1 -- 172.21.15.98:0/3026911518 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb181f8630 con 0x7feb1813d200 2024-09-16T15:37:54.707 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.674+0000 7f7cdeffd640 1 -- 172.21.15.98:0/2273382413 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7f7ce001a070 con 0x7f7ce80d2050 2024-09-16T15:37:54.707 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.674+0000 7f1102b5d640 1 -- 172.21.15.98:0/169125813 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f10dc001030 con 0x7f10fc0d30b0 2024-09-16T15:37:54.707 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.674+0000 7feb1efda640 1 -- 172.21.15.98:0/3026911518 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7feb181f4800 con 0x7feb1813d200 2024-09-16T15:37:54.708 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.674+0000 7f9b24fb2640 1 --2- 172.21.15.98:0/4055155904 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9b20070920 0x7f9b200b1080 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9b1000c400 tx=0x7f9b1000c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:54.708 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.674+0000 7fcf8994b640 1 -- 172.21.15.98:0/1114247591 shutdown_connections 2024-09-16T15:37:54.708 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.674+0000 7f7cd28f3640 1 --2- 172.21.15.98:0/1502919520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ccc15ec90 0x7f7ccc145120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T15:37:54.708 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.674+0000 7f7cd20f2640 1 --2- 172.21.15.98:0/1502919520 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7ccc073840 0x7f7ccc0ca120 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7cc8034040 tx=0x7f7cc8003890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:54.709 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.674+0000 7eff76e60640 1 -- 172.21.15.98:0/517574483 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff7015eb80 con 0x7eff700a1810 2024-09-16T15:37:54.709 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.675+0000 7f9b1d7fa640 1 -- 172.21.15.98:0/4055155904 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b10011790 con 0x7f9b20070920 2024-09-16T15:37:54.709 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.674+0000 7f7cdeffd640 1 --2- 172.21.15.98:0/2273382413 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f7ccc078920 0x7f7ccc07ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:54.709 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.675+0000 7f7cdeffd640 1 -- 172.21.15.98:0/2273382413 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f7ce0099de0 con 0x7f7ce80d2050 2024-09-16T15:37:54.709 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.675+0000 7f7cdeffd640 1 --2- 172.21.15.98:0/2273382413 >> [v2:172.21.15.98:6824/1967099790,v1:172.21.15.98:6825/1967099790] conn(0x7f7ccc080ba0 0x7f7ccc082fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:54.710 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.675+0000 7f7cdeffd640 1 -- 172.21.15.98:0/2273382413 --> [v2:172.21.15.98:6824/1967099790,v1:172.21.15.98:6825/1967099790] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7ce000de50 con 0x7f7ccc080ba0 2024-09-16T15:37:54.710 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.675+0000 7f7cdeffd640 1 -- 172.21.15.98:0/2273382413 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f7ce009c440 con 0x7f7ce80d2050 2024-09-16T15:37:54.710 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.675+0000 7feb1efda640 1 -- 172.21.15.98:0/3026911518 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7feb180b3040 con 0x7feb1813d200 2024-09-16T15:37:54.710 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.675+0000 7fe41cd91640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe41806f740 0x7fe41814eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:54.710 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.675+0000 7f7cee88c640 1 --2- 172.21.15.98:0/2273382413 >> [v2:172.21.15.98:6824/1967099790,v1:172.21.15.98:6825/1967099790] conn(0x7f7ccc080ba0 0x7f7ccc082fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:54.711 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.675+0000 7eff76e60640 1 -- 172.21.15.98:0/517574483 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7eff700cf2e0 con 0x7eff700a1810 2024-09-16T15:37:54.711 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.674+0000 7fcf8994b640 1 -- 172.21.15.98:0/1114247591 wait complete. 2024-09-16T15:37:54.711 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.675+0000 7f9b1d7fa640 1 -- 172.21.15.98:0/4055155904 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9b10017070 con 0x7f9b20070920 2024-09-16T15:37:54.711 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.675+0000 7f9b27216640 1 -- 172.21.15.98:0/4055155904 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b200afa40 con 0x7f9b20070920 2024-09-16T15:37:54.711 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.675+0000 7f9b1d7fa640 1 -- 172.21.15.98:0/4055155904 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b10011790 con 0x7f9b20070920 2024-09-16T15:37:54.712 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.676+0000 7f10f97fa640 1 -- 172.21.15.98:0/169125813 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7f10f0019020 con 0x7f10fc0d30b0 2024-09-16T15:37:54.712 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.676+0000 7f7cc2ffd640 1 -- 172.21.15.98:0/1502919520 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc803e030 con 0x7f7ccc073840 2024-09-16T15:37:54.712 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.676+0000 7f7cc2ffd640 1 -- 172.21.15.98:0/1502919520 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7cc8003d80 con 0x7f7ccc073840 2024-09-16T15:37:54.712 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.676+0000 7f7cc2ffd640 1 -- 172.21.15.98:0/1502919520 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc8035040 con 0x7f7ccc073840 2024-09-16T15:37:54.712 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.676+0000 7f7cd4356640 1 -- 172.21.15.98:0/1502919520 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ccc159450 con 0x7f7ccc073840 2024-09-16T15:37:54.712 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.676+0000 7f7cd4356640 1 -- 172.21.15.98:0/1502919520 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ccc159170 con 0x7f7ccc073840 2024-09-16T15:37:54.713 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.676+0000 7f7cee88c640 1 --2- 172.21.15.98:0/2273382413 >> [v2:172.21.15.98:6824/1967099790,v1:172.21.15.98:6825/1967099790] conn(0x7f7ccc080ba0 0x7f7ccc082fc0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:54.713 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.676+0000 7f10f97fa640 1 --2- 172.21.15.98:0/169125813 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f10e8078920 0x7f10e807ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:54.713 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.676+0000 7f9b27216640 1 -- 172.21.15.98:0/4055155904 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b20072db0 con 0x7f9b20070920 2024-09-16T15:37:54.714 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.677+0000 7eff6d7fa640 1 -- 172.21.15.98:0/517574483 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7eff6003c850 con 0x7eff700a1810 2024-09-16T15:37:54.714 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.676+0000 7fcf8994b640 1 Processor -- start 2024-09-16T15:37:54.714 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.677+0000 7f10fbfff640 1 --2- 172.21.15.98:0/169125813 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f10e8078920 0x7f10e807ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:54.714 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.677+0000 7f10f97fa640 1 -- 172.21.15.98:0/169125813 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f10f009a7e0 con 0x7f10fc0d30b0 2024-09-16T15:37:54.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.677+0000 7fcf8994b640 1 -- start start 2024-09-16T15:37:54.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.677+0000 7f7cdeffd640 1 -- 172.21.15.98:0/2273382413 <== osd.0 v2:172.21.15.98:6824/1967099790 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7ce000de50 con 0x7f7ccc080ba0 2024-09-16T15:37:54.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.677+0000 7f7cee08b640 1 --2- 172.21.15.98:0/2273382413 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f7ccc078920 0x7f7ccc07ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:54.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.677+0000 7f7cd4356640 1 -- 172.21.15.98:0/1502919520 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7ccc15f450 con 0x7f7ccc073840 2024-09-16T15:37:54.716 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.677+0000 7f10fbfff640 1 --2- 172.21.15.98:0/169125813 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f10e8078920 0x7f10e807ade0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f10f4035000 tx=0x7f10f403b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:54.716 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.677+0000 7eff6d7fa640 1 --2- 172.21.15.98:0/517574483 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7eff5c078920 0x7eff5c07ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:54.716 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.677+0000 7eff6d7fa640 1 -- 172.21.15.98:0/517574483 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7eff600bb450 con 0x7eff700a1810 2024-09-16T15:37:54.716 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.678+0000 7eff6d7fa640 1 --2- 172.21.15.98:0/517574483 >> [v2:172.21.15.98:6808/3571460482,v1:172.21.15.98:6809/3571460482] conn(0x7eff5c080b40 0x7eff5c082f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:54.716 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.678+0000 7eff6d7fa640 1 -- 172.21.15.98:0/517574483 --> [v2:172.21.15.98:6808/3571460482,v1:172.21.15.98:6809/3571460482] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7eff60039e50 con 0x7eff5c080b40 2024-09-16T15:37:54.716 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.678+0000 7eff6d7fa640 1 -- 172.21.15.98:0/517574483 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7eff600bb840 con 0x7eff700a1810 2024-09-16T15:37:54.716 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.677+0000 7f10f97fa640 1 --2- 172.21.15.98:0/169125813 >> [v2:172.21.15.98:6800/2573210695,v1:172.21.15.98:6801/2573210695] conn(0x7f10e8080ac0 0x7f10e8082ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:54.717 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.678+0000 7f10f97fa640 1 -- 172.21.15.98:0/169125813 --> [v2:172.21.15.98:6800/2573210695,v1:172.21.15.98:6801/2573210695] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f10f000ee50 con 0x7f10e8080ac0 2024-09-16T15:37:54.717 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.678+0000 7f10f97fa640 1 -- 172.21.15.98:0/169125813 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f10f00a1050 con 0x7f10fc0d30b0 2024-09-16T15:37:54.717 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.677+0000 7feb157fa640 1 -- 172.21.15.98:0/3026911518 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7feb0c01a070 con 0x7feb1813d200 2024-09-16T15:37:54.717 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.677+0000 7feb157fa640 1 --2- 172.21.15.98:0/3026911518 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7feb04078920 0x7feb0407ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:54.717 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.678+0000 7feb157fa640 1 -- 172.21.15.98:0/3026911518 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7feb0c099eb0 con 0x7feb1813d200 2024-09-16T15:37:54.717 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.678+0000 7feb157fa640 1 --2- 172.21.15.98:0/3026911518 >> [v2:172.21.15.135:6826/2559837727,v1:172.21.15.135:6827/2559837727] conn(0x7feb04080ba0 0x7feb04082fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:54.717 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.678+0000 7feb157fa640 1 -- 172.21.15.98:0/3026911518 --> [v2:172.21.15.135:6826/2559837727,v1:172.21.15.135:6827/2559837727] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7feb0c039e50 con 0x7feb04080ba0 2024-09-16T15:37:54.717 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.678+0000 7feb157fa640 1 -- 172.21.15.98:0/3026911518 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7feb0c09a2a0 con 0x7feb1813d200 2024-09-16T15:37:54.718 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.677+0000 7f9b1d7fa640 1 -- 172.21.15.98:0/4055155904 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7f9b10011a80 con 0x7f9b20070920 2024-09-16T15:37:54.718 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.676+0000 7fe41cd91640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe4180ce7e0 0x7fe41814bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:54.718 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.678+0000 7eff74bfc640 1 --2- 172.21.15.98:0/517574483 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7eff5c078920 0x7eff5c07ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:54.718 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.678+0000 7f11010fa640 1 --2- 172.21.15.98:0/169125813 >> [v2:172.21.15.98:6800/2573210695,v1:172.21.15.98:6801/2573210695] conn(0x7f10e8080ac0 0x7f10e8082ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:54.719 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.676+0000 7fe41cd91640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4180d1620 0x7fe4180c9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:54.719 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.676+0000 7fe41cd91640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe418073da0 con 0x7fe41806f740 2024-09-16T15:37:54.719 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.678+0000 7f9b1d7fa640 1 --2- 172.21.15.98:0/4055155904 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f9b0c078a80 0x7f9b0c07af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:54.719 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.676+0000 7fe41cd91640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe418073c20 con 0x7fe4180d1620 2024-09-16T15:37:54.720 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.678+0000 7f9b1d7fa640 1 -- 172.21.15.98:0/4055155904 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f9b10099f60 con 0x7f9b20070920 2024-09-16T15:37:54.720 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.678+0000 7fcf8994b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf7c005a90 0x7fcf7c0e1c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:54.720 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.678+0000 7fcf8994b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf7c01c8c0 0x7fcf7c0dda60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:54.720 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.678+0000 7fcf8994b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcf7c036550 0x7fcf7c179c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:54.720 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.678+0000 7eff753fd640 1 --2- 172.21.15.98:0/517574483 >> [v2:172.21.15.98:6808/3571460482,v1:172.21.15.98:6809/3571460482] conn(0x7eff5c080b40 0x7eff5c082f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:54.721 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.678+0000 7fcf8994b640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fcf7c00a430 con 0x7fcf7c005a90 2024-09-16T15:37:54.721 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.678+0000 7fcf8994b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fcf7c00a2b0 con 0x7fcf7c01c8c0 2024-09-16T15:37:54.721 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.678+0000 7fcf8994b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fcf7c00a5b0 con 0x7fcf7c036550 2024-09-16T15:37:54.721 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.678+0000 7feb17fff640 1 --2- 172.21.15.98:0/3026911518 >> [v2:172.21.15.135:6826/2559837727,v1:172.21.15.135:6827/2559837727] conn(0x7feb04080ba0 0x7feb04082fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:54.721 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.678+0000 7feb1cd76640 1 --2- 172.21.15.98:0/3026911518 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7feb04078920 0x7feb0407ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:54.722 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.676+0000 7fe41cd91640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fe418073f20 con 0x7fe4180ce7e0 2024-09-16T15:37:54.722 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.677+0000 7fe4177fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe41806f740 0x7fe41814eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:54.722 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.677+0000 7fe416ffd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe4180ce7e0 0x7fe41814bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:54.722 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.677+0000 7fe416ffd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe4180ce7e0 0x7fe41814bb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.98:34914/0 (socket says 172.21.15.98:34914) 2024-09-16T15:37:54.722 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.677+0000 7fe416ffd640 1 -- 172.21.15.98:0/1184433443 learned_addr learned my addr 172.21.15.98:0/1184433443 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:37:54.722 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.678+0000 7fe417fff640 1 --2- 172.21.15.98:0/1184433443 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4180d1620 0x7fe4180c9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:54.722 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.678+0000 7fe416ffd640 1 -- 172.21.15.98:0/1184433443 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4180d1620 msgr2=0x7fe4180c9bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:54.722 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.678+0000 7fe416ffd640 1 --2- 172.21.15.98:0/1184433443 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4180d1620 0x7fe4180c9bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:54.722 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.678+0000 7fe416ffd640 1 -- 172.21.15.98:0/1184433443 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe41806f740 msgr2=0x7fe41814eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:54.722 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.678+0000 7fe416ffd640 1 --2- 172.21.15.98:0/1184433443 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe41806f740 0x7fe41814eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:54.722 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.678+0000 7fe416ffd640 1 -- 172.21.15.98:0/1184433443 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4180ca4d0 con 0x7fe4180ce7e0 2024-09-16T15:37:54.722 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.679+0000 7fe416ffd640 1 --2- 172.21.15.98:0/1184433443 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe4180ce7e0 0x7fe41814bb30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe40c001c20 tx=0x7fe40c014420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:54.723 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.679+0000 7f9b1ffff640 1 --2- 172.21.15.98:0/4055155904 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f9b0c078a80 0x7f9b0c07af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:54.723 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.679+0000 7f9b27216640 1 --2- 172.21.15.98:0/4055155904 >> [v2:172.21.15.135:6810/724302036,v1:172.21.15.135:6811/724302036] conn(0x7f9b2013fef0 0x7f9b200cecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:54.723 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.679+0000 7f9b27216640 1 -- 172.21.15.98:0/4055155904 --> [v2:172.21.15.135:6810/724302036,v1:172.21.15.135:6811/724302036] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9b2006f850 con 0x7f9b2013fef0 2024-09-16T15:37:54.723 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.678+0000 7fcf82ffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf7c005a90 0x7fcf7c0e1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:54.723 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.678+0000 7fcf82ffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf7c005a90 0x7fcf7c0e1c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59694/0 (socket says 172.21.15.98:59694) 2024-09-16T15:37:54.723 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.678+0000 7fcf82ffd640 1 -- 172.21.15.98:0/1435624545 learned_addr learned my addr 172.21.15.98:0/1435624545 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:37:54.723 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.678+0000 7fcf837fe640 1 --2- 172.21.15.98:0/1435624545 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcf7c036550 0x7fcf7c179c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:54.724 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.679+0000 7fcf827fc640 1 --2- 172.21.15.98:0/1435624545 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf7c01c8c0 0x7fcf7c0dda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:54.724 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.679+0000 7feb17fff640 1 --2- 172.21.15.98:0/3026911518 >> [v2:172.21.15.135:6826/2559837727,v1:172.21.15.135:6827/2559837727] conn(0x7feb04080ba0 0x7feb04082fc0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:54.724 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.679+0000 7fe3fffff640 1 -- 172.21.15.98:0/1184433443 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe40c001d10 con 0x7fe4180ce7e0 2024-09-16T15:37:54.724 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.679+0000 7eff753fd640 1 --2- 172.21.15.98:0/517574483 >> [v2:172.21.15.98:6808/3571460482,v1:172.21.15.98:6809/3571460482] conn(0x7eff5c080b40 0x7eff5c082f60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:54.725 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.679+0000 7fe41cd91640 1 -- 172.21.15.98:0/1184433443 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4180ca7b0 con 0x7fe4180ce7e0 2024-09-16T15:37:54.725 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.679+0000 7f7cee08b640 1 --2- 172.21.15.98:0/2273382413 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f7ccc078920 0x7f7ccc07ade0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7cd8009830 tx=0x7f7cd8004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:54.725 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.679+0000 7fcf82ffd640 1 -- 172.21.15.98:0/1435624545 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcf7c036550 msgr2=0x7fcf7c179c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:54.725 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.679+0000 7fcf82ffd640 1 --2- 172.21.15.98:0/1435624545 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcf7c036550 0x7fcf7c179c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:54.725 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.679+0000 7fcf82ffd640 1 -- 172.21.15.98:0/1435624545 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf7c01c8c0 msgr2=0x7fcf7c0dda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:54.725 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.679+0000 7fcf82ffd640 1 --2- 172.21.15.98:0/1435624545 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf7c01c8c0 0x7fcf7c0dda60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:54.726 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.679+0000 7fcf82ffd640 1 -- 172.21.15.98:0/1435624545 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf7c17b6f0 con 0x7fcf7c005a90 2024-09-16T15:37:54.726 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.679+0000 7feb1cd76640 1 --2- 172.21.15.98:0/3026911518 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7feb04078920 0x7feb0407ade0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7feb1815ad20 tx=0x7feb10038040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:54.726 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.679+0000 7fcf837fe640 1 --2- 172.21.15.98:0/1435624545 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcf7c036550 0x7fcf7c179c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T15:37:54.726 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.679+0000 7fe41cd91640 1 -- 172.21.15.98:0/1184433443 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4180cad70 con 0x7fe4180ce7e0 2024-09-16T15:37:54.726 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.679+0000 7fe3fffff640 1 -- 172.21.15.98:0/1184433443 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe40c014d40 con 0x7fe4180ce7e0 2024-09-16T15:37:54.727 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.680+0000 7fcf82ffd640 1 --2- 172.21.15.98:0/1435624545 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf7c005a90 0x7fcf7c0e1c60 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fcf7400c410 tx=0x7fcf7400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:54.727 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.680+0000 7fcf6bfff640 1 -- 172.21.15.98:0/1435624545 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf74011790 con 0x7fcf7c005a90 2024-09-16T15:37:54.727 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.679+0000 7f7cc2ffd640 1 -- 172.21.15.98:0/1502919520 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7f7cc8041030 con 0x7f7ccc073840 2024-09-16T15:37:54.727 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.680+0000 7feb157fa640 1 -- 172.21.15.98:0/3026911518 <== osd.7 v2:172.21.15.135:6826/2559837727 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7feb0c039e50 con 0x7feb04080ba0 2024-09-16T15:37:54.728 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.680+0000 7fcf6bfff640 1 -- 172.21.15.98:0/1435624545 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcf74017070 con 0x7fcf7c005a90 2024-09-16T15:37:54.728 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.680+0000 7fcf6bfff640 1 -- 172.21.15.98:0/1435624545 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf74011ce0 con 0x7fcf7c005a90 2024-09-16T15:37:54.728 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.680+0000 7f9b1ffff640 1 --2- 172.21.15.98:0/4055155904 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f9b0c078a80 0x7f9b0c07af40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9b18034000 tx=0x7f9b18004ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:54.728 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.680+0000 7f7cc2ffd640 1 --2- 172.21.15.98:0/1502919520 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f7cb00788a0 0x7f7cb007ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:54.728 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.680+0000 7fcf8994b640 1 -- 172.21.15.98:0/1435624545 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf7c0e01a0 con 0x7fcf7c005a90 2024-09-16T15:37:54.729 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.680+0000 7f7cc2ffd640 1 -- 172.21.15.98:0/1502919520 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f7cc80bb4f0 con 0x7f7ccc073840 2024-09-16T15:37:54.729 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.680+0000 7f11010fa640 1 --2- 172.21.15.98:0/169125813 >> [v2:172.21.15.98:6800/2573210695,v1:172.21.15.98:6801/2573210695] conn(0x7f10e8080ac0 0x7f10e8082ee0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:54.729 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.680+0000 7f7cd18f1640 1 --2- 172.21.15.98:0/1502919520 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f7cb00788a0 0x7f7cb007ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:54.729 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.681+0000 7fe3fffff640 1 -- 172.21.15.98:0/1184433443 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe40c010a90 con 0x7fe4180ce7e0 2024-09-16T15:37:54.730 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.679+0000 7eff74bfc640 1 --2- 172.21.15.98:0/517574483 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7eff5c078920 0x7eff5c07ade0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7eff68006fd0 tx=0x7eff68006aa0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:54.730 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.681+0000 7f7cc2ffd640 1 --2- 172.21.15.98:0/1502919520 >> [v2:172.21.15.135:6818/3376376340,v1:172.21.15.135:6819/3376376340] conn(0x7f7cb0080aa0 0x7f7cb0082ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:54.730 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.681+0000 7f7cc2ffd640 1 -- 172.21.15.98:0/1502919520 --> [v2:172.21.15.135:6818/3376376340,v1:172.21.15.135:6819/3376376340] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7cb0083570 con 0x7f7cb0080aa0 2024-09-16T15:37:54.730 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.681+0000 7f7cc2ffd640 1 -- 172.21.15.98:0/1502919520 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f7cc80bb8a0 con 0x7f7ccc073840 2024-09-16T15:37:54.730 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.681+0000 7eff6d7fa640 1 -- 172.21.15.98:0/517574483 <== osd.1 v2:172.21.15.98:6808/3571460482 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7eff60039e50 con 0x7eff5c080b40 2024-09-16T15:37:54.731 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.681+0000 7f7cd28f3640 1 --2- 172.21.15.98:0/1502919520 >> [v2:172.21.15.135:6818/3376376340,v1:172.21.15.135:6819/3376376340] conn(0x7f7cb0080aa0 0x7f7cb0082ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:54.731 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.681+0000 7fcf8994b640 1 -- 172.21.15.98:0/1435624545 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf7c0dccf0 con 0x7fcf7c005a90 2024-09-16T15:37:54.731 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.681+0000 7f9b257b3640 1 --2- 172.21.15.98:0/4055155904 >> [v2:172.21.15.135:6810/724302036,v1:172.21.15.135:6811/724302036] conn(0x7f9b2013fef0 0x7f9b200cecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:54.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.681+0000 7fe41cd91640 1 -- 172.21.15.98:0/1184433443 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe3f8001030 con 0x7fe4180ce7e0 2024-09-16T15:37:54.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.682+0000 7fcf69ffb640 1 -- 172.21.15.98:0/1435624545 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcf5c001030 con 0x7fcf7c005a90 2024-09-16T15:37:54.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.682+0000 7f9b257b3640 1 --2- 172.21.15.98:0/4055155904 >> [v2:172.21.15.135:6810/724302036,v1:172.21.15.135:6811/724302036] conn(0x7f9b2013fef0 0x7f9b200cecd0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:54.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.682+0000 7f7cd28f3640 1 --2- 172.21.15.98:0/1502919520 >> [v2:172.21.15.135:6818/3376376340,v1:172.21.15.135:6819/3376376340] conn(0x7f7cb0080aa0 0x7f7cb0082ec0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:54.733 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.682+0000 7f7cd18f1640 1 --2- 172.21.15.98:0/1502919520 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f7cb00788a0 0x7f7cb007ad60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7cbc005fd0 tx=0x7f7cbc00b410 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:54.733 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.682+0000 7fe3fffff640 1 -- 172.21.15.98:0/1184433443 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7fe40c010cf0 con 0x7fe4180ce7e0 2024-09-16T15:37:54.733 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.682+0000 7f10f97fa640 1 -- 172.21.15.98:0/169125813 <== osd.2 v2:172.21.15.98:6800/2573210695 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f10f000ee50 con 0x7f10e8080ac0 2024-09-16T15:37:54.733 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.683+0000 7fcf6bfff640 1 -- 172.21.15.98:0/1435624545 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7fcf7401c460 con 0x7fcf7c005a90 2024-09-16T15:37:54.734 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.683+0000 7f9b1d7fa640 1 -- 172.21.15.98:0/4055155904 <== osd.4 v2:172.21.15.135:6810/724302036 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9b2006f850 con 0x7f9b2013fef0 2024-09-16T15:37:54.734 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.683+0000 7fe3fffff640 1 --2- 172.21.15.98:0/1184433443 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fe404078850 0x7fe40407ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:54.734 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.683+0000 7fe3fffff640 1 -- 172.21.15.98:0/1184433443 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fe40c0a2bc0 con 0x7fe4180ce7e0 2024-09-16T15:37:54.734 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.683+0000 7fcf6bfff640 1 --2- 172.21.15.98:0/1435624545 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fcf70078850 0x7fcf7007ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:54.735 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.683+0000 7fe4177fe640 1 --2- 172.21.15.98:0/1184433443 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fe404078850 0x7fe40407ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:54.735 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.683+0000 7fe3fffff640 1 --2- 172.21.15.98:0/1184433443 >> [v2:172.21.15.98:6816/3951374837,v1:172.21.15.98:6817/3951374837] conn(0x7fe4040809f0 0x7fe404082e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:54.735 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.683+0000 7fe3fffff640 1 -- 172.21.15.98:0/1184433443 --> [v2:172.21.15.98:6816/3951374837,v1:172.21.15.98:6817/3951374837] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe40c014d40 con 0x7fe4040809f0 2024-09-16T15:37:54.735 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.684+0000 7fcf6bfff640 1 -- 172.21.15.98:0/1435624545 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fcf7409a670 con 0x7fcf7c005a90 2024-09-16T15:37:54.736 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.683+0000 7fe3fffff640 1 -- 172.21.15.98:0/1184433443 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fe40c0a9050 con 0x7fe4180ce7e0 2024-09-16T15:37:54.736 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.684+0000 7fe417fff640 1 --2- 172.21.15.98:0/1184433443 >> [v2:172.21.15.98:6816/3951374837,v1:172.21.15.98:6817/3951374837] conn(0x7fe4040809f0 0x7fe404082e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:54.736 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.684+0000 7fcf6bfff640 1 --2- 172.21.15.98:0/1435624545 >> [v2:172.21.15.135:6802/3083482635,v1:172.21.15.135:6803/3083482635] conn(0x7fcf70080a50 0x7fcf70082e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:54.736 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.684+0000 7fcf6bfff640 1 -- 172.21.15.98:0/1435624545 --> [v2:172.21.15.135:6802/3083482635,v1:172.21.15.135:6803/3083482635] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcf74009e50 con 0x7fcf70080a50 2024-09-16T15:37:54.736 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.684+0000 7fcf6bfff640 1 -- 172.21.15.98:0/1435624545 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fcf740a1050 con 0x7fcf7c005a90 2024-09-16T15:37:54.737 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.684+0000 7fcf827fc640 1 --2- 172.21.15.98:0/1435624545 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fcf70078850 0x7fcf7007ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:54.737 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.684+0000 7fe417fff640 1 --2- 172.21.15.98:0/1184433443 >> [v2:172.21.15.98:6816/3951374837,v1:172.21.15.98:6817/3951374837] conn(0x7fe4040809f0 0x7fe404082e10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:54.737 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.684+0000 7f7cc2ffd640 1 -- 172.21.15.98:0/1502919520 <== osd.6 v2:172.21.15.135:6818/3376376340 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7cb0083570 con 0x7f7cb0080aa0 2024-09-16T15:37:54.737 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.684+0000 7fcf837fe640 1 --2- 172.21.15.98:0/1435624545 >> [v2:172.21.15.135:6802/3083482635,v1:172.21.15.135:6803/3083482635] conn(0x7fcf70080a50 0x7fcf70082e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:54.738 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.685+0000 7fe4177fe640 1 --2- 172.21.15.98:0/1184433443 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fe404078850 0x7fe40407ad10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe408034000 tx=0x7fe40800b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:54.738 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.685+0000 7fcf827fc640 1 --2- 172.21.15.98:0/1435624545 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fcf70078850 0x7fcf7007ad10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c0e21a0 tx=0x7fcf78005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:54.738 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.685+0000 7fcf837fe640 1 --2- 172.21.15.98:0/1435624545 >> [v2:172.21.15.135:6802/3083482635,v1:172.21.15.135:6803/3083482635] conn(0x7fcf70080a50 0x7fcf70082e70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:54.738 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.686+0000 7fe3fffff640 1 -- 172.21.15.98:0/1184433443 <== osd.3 v2:172.21.15.98:6816/3951374837 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe40c014d40 con 0x7fe4040809f0 2024-09-16T15:37:54.739 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.686+0000 7fcf6bfff640 1 -- 172.21.15.98:0/1435624545 <== osd.5 v2:172.21.15.135:6802/3083482635 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcf74009e50 con 0x7fcf70080a50 2024-09-16T15:37:54.739 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.706+0000 7f7cf02ef640 1 -- 172.21.15.98:0/2273382413 --> [v2:172.21.15.98:6824/1967099790,v1:172.21.15.98:6825/1967099790] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7ce80cfc80 con 0x7f7ccc080ba0 2024-09-16T15:37:54.739 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.707+0000 7f7cdeffd640 1 -- 172.21.15.98:0/2273382413 <== osd.0 v2:172.21.15.98:6824/1967099790 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7ce80cfc80 con 0x7f7ccc080ba0 2024-09-16T15:37:54.740 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.707+0000 7f7cdcff9640 1 -- 172.21.15.98:0/2273382413 >> [v2:172.21.15.98:6824/1967099790,v1:172.21.15.98:6825/1967099790] conn(0x7f7ccc080ba0 msgr2=0x7f7ccc082fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:54.741 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.707+0000 7f7cdcff9640 1 --2- 172.21.15.98:0/2273382413 >> [v2:172.21.15.98:6824/1967099790,v1:172.21.15.98:6825/1967099790] conn(0x7f7ccc080ba0 0x7f7ccc082fc0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:54.741 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.707+0000 7f7cdcff9640 1 -- 172.21.15.98:0/2273382413 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f7ccc078920 msgr2=0x7f7ccc07ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:54.741 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.708+0000 7f7cdcff9640 1 --2- 172.21.15.98:0/2273382413 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f7ccc078920 0x7f7ccc07ade0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7cd8009830 tx=0x7f7cd8004730 comp rx=0 tx=0).stop 2024-09-16T15:37:54.741 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.708+0000 7f7cdcff9640 1 -- 172.21.15.98:0/2273382413 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7ce80d2050 msgr2=0x7f7ce81f8180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:54.741 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.708+0000 7f7cdcff9640 1 --2- 172.21.15.98:0/2273382413 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7ce80d2050 0x7f7ce81f8180 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7ce000caf0 tx=0x7f7ce00020c0 comp rx=0 tx=0).stop 2024-09-16T15:37:54.741 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.708+0000 7f7cee88c640 1 -- 172.21.15.98:0/2273382413 reap_dead start 2024-09-16T15:37:54.741 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.709+0000 7f7cdcff9640 1 -- 172.21.15.98:0/2273382413 shutdown_connections 2024-09-16T15:37:54.741 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.709+0000 7f7cdcff9640 1 -- 172.21.15.98:0/2273382413 >> 172.21.15.98:0/2273382413 conn(0x7f7ce80d3fe0 msgr2=0x7f7ce81608c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:54.741 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.710+0000 7f7cdcff9640 1 -- 172.21.15.98:0/2273382413 shutdown_connections 2024-09-16T15:37:54.741 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.710+0000 7feb1efda640 1 -- 172.21.15.98:0/3026911518 --> [v2:172.21.15.135:6826/2559837727,v1:172.21.15.135:6827/2559837727] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7feb1813bdd0 con 0x7feb04080ba0 2024-09-16T15:37:54.742 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.710+0000 7f7cdcff9640 1 -- 172.21.15.98:0/2273382413 wait complete. 2024-09-16T15:37:54.742 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.711+0000 7eff76e60640 1 -- 172.21.15.98:0/517574483 --> [v2:172.21.15.98:6808/3571460482,v1:172.21.15.98:6809/3571460482] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7eff700d14f0 con 0x7eff5c080b40 2024-09-16T15:37:54.742 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.711+0000 7feb157fa640 1 -- 172.21.15.98:0/3026911518 <== osd.7 v2:172.21.15.135:6826/2559837727 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7feb1813bdd0 con 0x7feb04080ba0 2024-09-16T15:37:54.742 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.711+0000 7eff6d7fa640 1 -- 172.21.15.98:0/517574483 <== osd.1 v2:172.21.15.98:6808/3571460482 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7eff700d14f0 con 0x7eff5c080b40 2024-09-16T15:37:54.743 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.711+0000 7f7cd4356640 1 -- 172.21.15.98:0/1502919520 --> [v2:172.21.15.135:6818/3376376340,v1:172.21.15.135:6819/3376376340] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7ccc0c9d80 con 0x7f7cb0080aa0 2024-09-16T15:37:54.743 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.711+0000 7feafeffd640 1 -- 172.21.15.98:0/3026911518 >> [v2:172.21.15.135:6826/2559837727,v1:172.21.15.135:6827/2559837727] conn(0x7feb04080ba0 msgr2=0x7feb04082fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:54.744 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.712+0000 7feafeffd640 1 --2- 172.21.15.98:0/3026911518 >> [v2:172.21.15.135:6826/2559837727,v1:172.21.15.135:6827/2559837727] conn(0x7feb04080ba0 0x7feb04082fc0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:54.744 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.712+0000 7feafeffd640 1 -- 172.21.15.98:0/3026911518 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7feb04078920 msgr2=0x7feb0407ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:54.744 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.712+0000 7feafeffd640 1 --2- 172.21.15.98:0/3026911518 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7feb04078920 0x7feb0407ade0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7feb1815ad20 tx=0x7feb10038040 comp rx=0 tx=0).stop 2024-09-16T15:37:54.744 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.712+0000 7feafeffd640 1 -- 172.21.15.98:0/3026911518 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feb1813d200 msgr2=0x7feb1813d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:54.744 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.712+0000 7feafeffd640 1 --2- 172.21.15.98:0/3026911518 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7feb1813d200 0x7feb1813d670 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7feb0c00c3f0 tx=0x7feb0c00c7f0 comp rx=0 tx=0).stop 2024-09-16T15:37:54.745 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.712+0000 7eff76e60640 1 -- 172.21.15.98:0/517574483 >> [v2:172.21.15.98:6808/3571460482,v1:172.21.15.98:6809/3571460482] conn(0x7eff5c080b40 msgr2=0x7eff5c082f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:54.745 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.712+0000 7eff76e60640 1 --2- 172.21.15.98:0/517574483 >> [v2:172.21.15.98:6808/3571460482,v1:172.21.15.98:6809/3571460482] conn(0x7eff5c080b40 0x7eff5c082f60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:54.745 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.712+0000 7eff76e60640 1 -- 172.21.15.98:0/517574483 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7eff5c078920 msgr2=0x7eff5c07ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:54.745 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.712+0000 7eff76e60640 1 --2- 172.21.15.98:0/517574483 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7eff5c078920 0x7eff5c07ade0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7eff68006fd0 tx=0x7eff68006aa0 comp rx=0 tx=0).stop 2024-09-16T15:37:54.745 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.712+0000 7eff76e60640 1 -- 172.21.15.98:0/517574483 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff700a1810 msgr2=0x7eff7015b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:54.745 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.712+0000 7eff76e60640 1 --2- 172.21.15.98:0/517574483 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff700a1810 0x7eff7015b3a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7eff5800c6d0 tx=0x7eff60032c80 comp rx=0 tx=0).stop 2024-09-16T15:37:54.745 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.712+0000 7eff753fd640 1 -- 172.21.15.98:0/517574483 reap_dead start 2024-09-16T15:37:54.745 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.712+0000 7f7cc2ffd640 1 -- 172.21.15.98:0/1502919520 <== osd.6 v2:172.21.15.135:6818/3376376340 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7ccc0c9d80 con 0x7f7cb0080aa0 2024-09-16T15:37:54.746 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.712+0000 7eff76e60640 1 -- 172.21.15.98:0/517574483 shutdown_connections 2024-09-16T15:37:54.746 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.712+0000 7eff76e60640 1 -- 172.21.15.98:0/517574483 >> 172.21.15.98:0/517574483 conn(0x7eff700d3fc0 msgr2=0x7eff700b8e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:54.746 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.712+0000 7eff76e60640 1 -- 172.21.15.98:0/517574483 shutdown_connections 2024-09-16T15:37:54.746 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.713+0000 7eff76e60640 1 -- 172.21.15.98:0/517574483 wait complete. 2024-09-16T15:37:54.747 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.713+0000 7f7cd4356640 1 -- 172.21.15.98:0/1502919520 >> [v2:172.21.15.135:6818/3376376340,v1:172.21.15.135:6819/3376376340] conn(0x7f7cb0080aa0 msgr2=0x7f7cb0082ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:54.747 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.713+0000 7feb1d577640 1 -- 172.21.15.98:0/3026911518 reap_dead start 2024-09-16T15:37:54.747 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.713+0000 7feafeffd640 1 -- 172.21.15.98:0/3026911518 shutdown_connections 2024-09-16T15:37:54.747 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.713+0000 7feafeffd640 1 -- 172.21.15.98:0/3026911518 >> 172.21.15.98:0/3026911518 conn(0x7feb1806cd50 msgr2=0x7feb1815a220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:54.747 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.713+0000 7f7cd4356640 1 --2- 172.21.15.98:0/1502919520 >> [v2:172.21.15.135:6818/3376376340,v1:172.21.15.135:6819/3376376340] conn(0x7f7cb0080aa0 0x7f7cb0082ec0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:54.748 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.713+0000 7feafeffd640 1 -- 172.21.15.98:0/3026911518 shutdown_connections 2024-09-16T15:37:54.748 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.713+0000 7feafeffd640 1 -- 172.21.15.98:0/3026911518 wait complete. 2024-09-16T15:37:54.748 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.713+0000 7f7cd4356640 1 -- 172.21.15.98:0/1502919520 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f7cb00788a0 msgr2=0x7f7cb007ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:54.748 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.713+0000 7f7cd4356640 1 --2- 172.21.15.98:0/1502919520 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f7cb00788a0 0x7f7cb007ad60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7cbc005fd0 tx=0x7f7cbc00b410 comp rx=0 tx=0).stop 2024-09-16T15:37:54.748 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.713+0000 7f1102b5d640 1 -- 172.21.15.98:0/169125813 --> [v2:172.21.15.98:6800/2573210695,v1:172.21.15.98:6801/2573210695] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f10dc002dd0 con 0x7f10e8080ac0 2024-09-16T15:37:54.749 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.713+0000 7f7cd4356640 1 -- 172.21.15.98:0/1502919520 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7ccc073840 msgr2=0x7f7ccc0ca120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:54.749 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.713+0000 7f7cd4356640 1 --2- 172.21.15.98:0/1502919520 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7ccc073840 0x7f7ccc0ca120 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7cc8034040 tx=0x7f7cc8003890 comp rx=0 tx=0).stop 2024-09-16T15:37:54.749 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.713+0000 7f7cd28f3640 1 -- 172.21.15.98:0/1502919520 reap_dead start 2024-09-16T15:37:54.749 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.713+0000 7f7cd4356640 1 -- 172.21.15.98:0/1502919520 shutdown_connections 2024-09-16T15:37:54.749 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.713+0000 7f7cd4356640 1 -- 172.21.15.98:0/1502919520 >> 172.21.15.98:0/1502919520 conn(0x7f7ccc0d0cb0 msgr2=0x7f7ccc0b6470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:54.749 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.714+0000 7f7cd4356640 1 -- 172.21.15.98:0/1502919520 shutdown_connections 2024-09-16T15:37:54.750 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.714+0000 7f10f97fa640 1 -- 172.21.15.98:0/169125813 <== osd.2 v2:172.21.15.98:6800/2573210695 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f10dc002dd0 con 0x7f10e8080ac0 2024-09-16T15:37:54.750 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.714+0000 7f7cd4356640 1 -- 172.21.15.98:0/1502919520 wait complete. 2024-09-16T15:37:54.751 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.714+0000 7f1102b5d640 1 -- 172.21.15.98:0/169125813 >> [v2:172.21.15.98:6800/2573210695,v1:172.21.15.98:6801/2573210695] conn(0x7f10e8080ac0 msgr2=0x7f10e8082ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:54.751 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.714+0000 7f1102b5d640 1 --2- 172.21.15.98:0/169125813 >> [v2:172.21.15.98:6800/2573210695,v1:172.21.15.98:6801/2573210695] conn(0x7f10e8080ac0 0x7f10e8082ee0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:54.751 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.714+0000 7f1102b5d640 1 -- 172.21.15.98:0/169125813 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f10e8078920 msgr2=0x7f10e807ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:54.751 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.714+0000 7f1102b5d640 1 --2- 172.21.15.98:0/169125813 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f10e8078920 0x7f10e807ade0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f10f4035000 tx=0x7f10f403b040 comp rx=0 tx=0).stop 2024-09-16T15:37:54.751 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.714+0000 7f1102b5d640 1 -- 172.21.15.98:0/169125813 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f10fc0d30b0 msgr2=0x7f10fc1fcd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:54.751 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.714+0000 7f1102b5d640 1 --2- 172.21.15.98:0/169125813 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f10fc0d30b0 0x7f10fc1fcd90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f10f000c480 tx=0x7f10f000c940 comp rx=0 tx=0).stop 2024-09-16T15:37:54.751 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.714+0000 7f11010fa640 1 -- 172.21.15.98:0/169125813 reap_dead start 2024-09-16T15:37:54.751 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.715+0000 7f1102b5d640 1 -- 172.21.15.98:0/169125813 shutdown_connections 2024-09-16T15:37:54.751 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.715+0000 7f1102b5d640 1 -- 172.21.15.98:0/169125813 >> 172.21.15.98:0/169125813 conn(0x7f10fc0d0a40 msgr2=0x7f10fc0cf750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:54.751 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.716+0000 7f1102b5d640 1 -- 172.21.15.98:0/169125813 shutdown_connections 2024-09-16T15:37:54.752 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.715+0000 7f9b27216640 1 -- 172.21.15.98:0/4055155904 --> [v2:172.21.15.135:6810/724302036,v1:172.21.15.135:6811/724302036] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9b2013f9d0 con 0x7f9b2013fef0 2024-09-16T15:37:54.752 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.716+0000 7f1102b5d640 1 -- 172.21.15.98:0/169125813 wait complete. 2024-09-16T15:37:54.752 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.716+0000 7f9b1d7fa640 1 -- 172.21.15.98:0/4055155904 <== osd.4 v2:172.21.15.135:6810/724302036 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9b2013f9d0 con 0x7f9b2013fef0 2024-09-16T15:37:54.753 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.716+0000 7fcf69ffb640 1 -- 172.21.15.98:0/1435624545 --> [v2:172.21.15.135:6802/3083482635,v1:172.21.15.135:6803/3083482635] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fcf5c002dd0 con 0x7fcf70080a50 2024-09-16T15:37:54.753 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.716+0000 7f9b27216640 1 -- 172.21.15.98:0/4055155904 >> [v2:172.21.15.135:6810/724302036,v1:172.21.15.135:6811/724302036] conn(0x7f9b2013fef0 msgr2=0x7f9b200cecd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:54.753 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.716+0000 7f9b27216640 1 --2- 172.21.15.98:0/4055155904 >> [v2:172.21.15.135:6810/724302036,v1:172.21.15.135:6811/724302036] conn(0x7f9b2013fef0 0x7f9b200cecd0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:54.753 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.717+0000 7fe41cd91640 1 -- 172.21.15.98:0/1184433443 --> [v2:172.21.15.98:6816/3951374837,v1:172.21.15.98:6817/3951374837] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe3f8002dd0 con 0x7fe4040809f0 2024-09-16T15:37:54.754 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.717+0000 7fcf6bfff640 1 -- 172.21.15.98:0/1435624545 <== osd.5 v2:172.21.15.135:6802/3083482635 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fcf5c002dd0 con 0x7fcf70080a50 2024-09-16T15:37:54.754 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.717+0000 7f9b27216640 1 -- 172.21.15.98:0/4055155904 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f9b0c078a80 msgr2=0x7f9b0c07af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:54.754 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.717+0000 7f9b27216640 1 --2- 172.21.15.98:0/4055155904 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f9b0c078a80 0x7f9b0c07af40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9b18034000 tx=0x7f9b18004ab0 comp rx=0 tx=0).stop 2024-09-16T15:37:54.755 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.717+0000 7f9b27216640 1 -- 172.21.15.98:0/4055155904 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9b20070920 msgr2=0x7f9b200b1080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:54.755 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.717+0000 7f9b27216640 1 --2- 172.21.15.98:0/4055155904 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9b20070920 0x7f9b200b1080 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9b1000c400 tx=0x7f9b1000c8c0 comp rx=0 tx=0).stop 2024-09-16T15:37:54.755 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.717+0000 7f9b257b3640 1 -- 172.21.15.98:0/4055155904 reap_dead start 2024-09-16T15:37:54.755 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.717+0000 7f9b27216640 1 -- 172.21.15.98:0/4055155904 shutdown_connections 2024-09-16T15:37:54.755 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.717+0000 7f9b27216640 1 -- 172.21.15.98:0/4055155904 >> 172.21.15.98:0/4055155904 conn(0x7f9b200b1950 msgr2=0x7f9b20142a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:54.755 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.717+0000 7fe3fffff640 1 -- 172.21.15.98:0/1184433443 <== osd.3 v2:172.21.15.98:6816/3951374837 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe3f8002dd0 con 0x7fe4040809f0 2024-09-16T15:37:54.756 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.718+0000 7f9b27216640 1 -- 172.21.15.98:0/4055155904 shutdown_connections 2024-09-16T15:37:54.756 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.718+0000 7f9b27216640 1 -- 172.21.15.98:0/4055155904 wait complete. 2024-09-16T15:37:54.756 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.718+0000 7fe3fdffb640 1 -- 172.21.15.98:0/1184433443 >> [v2:172.21.15.98:6816/3951374837,v1:172.21.15.98:6817/3951374837] conn(0x7fe4040809f0 msgr2=0x7fe404082e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:54.756 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.718+0000 7fe3fdffb640 1 --2- 172.21.15.98:0/1184433443 >> [v2:172.21.15.98:6816/3951374837,v1:172.21.15.98:6817/3951374837] conn(0x7fe4040809f0 0x7fe404082e10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:54.756 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.718+0000 7fe3fdffb640 1 -- 172.21.15.98:0/1184433443 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fe404078850 msgr2=0x7fe40407ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:54.756 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.718+0000 7fe3fdffb640 1 --2- 172.21.15.98:0/1184433443 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fe404078850 0x7fe40407ad10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe408034000 tx=0x7fe40800b040 comp rx=0 tx=0).stop 2024-09-16T15:37:54.756 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.718+0000 7fe3fdffb640 1 -- 172.21.15.98:0/1184433443 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe4180ce7e0 msgr2=0x7fe41814bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:54.757 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.718+0000 7fe3fdffb640 1 --2- 172.21.15.98:0/1184433443 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe4180ce7e0 0x7fe41814bb30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe40c001c20 tx=0x7fe40c014420 comp rx=0 tx=0).stop 2024-09-16T15:37:54.757 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.718+0000 7fe417fff640 1 -- 172.21.15.98:0/1184433443 reap_dead start 2024-09-16T15:37:54.757 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.718+0000 7fe3fdffb640 1 -- 172.21.15.98:0/1184433443 shutdown_connections 2024-09-16T15:37:54.757 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.718+0000 7fe3fdffb640 1 -- 172.21.15.98:0/1184433443 >> 172.21.15.98:0/1184433443 conn(0x7fe4180d0b30 msgr2=0x7fe4180af890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:54.757 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.718+0000 7fcf8994b640 1 -- 172.21.15.98:0/1435624545 >> [v2:172.21.15.135:6802/3083482635,v1:172.21.15.135:6803/3083482635] conn(0x7fcf70080a50 msgr2=0x7fcf70082e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:54.757 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.718+0000 7fcf8994b640 1 --2- 172.21.15.98:0/1435624545 >> [v2:172.21.15.135:6802/3083482635,v1:172.21.15.135:6803/3083482635] conn(0x7fcf70080a50 0x7fcf70082e70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:54.757 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.718+0000 7fe3fdffb640 1 -- 172.21.15.98:0/1184433443 shutdown_connections 2024-09-16T15:37:54.758 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.718+0000 7fe3fdffb640 1 -- 172.21.15.98:0/1184433443 wait complete. 2024-09-16T15:37:54.758 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.719+0000 7fcf8994b640 1 -- 172.21.15.98:0/1435624545 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fcf70078850 msgr2=0x7fcf7007ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:54.759 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.719+0000 7fcf8994b640 1 --2- 172.21.15.98:0/1435624545 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fcf70078850 0x7fcf7007ad10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c0e21a0 tx=0x7fcf78005f90 comp rx=0 tx=0).stop 2024-09-16T15:37:54.759 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.719+0000 7fcf8994b640 1 -- 172.21.15.98:0/1435624545 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf7c005a90 msgr2=0x7fcf7c0e1c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:54.759 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.719+0000 7fcf8994b640 1 --2- 172.21.15.98:0/1435624545 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf7c005a90 0x7fcf7c0e1c60 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fcf7400c410 tx=0x7fcf7400c8d0 comp rx=0 tx=0).stop 2024-09-16T15:37:54.759 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.719+0000 7fcf837fe640 1 -- 172.21.15.98:0/1435624545 reap_dead start 2024-09-16T15:37:54.759 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.719+0000 7fcf8994b640 1 -- 172.21.15.98:0/1435624545 shutdown_connections 2024-09-16T15:37:54.759 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.719+0000 7fcf8994b640 1 -- 172.21.15.98:0/1435624545 >> 172.21.15.98:0/1435624545 conn(0x7fcf7c054590 msgr2=0x7fcf7c052620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:54.759 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.719+0000 7fcf8994b640 1 -- 172.21.15.98:0/1435624545 shutdown_connections 2024-09-16T15:37:54.759 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.719+0000 7fcf8994b640 1 -- 172.21.15.98:0/1435624545 wait complete. 2024-09-16T15:37:54.760 INFO:teuthology.orchestra.run.smithi098.stdout:64424509447 2024-09-16T15:37:54.760 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-16T15:37:54.761 INFO:teuthology.orchestra.run.smithi098.stdout:64424509449 2024-09-16T15:37:54.761 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-16T15:37:54.762 INFO:teuthology.orchestra.run.smithi098.stdout:64424509448 2024-09-16T15:37:54.762 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-16T15:37:54.763 INFO:teuthology.orchestra.run.smithi098.stdout:55834574855 2024-09-16T15:37:54.763 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-16T15:37:54.764 INFO:teuthology.orchestra.run.smithi098.stdout:64424509448 2024-09-16T15:37:54.764 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-16T15:37:54.765 INFO:teuthology.orchestra.run.smithi098.stdout:64424509449 2024-09-16T15:37:54.765 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-16T15:37:54.766 INFO:teuthology.orchestra.run.smithi098.stdout:64424509449 2024-09-16T15:37:54.766 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-16T15:37:54.767 INFO:teuthology.orchestra.run.smithi098.stdout:64424509448 2024-09-16T15:37:54.767 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-16T15:37:54.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.970+0000 7f0a9ffff640 1 -- 172.21.15.98:0/1278701567 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa0030dd0 con 0x7f0aa80b3b90 2024-09-16T15:37:54.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.971+0000 7f0aaf33d640 1 -- 172.21.15.98:0/1278701567 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0aa80b3b90 msgr2=0x7f0aa80b1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:54.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.971+0000 7f0aaf33d640 1 --2- 172.21.15.98:0/1278701567 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0aa80b3b90 0x7f0aa80b1a50 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0aa8073970 tx=0x7f0aa002a930 comp rx=0 tx=0).stop 2024-09-16T15:37:54.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.971+0000 7f0aaf33d640 1 -- 172.21.15.98:0/1278701567 shutdown_connections 2024-09-16T15:37:54.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.971+0000 7f0aaf33d640 1 --2- 172.21.15.98:0/1278701567 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0aa80b3b90 0x7f0aa80b1a50 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:54.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.971+0000 7f0aaf33d640 1 --2- 172.21.15.98:0/1278701567 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0aa80b0d60 0x7f0aa80b3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:54.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.971+0000 7f0aaf33d640 1 --2- 172.21.15.98:0/1278701567 >> v2:172.21.15.135:3300/0 conn(0x7f0aa80b3270 0x7f0aa80d28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:54.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.971+0000 7f0aaf33d640 1 -- 172.21.15.98:0/1278701567 >> 172.21.15.98:0/1278701567 conn(0x7f0aa80d1d80 msgr2=0x7f0aa80d2190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:54.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.971+0000 7f0aaf33d640 1 -- 172.21.15.98:0/1278701567 shutdown_connections 2024-09-16T15:37:54.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.972+0000 7efc01d9b640 1 -- 172.21.15.98:0/3139377549 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc040ae440 con 0x7efbfc054860 2024-09-16T15:37:54.975 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.972+0000 7f5ae2ffd640 1 -- 172.21.15.98:0/1921644355 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5adc02fdf0 con 0x7f5ae415df90 2024-09-16T15:37:54.975 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.971+0000 7f0aaf33d640 1 -- 172.21.15.98:0/1278701567 wait complete. 2024-09-16T15:37:54.976 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.972+0000 7f5aea394640 1 -- 172.21.15.98:0/1921644355 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ae415df90 msgr2=0x7f5ae40745c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:54.976 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.972+0000 7f5aea394640 1 --2- 172.21.15.98:0/1921644355 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ae415df90 0x7f5ae40745c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5adc005fd0 tx=0x7f5adc02a9f0 comp rx=0 tx=0).stop 2024-09-16T15:37:54.976 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.972+0000 7f5aea394640 1 -- 172.21.15.98:0/1921644355 shutdown_connections 2024-09-16T15:37:54.976 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.972+0000 7f5aea394640 1 --2- 172.21.15.98:0/1921644355 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5ae40710c0 0x7f5ae40cb310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:54.976 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.972+0000 7f5aea394640 1 --2- 172.21.15.98:0/1921644355 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ae415df90 0x7f5ae40745c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:54.976 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.972+0000 7f5aea394640 1 -- 172.21.15.98:0/1921644355 >> 172.21.15.98:0/1921644355 conn(0x7f5ae40b2850 msgr2=0x7f5ae40b2c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:54.976 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.972+0000 7f5aea394640 1 -- 172.21.15.98:0/1921644355 shutdown_connections 2024-09-16T15:37:54.976 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.973+0000 7efc08a02640 1 -- 172.21.15.98:0/3139377549 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efbfc054860 msgr2=0x7efbfc054c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:54.976 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.973+0000 7efc08a02640 1 --2- 172.21.15.98:0/3139377549 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efbfc054860 0x7efbfc054c40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7efc0407aef0 tx=0x7efc040a5d70 comp rx=0 tx=0).stop 2024-09-16T15:37:54.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.973+0000 7f5aea394640 1 -- 172.21.15.98:0/1921644355 wait complete. 2024-09-16T15:37:54.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.973+0000 7efc08a02640 1 -- 172.21.15.98:0/3139377549 shutdown_connections 2024-09-16T15:37:54.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.973+0000 7efc08a02640 1 --2- 172.21.15.98:0/3139377549 >> v2:172.21.15.135:3300/0 conn(0x7efbfc034650 0x7efbfc008d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:54.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.973+0000 7efc08a02640 1 --2- 172.21.15.98:0/3139377549 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efbfc054860 0x7efbfc054c40 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:54.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.973+0000 7efc08a02640 1 -- 172.21.15.98:0/3139377549 >> 172.21.15.98:0/3139377549 conn(0x7efbfc01e890 msgr2=0x7efbfc055640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:54.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.973+0000 7ff28af6b640 1 -- 172.21.15.98:0/4154262766 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff27c01c8c0 msgr2=0x7ff27c01cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:54.978 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.973+0000 7ff28af6b640 1 --2- 172.21.15.98:0/4154262766 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff27c01c8c0 0x7ff27c01cca0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff28406cae0 tx=0x7ff2840a5cc0 comp rx=0 tx=0).stop 2024-09-16T15:37:54.978 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.973+0000 7f0aaf33d640 1 Processor -- start 2024-09-16T15:37:54.978 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.973+0000 7ff28af6b640 1 -- 172.21.15.98:0/4154262766 shutdown_connections 2024-09-16T15:37:54.979 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.973+0000 7ff28af6b640 1 --2- 172.21.15.98:0/4154262766 >> v2:172.21.15.98:3300/0 conn(0x7ff27c036720 0x7ff27c009a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:54.979 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.973+0000 7ff28af6b640 1 --2- 172.21.15.98:0/4154262766 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff27c01c8c0 0x7ff27c01cca0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:54.979 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.973+0000 7ff28af6b640 1 -- 172.21.15.98:0/4154262766 >> 172.21.15.98:0/4154262766 conn(0x7ff27c054590 msgr2=0x7ff27c054970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:54.979 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.973+0000 7ff28af6b640 1 -- 172.21.15.98:0/4154262766 shutdown_connections 2024-09-16T15:37:54.979 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.973+0000 7ff28af6b640 1 -- 172.21.15.98:0/4154262766 wait complete. 2024-09-16T15:37:54.979 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.973+0000 7efc08a02640 1 -- 172.21.15.98:0/3139377549 shutdown_connections 2024-09-16T15:37:54.979 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.973+0000 7efc08a02640 1 -- 172.21.15.98:0/3139377549 wait complete. 2024-09-16T15:37:54.980 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.973+0000 7f5b67a16640 1 -- 172.21.15.98:0/38087139 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5b4c003aa0 msgr2=0x7f5b4c003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:54.980 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.974+0000 7f5b67a16640 1 --2- 172.21.15.98:0/38087139 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5b4c003aa0 0x7f5b4c003ec0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c006f80 tx=0x7f5b4c005830 comp rx=0 tx=0).stop 2024-09-16T15:37:54.980 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.973+0000 7f748b42b640 1 -- 172.21.15.98:0/1715833290 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74840d16d0 msgr2=0x7f74840d1b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:54.980 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.974+0000 7f0b89f0e640 1 -- 172.21.15.98:0/2196565188 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b8406aaf0 msgr2=0x7f0b840cc310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:54.980 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.973+0000 7f0aaf33d640 1 -- start start 2024-09-16T15:37:54.981 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.974+0000 7f0b89f0e640 1 --2- 172.21.15.98:0/2196565188 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b8406aaf0 0x7f0b840cc310 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0b8406e660 tx=0x7f0b7802a680 comp rx=0 tx=0).stop 2024-09-16T15:37:54.981 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.974+0000 7f0b89f0e640 1 -- 172.21.15.98:0/2196565188 shutdown_connections 2024-09-16T15:37:54.981 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.974+0000 7f0b89f0e640 1 --2- 172.21.15.98:0/2196565188 >> v2:172.21.15.98:3300/0 conn(0x7f0b8406ead0 0x7f0b840ced00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:54.981 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.974+0000 7f0b89f0e640 1 --2- 172.21.15.98:0/2196565188 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b8406aaf0 0x7f0b840cc310 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:54.981 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.974+0000 7f0b89f0e640 1 -- 172.21.15.98:0/2196565188 >> 172.21.15.98:0/2196565188 conn(0x7f0b840cffe0 msgr2=0x7f0b840d03f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:54.982 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.973+0000 7f748b42b640 1 --2- 172.21.15.98:0/1715833290 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74840d16d0 0x7f74840d1b10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f74840699d0 tx=0x7f748002a560 comp rx=0 tx=0).stop 2024-09-16T15:37:54.982 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.974+0000 7f748b42b640 1 -- 172.21.15.98:0/1715833290 shutdown_connections 2024-09-16T15:37:54.982 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.974+0000 7f748b42b640 1 --2- 172.21.15.98:0/1715833290 >> v2:172.21.15.98:3300/0 conn(0x7f74840d2050 0x7f748415e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:54.982 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.974+0000 7f748b42b640 1 --2- 172.21.15.98:0/1715833290 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74840d16d0 0x7f74840d1b10 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:54.982 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.974+0000 7f748b42b640 1 --2- 172.21.15.98:0/1715833290 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f74840cefc0 0x7f7484162490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:54.982 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.974+0000 7f748b42b640 1 -- 172.21.15.98:0/1715833290 >> 172.21.15.98:0/1715833290 conn(0x7f74840688b0 msgr2=0x7f7484068cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:54.982 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.974+0000 7f0b89f0e640 1 -- 172.21.15.98:0/2196565188 shutdown_connections 2024-09-16T15:37:54.983 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.974+0000 7f5aea394640 1 Processor -- start 2024-09-16T15:37:54.983 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.974+0000 7f0aaf33d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0aa80b0d60 0x7f0aa81fd060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:54.983 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.974+0000 7f5b67a16640 1 -- 172.21.15.98:0/38087139 shutdown_connections 2024-09-16T15:37:54.983 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.974+0000 7f5b67a16640 1 --2- 172.21.15.98:0/38087139 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5b4c003aa0 0x7f5b4c003ec0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:54.983 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.974+0000 7f5b67a16640 1 -- 172.21.15.98:0/38087139 >> 172.21.15.98:0/38087139 conn(0x7f5b6006cb70 msgr2=0x7f5b6006cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:54.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.974+0000 7f0aaf33d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0aa80b3270 0x7f0aa8151ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:54.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.975+0000 7f5aea394640 1 -- start start 2024-09-16T15:37:54.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.974+0000 7f748b42b640 1 -- 172.21.15.98:0/1715833290 shutdown_connections 2024-09-16T15:37:54.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.974+0000 7f748b42b640 1 -- 172.21.15.98:0/1715833290 wait complete. 2024-09-16T15:37:54.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.975+0000 7f0aaf33d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0aa80b3b90 0x7f0aa80caf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:54.985 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.975+0000 7f5b67a16640 1 -- 172.21.15.98:0/38087139 shutdown_connections 2024-09-16T15:37:54.985 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.975+0000 7f0aaf33d640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0aa80b23e0 con 0x7f0aa80b0d60 2024-09-16T15:37:54.985 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.974+0000 7f0b89f0e640 1 -- 172.21.15.98:0/2196565188 wait complete. 2024-09-16T15:37:54.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.975+0000 7f5b67a16640 1 -- 172.21.15.98:0/38087139 wait complete. 2024-09-16T15:37:54.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.976+0000 7f0b89f0e640 1 Processor -- start 2024-09-16T15:37:54.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.975+0000 7f0aaf33d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0aa80b2260 con 0x7f0aa80b3b90 2024-09-16T15:37:54.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.975+0000 7f0aaf33d640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f0aa80b2560 con 0x7f0aa80b3270 2024-09-16T15:37:54.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.976+0000 7f0aad8da640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0aa80b3b90 0x7f0aa80caf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:54.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.976+0000 7f0aad8da640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0aa80b3b90 0x7f0aa80caf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.98:32798/0 (socket says 172.21.15.98:32798) 2024-09-16T15:37:54.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.976+0000 7f0aad8da640 1 -- 172.21.15.98:0/2031206777 learned_addr learned my addr 172.21.15.98:0/2031206777 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:37:54.987 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.975+0000 7ff28af6b640 1 Processor -- start 2024-09-16T15:37:54.987 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.975+0000 7ff28af6b640 1 -- start start 2024-09-16T15:37:54.987 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.976+0000 7f0aad0d9640 1 --2- 172.21.15.98:0/2031206777 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0aa80b0d60 0x7f0aa81fd060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:54.987 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.976+0000 7f5aea394640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5ae40710c0 0x7f5ae40c6880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:54.987 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.976+0000 7f5aea394640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ae40d01f0 0x7f5ae4156b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:54.988 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.976+0000 7f9e4359e640 1 -- 172.21.15.98:0/2043005791 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e44159b70 msgr2=0x7f9e440725d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:54.988 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.976+0000 7f5aea394640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ae415df90 0x7f5ae41570a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:54.988 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.976+0000 7f9e4359e640 1 --2- 172.21.15.98:0/2043005791 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e44159b70 0x7f9e440725d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9e440cbb00 tx=0x7f9e3c02b4d0 comp rx=0 tx=0).stop 2024-09-16T15:37:54.988 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.976+0000 7f5b67a16640 1 Processor -- start 2024-09-16T15:37:54.989 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.976+0000 7f5ae8931640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ae415df90 0x7f5ae41570a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:54.989 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.977+0000 7efc08a02640 1 Processor -- start 2024-09-16T15:37:54.989 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.976+0000 7f5ae37fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ae40d01f0 0x7f5ae4156b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:54.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.977+0000 7f5b67a16640 1 -- start start 2024-09-16T15:37:54.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.977+0000 7ff28af6b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff27c005a90 0x7ff27c049080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:54.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.977+0000 7f9e4359e640 1 -- 172.21.15.98:0/2043005791 shutdown_connections 2024-09-16T15:37:54.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.977+0000 7f0aad0d9640 1 -- 172.21.15.98:0/2031206777 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0aa80b3270 msgr2=0x7f0aa8151ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:54.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.977+0000 7f0aad0d9640 1 --2- 172.21.15.98:0/2031206777 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0aa80b3270 0x7f0aa8151ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:54.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.977+0000 7efc08a02640 1 -- start start 2024-09-16T15:37:54.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.977+0000 7f9e4359e640 1 --2- 172.21.15.98:0/2043005791 >> v2:172.21.15.135:3300/0 conn(0x7f9e44159f50 0x7f9e440ca070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:54.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.977+0000 7f9e4359e640 1 --2- 172.21.15.98:0/2043005791 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e44159b70 0x7f9e440725d0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:54.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.977+0000 7f0aad0d9640 1 -- 172.21.15.98:0/2031206777 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0aa80b3b90 msgr2=0x7f0aa80caf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:54.992 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.977+0000 7f9e4359e640 1 -- 172.21.15.98:0/2043005791 >> 172.21.15.98:0/2043005791 conn(0x7f9e440b15f0 msgr2=0x7f9e440b19d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:54.992 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.977+0000 7f0aad0d9640 1 --2- 172.21.15.98:0/2031206777 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0aa80b3b90 0x7f0aa80caf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:54.992 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.977+0000 7ff28af6b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff27c01c8c0 0x7ff27c0dfca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:54.993 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.977+0000 7f0aad0d9640 1 -- 172.21.15.98:0/2031206777 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0aa81520e0 con 0x7f0aa80b0d60 2024-09-16T15:37:54.993 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.977+0000 7ff28af6b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff27c036720 0x7ff27c0e16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:54.993 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.976+0000 7f5ae8931640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ae415df90 0x7f5ae41570a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:32788/0 (socket says 172.21.15.98:32788) 2024-09-16T15:37:54.993 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.977+0000 7ff28af6b640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff27c009fc0 con 0x7ff27c01c8c0 2024-09-16T15:37:54.994 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.976+0000 7f748b42b640 1 Processor -- start 2024-09-16T15:37:54.994 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.976+0000 7f748b42b640 1 -- start start 2024-09-16T15:37:54.994 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.977+0000 7ff28af6b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff27c00bc40 con 0x7ff27c036720 2024-09-16T15:37:54.994 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.977+0000 7ff28af6b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff27c00a140 con 0x7ff27c005a90 2024-09-16T15:37:54.994 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.977+0000 7ff288d07640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff27c005a90 0x7ff27c049080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:54.995 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.976+0000 7f5ae37fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ae40d01f0 0x7f5ae4156b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.98:32804/0 (socket says 172.21.15.98:32804) 2024-09-16T15:37:54.995 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.977+0000 7f0aad0d9640 1 --2- 172.21.15.98:0/2031206777 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0aa80b0d60 0x7f0aa81fd060 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0a98009fd0 tx=0x7f0a9800b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:54.995 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.977+0000 7f5ae8931640 1 -- 172.21.15.98:0/1058346880 learned_addr learned my addr 172.21.15.98:0/1058346880 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:37:54.995 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.977+0000 7f5aea394640 1 -- 172.21.15.98:0/1058346880 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5ae406d280 con 0x7f5ae415df90 2024-09-16T15:37:54.995 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.977+0000 7f5aea394640 1 -- 172.21.15.98:0/1058346880 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5ae40ce560 con 0x7f5ae40d01f0 2024-09-16T15:37:54.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.977+0000 7f5aea394640 1 -- 172.21.15.98:0/1058346880 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f5ae406d400 con 0x7f5ae40710c0 2024-09-16T15:37:54.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.977+0000 7ff288d07640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff27c005a90 0x7ff27c049080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.98:39688/0 (socket says 172.21.15.98:39688) 2024-09-16T15:37:54.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.977+0000 7ff288d07640 1 -- 172.21.15.98:0/1592181633 learned_addr learned my addr 172.21.15.98:0/1592181633 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:37:54.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.977+0000 7ff289508640 1 --2- 172.21.15.98:0/1592181633 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff27c036720 0x7ff27c0e16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:54.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.976+0000 7f0b89f0e640 1 -- start start 2024-09-16T15:37:54.997 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.977+0000 7f748b42b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f74840cefc0 0x7f74841f8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:54.997 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.977+0000 7f748b42b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74840d16d0 0x7f74840b2450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:54.997 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.977+0000 7ff283fff640 1 --2- 172.21.15.98:0/1592181633 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff27c01c8c0 0x7ff27c0dfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:54.997 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.977+0000 7f0b89f0e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b8406aaf0 0x7f0b84150230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:54.997 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.977+0000 7f748b42b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f74840d2050 0x7f74840c9890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:54.998 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.977+0000 7ff289508640 1 -- 172.21.15.98:0/1592181633 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff27c005a90 msgr2=0x7ff27c049080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:54.998 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.977+0000 7ff289508640 1 --2- 172.21.15.98:0/1592181633 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff27c005a90 0x7ff27c049080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:54.998 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.977+0000 7f5ae3fff640 1 --2- 172.21.15.98:0/1058346880 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5ae40710c0 0x7f5ae40c6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:54.998 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.977+0000 7f0b89f0e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b8406ead0 0x7f0b8415c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:54.999 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.977+0000 7ff289508640 1 -- 172.21.15.98:0/1592181633 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff27c01c8c0 msgr2=0x7ff27c0dfca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:54.999 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.977+0000 7ff289508640 1 --2- 172.21.15.98:0/1592181633 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff27c01c8c0 0x7ff27c0dfca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:54.999 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.977+0000 7f748b42b640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f748415ed00 con 0x7f74840d2050 2024-09-16T15:37:54.999 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.977+0000 7f748b42b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f748415eb80 con 0x7f74840d16d0 2024-09-16T15:37:54.999 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.977+0000 7f748b42b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f748415ee80 con 0x7f74840cefc0 2024-09-16T15:37:54.999 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.978+0000 7ff289508640 1 -- 172.21.15.98:0/1592181633 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff27c0495c0 con 0x7ff27c036720 2024-09-16T15:37:55.000 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.977+0000 7f0b89f0e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b8406eeb0 0x7f0b8415cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:55.000 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.978+0000 7f74891c7640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f74840cefc0 0x7f74841f8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:55.000 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.978+0000 7f74899c8640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f74840d2050 0x7f74840c9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:55.000 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.978+0000 7f74891c7640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f74840cefc0 0x7f74841f8bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.98:39704/0 (socket says 172.21.15.98:39704) 2024-09-16T15:37:55.000 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.978+0000 7f74891c7640 1 -- 172.21.15.98:0/885199726 learned_addr learned my addr 172.21.15.98:0/885199726 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:37:55.000 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.978+0000 7f74889c6640 1 --2- 172.21.15.98:0/885199726 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74840d16d0 0x7f74840b2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:55.001 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.978+0000 7f9e4359e640 1 -- 172.21.15.98:0/2043005791 shutdown_connections 2024-09-16T15:37:55.001 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.978+0000 7f0a9dffb640 1 -- 172.21.15.98:0/2031206777 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a98015020 con 0x7f0aa80b0d60 2024-09-16T15:37:55.001 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.978+0000 7f9e4359e640 1 -- 172.21.15.98:0/2043005791 wait complete. 2024-09-16T15:37:55.002 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.977+0000 7f0b89f0e640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0b8415afd0 con 0x7f0b8406ead0 2024-09-16T15:37:55.002 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.978+0000 7f0a9dffb640 1 -- 172.21.15.98:0/2031206777 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0a98011920 con 0x7f0aa80b0d60 2024-09-16T15:37:55.002 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.978+0000 7f0a9dffb640 1 -- 172.21.15.98:0/2031206777 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a98011d70 con 0x7f0aa80b0d60 2024-09-16T15:37:55.002 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.978+0000 7ff289508640 1 --2- 172.21.15.98:0/1592181633 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff27c036720 0x7ff27c0e16f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff27c033fa0 tx=0x7ff27000ebd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:55.003 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.977+0000 7f0b89f0e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0b8415ae50 con 0x7f0b8406eeb0 2024-09-16T15:37:55.003 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.978+0000 7f5b67a16640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b4c003aa0 0x7f5b60141520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:55.003 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.977+0000 7f0b89f0e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f0b8415b150 con 0x7f0b8406aaf0 2024-09-16T15:37:55.004 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.978+0000 7f5b67a16640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5b600b1ea0 0x7f5b60142040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:55.004 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.978+0000 7f5b67a16640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b60142580 0x7f5b60142a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:55.004 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.978+0000 7f74891c7640 1 -- 172.21.15.98:0/885199726 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74840d16d0 msgr2=0x7f74840b2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:55.004 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.978+0000 7f74891c7640 1 --2- 172.21.15.98:0/885199726 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74840d16d0 0x7f74840b2450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:55.004 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.978+0000 7f74891c7640 1 -- 172.21.15.98:0/885199726 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f74840d2050 msgr2=0x7f74840c9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:55.005 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.978+0000 7f5b67a16640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5b60073190 con 0x7f5b4c003aa0 2024-09-16T15:37:55.005 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.978+0000 7f5b67a16640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5b60073010 con 0x7f5b60142580 2024-09-16T15:37:55.005 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.978+0000 7f5b67a16640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f5b60073310 con 0x7f5b600b1ea0 2024-09-16T15:37:55.005 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.978+0000 7f5b657b2640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b4c003aa0 0x7f5b60141520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:55.005 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.978+0000 7f5b657b2640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b4c003aa0 0x7f5b60141520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:32816/0 (socket says 172.21.15.98:32816) 2024-09-16T15:37:55.005 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.978+0000 7f5b657b2640 1 -- 172.21.15.98:0/3780492099 learned_addr learned my addr 172.21.15.98:0/3780492099 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:37:55.006 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.978+0000 7ff2817fa640 1 -- 172.21.15.98:0/1592181633 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff270018070 con 0x7ff27c036720 2024-09-16T15:37:55.006 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.978+0000 7f5ae3fff640 1 -- 172.21.15.98:0/1058346880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ae40d01f0 msgr2=0x7f5ae4156b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:55.006 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.978+0000 7f5ae3fff640 1 --2- 172.21.15.98:0/1058346880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ae40d01f0 0x7f5ae4156b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:55.006 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.978+0000 7f5ae3fff640 1 -- 172.21.15.98:0/1058346880 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ae415df90 msgr2=0x7f5ae41570a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:55.007 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.978+0000 7f5ae3fff640 1 --2- 172.21.15.98:0/1058346880 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ae415df90 0x7f5ae41570a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:55.007 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.978+0000 7f5ae3fff640 1 -- 172.21.15.98:0/1058346880 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ae40b3c80 con 0x7f5ae40710c0 2024-09-16T15:37:55.007 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.978+0000 7ff28af6b640 1 -- 172.21.15.98:0/1592181633 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff27c175550 con 0x7ff27c036720 2024-09-16T15:37:55.007 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.979+0000 7f5ae3fff640 1 --2- 172.21.15.98:0/1058346880 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5ae40710c0 0x7f5ae40c6880 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5adc032000 tx=0x7f5adc003f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:55.007 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.979+0000 7f5b657b2640 1 -- 172.21.15.98:0/3780492099 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5b600b1ea0 msgr2=0x7f5b60142040 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-16T15:37:55.007 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.979+0000 7f5b657b2640 1 --2- 172.21.15.98:0/3780492099 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5b600b1ea0 0x7f5b60142040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:55.007 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.979+0000 7f5b657b2640 1 -- 172.21.15.98:0/3780492099 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b60142580 msgr2=0x7f5b60142a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:55.008 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.979+0000 7f5b657b2640 1 --2- 172.21.15.98:0/3780492099 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b60142580 0x7f5b60142a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:55.008 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.979+0000 7f5b657b2640 1 -- 172.21.15.98:0/3780492099 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b60144260 con 0x7f5b4c003aa0 2024-09-16T15:37:55.008 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.978+0000 7ff28af6b640 1 -- 172.21.15.98:0/1592181633 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff27c175df0 con 0x7ff27c036720 2024-09-16T15:37:55.008 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.978+0000 7f0b82ffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b8406ead0 0x7f0b8415c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:55.008 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.978+0000 7f0b82ffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b8406ead0 0x7f0b8415c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:32802/0 (socket says 172.21.15.98:32802) 2024-09-16T15:37:55.008 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.978+0000 7f0b82ffd640 1 -- 172.21.15.98:0/717941948 learned_addr learned my addr 172.21.15.98:0/717941948 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:37:55.008 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.978+0000 7f0b837fe640 1 --2- 172.21.15.98:0/717941948 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b8406aaf0 0x7f0b84150230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:55.008 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.978+0000 7f0b83fff640 1 --2- 172.21.15.98:0/717941948 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b8406eeb0 0x7f0b8415cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:55.009 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.979+0000 7ff2817fa640 1 -- 172.21.15.98:0/1592181633 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff270007dc0 con 0x7ff27c036720 2024-09-16T15:37:55.009 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.979+0000 7f0aaf33d640 1 -- 172.21.15.98:0/2031206777 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0aa80cb890 con 0x7f0aa80b0d60 2024-09-16T15:37:55.009 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.979+0000 7efc08a02640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efbfc034650 0x7efbfc0d79f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:55.009 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.979+0000 7f0aaf33d640 1 -- 172.21.15.98:0/2031206777 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0aa81fc860 con 0x7f0aa80b0d60 2024-09-16T15:37:55.010 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.979+0000 7efc08a02640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efbfc034ba0 0x7efbfc0d6e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:55.010 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.979+0000 7f5ae0ff9640 1 -- 172.21.15.98:0/1058346880 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5adc046070 con 0x7f5ae40710c0 2024-09-16T15:37:55.010 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.979+0000 7f0b83fff640 1 -- 172.21.15.98:0/717941948 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b8406aaf0 msgr2=0x7f0b84150230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:55.010 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.979+0000 7f0b83fff640 1 --2- 172.21.15.98:0/717941948 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b8406aaf0 0x7f0b84150230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:55.011 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.979+0000 7f0b83fff640 1 -- 172.21.15.98:0/717941948 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b8406ead0 msgr2=0x7f0b8415c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:55.011 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.979+0000 7f0b83fff640 1 --2- 172.21.15.98:0/717941948 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b8406ead0 0x7f0b8415c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:55.011 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.979+0000 7f0b83fff640 1 -- 172.21.15.98:0/717941948 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b8416c220 con 0x7f0b8406eeb0 2024-09-16T15:37:55.011 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.979+0000 7efc08a02640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efbfc0d74c0 0x7efbfc0333f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:55.011 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.979+0000 7efc08a02640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7efbfc0e6840 con 0x7efbfc034ba0 2024-09-16T15:37:55.011 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.979+0000 7f5aea394640 1 -- 172.21.15.98:0/1058346880 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ae40b3f60 con 0x7f5ae40710c0 2024-09-16T15:37:55.012 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.979+0000 7f74891c7640 1 --2- 172.21.15.98:0/885199726 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f74840d2050 0x7f74840c9890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:55.012 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.979+0000 7f74891c7640 1 -- 172.21.15.98:0/885199726 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74841f92e0 con 0x7f74840cefc0 2024-09-16T15:37:55.012 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.979+0000 7efc0359e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efbfc0d74c0 0x7efbfc0333f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:55.012 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.979+0000 7f5aea394640 1 -- 172.21.15.98:0/1058346880 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ae415b730 con 0x7f5ae40710c0 2024-09-16T15:37:55.012 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.979+0000 7f74899c8640 1 --2- 172.21.15.98:0/885199726 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f74840d2050 0x7f74840c9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T15:37:55.013 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.980+0000 7f5ae0ff9640 1 -- 172.21.15.98:0/1058346880 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5adc004640 con 0x7f5ae40710c0 2024-09-16T15:37:55.013 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.980+0000 7ff2817fa640 1 -- 172.21.15.98:0/1592181633 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff270005280 con 0x7ff27c036720 2024-09-16T15:37:55.013 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.980+0000 7efc08a02640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7efbfc0e7780 con 0x7efbfc034650 2024-09-16T15:37:55.013 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.980+0000 7efc08a02640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7efbfc0e69c0 con 0x7efbfc0d74c0 2024-09-16T15:37:55.014 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.979+0000 7f5b657b2640 1 --2- 172.21.15.98:0/3780492099 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b4c003aa0 0x7f5b60141520 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c00c350 tx=0x7f5b5c003de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:55.014 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.980+0000 7efc0359e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efbfc0d74c0 0x7efbfc0333f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.98:39752/0 (socket says 172.21.15.98:39752) 2024-09-16T15:37:55.014 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.980+0000 7efc0359e640 1 -- 172.21.15.98:0/3968432726 learned_addr learned my addr 172.21.15.98:0/3968432726 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:37:55.014 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.980+0000 7efc0259c640 1 --2- 172.21.15.98:0/3968432726 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efbfc034ba0 0x7efbfc0d6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:55.014 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.980+0000 7f9e4359e640 1 Processor -- start 2024-09-16T15:37:55.014 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.980+0000 7f9e4359e640 1 -- start start 2024-09-16T15:37:55.015 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.980+0000 7f74891c7640 1 --2- 172.21.15.98:0/885199726 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f74840cefc0 0x7f74841f8bd0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f747400e710 tx=0x7f747400ebd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:55.015 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.981+0000 7f5ae0ff9640 1 -- 172.21.15.98:0/1058346880 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5adc033070 con 0x7f5ae40710c0 2024-09-16T15:37:55.015 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.981+0000 7f5aea394640 1 -- 172.21.15.98:0/1058346880 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ac4005290 con 0x7f5ae40710c0 2024-09-16T15:37:55.015 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.981+0000 7f5b55ffb640 1 -- 172.21.15.98:0/3780492099 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b5c032030 con 0x7f5b4c003aa0 2024-09-16T15:37:55.015 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.981+0000 7f5b55ffb640 1 -- 172.21.15.98:0/3780492099 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5b5c001600 con 0x7f5b4c003aa0 2024-09-16T15:37:55.015 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.981+0000 7f5b55ffb640 1 -- 172.21.15.98:0/3780492099 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b5c02e6a0 con 0x7f5b4c003aa0 2024-09-16T15:37:55.016 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.980+0000 7f0b837fe640 1 --2- 172.21.15.98:0/717941948 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b8406aaf0 0x7f0b84150230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T15:37:55.016 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.980+0000 7f0b83fff640 1 --2- 172.21.15.98:0/717941948 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b8406eeb0 0x7f0b8415cb90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c00c730 tx=0x7f0b7c00cbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:55.016 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.980+0000 7f0b6bfff640 1 -- 172.21.15.98:0/717941948 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b7c003b70 con 0x7f0b8406eeb0 2024-09-16T15:37:55.016 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.980+0000 7f0b6bfff640 1 -- 172.21.15.98:0/717941948 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0b7c003d10 con 0x7f0b8406eeb0 2024-09-16T15:37:55.016 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.980+0000 7f0b6bfff640 1 -- 172.21.15.98:0/717941948 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b7c005330 con 0x7f0b8406eeb0 2024-09-16T15:37:55.016 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.981+0000 7f0b89f0e640 1 -- 172.21.15.98:0/717941948 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b8416bf40 con 0x7f0b8406eeb0 2024-09-16T15:37:55.016 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.981+0000 7f0b89f0e640 1 -- 172.21.15.98:0/717941948 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b841fc880 con 0x7f0b8406eeb0 2024-09-16T15:37:55.016 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.982+0000 7f9e4359e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e440ca5b0 0x7f9e440b5370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:55.017 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.981+0000 7f0aaf33d640 1 -- 172.21.15.98:0/2031206777 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0aa80b2af0 con 0x7f0aa80b0d60 2024-09-16T15:37:55.017 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.980+0000 7efc02d9d640 1 --2- 172.21.15.98:0/3968432726 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efbfc034650 0x7efbfc0d79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:55.017 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.981+0000 7efc0359e640 1 -- 172.21.15.98:0/3968432726 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efbfc034650 msgr2=0x7efbfc0d79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:55.017 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.981+0000 7efc0359e640 1 --2- 172.21.15.98:0/3968432726 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efbfc034650 0x7efbfc0d79f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:55.017 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.981+0000 7efc0359e640 1 -- 172.21.15.98:0/3968432726 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efbfc034ba0 msgr2=0x7efbfc0d6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:55.017 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.981+0000 7efc0359e640 1 --2- 172.21.15.98:0/3968432726 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efbfc034ba0 0x7efbfc0d6e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:55.017 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.981+0000 7efc0359e640 1 -- 172.21.15.98:0/3968432726 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efbfc0e0e70 con 0x7efbfc0d74c0 2024-09-16T15:37:55.017 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.981+0000 7efc0359e640 1 --2- 172.21.15.98:0/3968432726 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efbfc0d74c0 0x7efbfc0333f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7efbf400d780 tx=0x7efbf400dc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:55.018 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.982+0000 7f9e4359e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e44159b70 0x7f9e440b3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:55.018 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.982+0000 7f9e4359e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e44159f50 0x7f9e4415b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:55.018 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.982+0000 7f9e4259c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e440ca5b0 0x7f9e440b5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:55.018 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.982+0000 7f9e4259c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e440ca5b0 0x7f9e440b5370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.98:32866/0 (socket says 172.21.15.98:32866) 2024-09-16T15:37:55.018 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.982+0000 7f5ae0ff9640 1 -- 172.21.15.98:0/1058346880 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7f5adc049070 con 0x7f5ae40710c0 2024-09-16T15:37:55.018 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.982+0000 7f9e4259c640 1 -- 172.21.15.98:0/856460491 learned_addr learned my addr 172.21.15.98:0/856460491 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:37:55.019 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.982+0000 7f0b89f0e640 1 -- 172.21.15.98:0/717941948 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b840cc310 con 0x7f0b8406eeb0 2024-09-16T15:37:55.019 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.982+0000 7f9e4359e640 1 -- 172.21.15.98:0/856460491 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9e4406e7e0 con 0x7f9e44159f50 2024-09-16T15:37:55.019 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.982+0000 7f9e4359e640 1 -- 172.21.15.98:0/856460491 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9e440b22f0 con 0x7f9e440ca5b0 2024-09-16T15:37:55.020 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.982+0000 7f7479ffb640 1 -- 172.21.15.98:0/885199726 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f747400cab0 con 0x7f74840cefc0 2024-09-16T15:37:55.020 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.982+0000 7f7479ffb640 1 -- 172.21.15.98:0/885199726 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f747400cd40 con 0x7f74840cefc0 2024-09-16T15:37:55.020 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.982+0000 7f9e4359e640 1 -- 172.21.15.98:0/856460491 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f9e4406e960 con 0x7f9e44159b70 2024-09-16T15:37:55.020 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.982+0000 7f7479ffb640 1 -- 172.21.15.98:0/885199726 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7474010690 con 0x7f74840cefc0 2024-09-16T15:37:55.020 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.982+0000 7ff2817fa640 1 -- 172.21.15.98:0/1592181633 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7ff270005460 con 0x7ff27c036720 2024-09-16T15:37:55.021 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.982+0000 7f5b67a16640 1 -- 172.21.15.98:0/3780492099 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b60144500 con 0x7f5b4c003aa0 2024-09-16T15:37:55.021 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.983+0000 7f5b67a16640 1 -- 172.21.15.98:0/3780492099 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b600af910 con 0x7f5b4c003aa0 2024-09-16T15:37:55.021 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.982+0000 7f748b42b640 1 -- 172.21.15.98:0/885199726 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74841f95c0 con 0x7f74840cefc0 2024-09-16T15:37:55.021 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.983+0000 7f748b42b640 1 -- 172.21.15.98:0/885199726 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f74840b5c70 con 0x7f74840cefc0 2024-09-16T15:37:55.022 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.983+0000 7ff28af6b640 1 -- 172.21.15.98:0/1592181633 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff264005290 con 0x7ff27c036720 2024-09-16T15:37:55.022 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.983+0000 7ff2817fa640 1 --2- 172.21.15.98:0/1592181633 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7ff268078920 0x7ff26807ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:55.022 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.983+0000 7f9e42d9d640 1 --2- 172.21.15.98:0/856460491 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e44159f50 0x7f9e4415b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:55.022 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.983+0000 7f0a9dffb640 1 -- 172.21.15.98:0/2031206777 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7f0a98018020 con 0x7f0aa80b0d60 2024-09-16T15:37:55.022 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.983+0000 7f5ae0ff9640 1 --2- 172.21.15.98:0/1058346880 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f5ad0078920 0x7f5ad007ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:55.023 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.983+0000 7efbeb7fe640 1 -- 172.21.15.98:0/3968432726 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf4017070 con 0x7efbfc0d74c0 2024-09-16T15:37:55.023 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.983+0000 7ff2817fa640 1 -- 172.21.15.98:0/1592181633 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7ff27009bc00 con 0x7ff27c036720 2024-09-16T15:37:55.023 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.983+0000 7efbeb7fe640 1 -- 172.21.15.98:0/3968432726 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efbf400de90 con 0x7efbfc0d74c0 2024-09-16T15:37:55.023 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.983+0000 7efc08a02640 1 -- 172.21.15.98:0/3968432726 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efbfc0e1150 con 0x7efbfc0d74c0 2024-09-16T15:37:55.024 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.983+0000 7f9e4259c640 1 -- 172.21.15.98:0/856460491 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e44159b70 msgr2=0x7f9e440b3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:55.024 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.984+0000 7f9e41d9b640 1 --2- 172.21.15.98:0/856460491 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e44159b70 0x7f9e440b3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:55.024 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.984+0000 7efc08a02640 1 -- 172.21.15.98:0/3968432726 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7efbfc032ed0 con 0x7efbfc0d74c0 2024-09-16T15:37:55.024 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.983+0000 7f0a9dffb640 1 --2- 172.21.15.98:0/2031206777 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f0a8c0788a0 0x7f0a8c07ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:55.025 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.984+0000 7f9e4259c640 1 --2- 172.21.15.98:0/856460491 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e44159b70 0x7f9e440b3340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:55.025 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.984+0000 7f9e4259c640 1 -- 172.21.15.98:0/856460491 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e44159f50 msgr2=0x7f9e4415b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:55.025 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.984+0000 7f9e4259c640 1 --2- 172.21.15.98:0/856460491 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e44159f50 0x7f9e4415b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:55.025 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.984+0000 7f9e4259c640 1 -- 172.21.15.98:0/856460491 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e441f0df0 con 0x7f9e440ca5b0 2024-09-16T15:37:55.025 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.984+0000 7f5ae0ff9640 1 -- 172.21.15.98:0/1058346880 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f5adc0bb7f0 con 0x7f5ae40710c0 2024-09-16T15:37:55.025 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.984+0000 7efbeb7fe640 1 -- 172.21.15.98:0/3968432726 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf4005020 con 0x7efbfc0d74c0 2024-09-16T15:37:55.026 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.984+0000 7f0a9dffb640 1 -- 172.21.15.98:0/2031206777 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f0a9809aa10 con 0x7f0aa80b0d60 2024-09-16T15:37:55.026 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.984+0000 7f9e42d9d640 1 --2- 172.21.15.98:0/856460491 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e44159f50 0x7f9e4415b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T15:37:55.026 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.984+0000 7f0aac8d8640 1 --2- 172.21.15.98:0/2031206777 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f0a8c0788a0 0x7f0a8c07ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:55.027 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.984+0000 7f0b6bfff640 1 -- 172.21.15.98:0/717941948 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7f0b7c0054d0 con 0x7f0b8406eeb0 2024-09-16T15:37:55.027 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.984+0000 7f748b42b640 1 -- 172.21.15.98:0/885199726 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74840d1b10 con 0x7f74840cefc0 2024-09-16T15:37:55.027 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.984+0000 7f9e4259c640 1 --2- 172.21.15.98:0/856460491 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e440ca5b0 0x7f9e440b5370 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c007780 tx=0x7f9e3c00a820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:55.027 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.984+0000 7f5ae37fe640 1 --2- 172.21.15.98:0/1058346880 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f5ad0078920 0x7f5ad007ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:55.028 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.984+0000 7ff288d07640 1 --2- 172.21.15.98:0/1592181633 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7ff268078920 0x7ff26807ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:55.028 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.985+0000 7f0aac8d8640 1 --2- 172.21.15.98:0/2031206777 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f0a8c0788a0 0x7f0a8c07ad60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0aa815eb40 tx=0x7f0aa4006c40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:55.028 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.985+0000 7f0b6bfff640 1 --2- 172.21.15.98:0/717941948 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f0b70078920 0x7f0b7007ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:55.028 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.985+0000 7f5b67a16640 1 -- 172.21.15.98:0/3780492099 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b60153a00 con 0x7f5b4c003aa0 2024-09-16T15:37:55.029 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.985+0000 7f0b6bfff640 1 -- 172.21.15.98:0/717941948 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f0b7c038e00 con 0x7f0b8406eeb0 2024-09-16T15:37:55.029 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.985+0000 7ff288d07640 1 --2- 172.21.15.98:0/1592181633 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7ff268078920 0x7ff26807ade0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff28406b7f0 tx=0x7ff2840b0040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:55.029 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.985+0000 7f0b837fe640 1 --2- 172.21.15.98:0/717941948 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f0b70078920 0x7f0b7007ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:55.029 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.985+0000 7f5ae37fe640 1 --2- 172.21.15.98:0/1058346880 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f5ad0078920 0x7f5ad007ade0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5ae41fc3a0 tx=0x7f5ad4009110 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:55.030 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.985+0000 7f0b837fe640 1 --2- 172.21.15.98:0/717941948 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f0b70078920 0x7f0b7007ade0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0b78033000 tx=0x7f0b78004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:55.030 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.985+0000 7efc08a02640 1 -- 172.21.15.98:0/3968432726 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efbe4005290 con 0x7efbfc0d74c0 2024-09-16T15:37:55.030 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.988+0000 7f0a9dffb640 1 -- 172.21.15.98:0/2031206777 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7f0a9801f030 con 0x7f0aa80b0d60 2024-09-16T15:37:55.030 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.988+0000 7f5ae0ff9640 1 -- 172.21.15.98:0/1058346880 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7f5adc03e070 con 0x7f5ae40710c0 2024-09-16T15:37:55.031 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.988+0000 7f0b6bfff640 1 -- 172.21.15.98:0/717941948 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7f0b7c020060 con 0x7f0b8406eeb0 2024-09-16T15:37:55.031 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.989+0000 7f5b55ffb640 1 -- 172.21.15.98:0/3780492099 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7f5b5c035020 con 0x7f5b4c003aa0 2024-09-16T15:37:55.031 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.990+0000 7f5b55ffb640 1 --2- 172.21.15.98:0/3780492099 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f5b440788d0 0x7f5b4407ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:55.032 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.990+0000 7efbeb7fe640 1 -- 172.21.15.98:0/3968432726 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7efbf40051c0 con 0x7efbfc0d74c0 2024-09-16T15:37:55.032 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.990+0000 7f5b55ffb640 1 -- 172.21.15.98:0/3780492099 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f5b5c0ba6a0 con 0x7f5b4c003aa0 2024-09-16T15:37:55.032 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.990+0000 7f5b64fb1640 1 --2- 172.21.15.98:0/3780492099 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f5b440788d0 0x7f5b4407ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:55.032 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.990+0000 7f7479ffb640 1 -- 172.21.15.98:0/885199726 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7f7474010a40 con 0x7f74840cefc0 2024-09-16T15:37:55.033 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.991+0000 7f5b64fb1640 1 --2- 172.21.15.98:0/3780492099 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f5b440788d0 0x7f5b4407ad90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5b601f9c80 tx=0x7f5b5000b260 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:55.033 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.991+0000 7efbeb7fe640 1 --2- 172.21.15.98:0/3968432726 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7efbf0078920 0x7efbf007ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:55.033 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.991+0000 7f7479ffb640 1 --2- 172.21.15.98:0/885199726 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f7468078920 0x7f746807ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:55.034 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.991+0000 7efc02d9d640 1 --2- 172.21.15.98:0/3968432726 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7efbf0078920 0x7efbf007ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:55.034 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.991+0000 7efbeb7fe640 1 -- 172.21.15.98:0/3968432726 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7efbf409ad40 con 0x7efbfc0d74c0 2024-09-16T15:37:55.034 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.991+0000 7f74889c6640 1 --2- 172.21.15.98:0/885199726 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f7468078920 0x7f746807ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:55.034 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.991+0000 7f7479ffb640 1 -- 172.21.15.98:0/885199726 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f747409bbd0 con 0x7f74840cefc0 2024-09-16T15:37:55.034 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.992+0000 7efc02d9d640 1 --2- 172.21.15.98:0/3968432726 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7efbf0078920 0x7efbf007ade0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7efbfc00d3f0 tx=0x7efc040a8070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:55.035 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.992+0000 7f74889c6640 1 --2- 172.21.15.98:0/885199726 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f7468078920 0x7f746807ade0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7480033000 tx=0x7f7480004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:55.035 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.993+0000 7ff2817fa640 1 -- 172.21.15.98:0/1592181633 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7ff27000ee20 con 0x7ff27c036720 2024-09-16T15:37:55.035 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.993+0000 7f9e32ffd640 1 -- 172.21.15.98:0/856460491 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e3c040020 con 0x7f9e440ca5b0 2024-09-16T15:37:55.035 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.993+0000 7f9e32ffd640 1 -- 172.21.15.98:0/856460491 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9e3c004330 con 0x7f9e440ca5b0 2024-09-16T15:37:55.035 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.993+0000 7f9e32ffd640 1 -- 172.21.15.98:0/856460491 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e3c037040 con 0x7f9e440ca5b0 2024-09-16T15:37:55.036 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.994+0000 7efbeb7fe640 1 -- 172.21.15.98:0/3968432726 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7efbf4062d40 con 0x7efbfc0d74c0 2024-09-16T15:37:55.036 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.994+0000 7f9e4359e640 1 -- 172.21.15.98:0/856460491 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e441f10d0 con 0x7f9e440ca5b0 2024-09-16T15:37:55.036 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.994+0000 7f9e4359e640 1 -- 172.21.15.98:0/856460491 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e441f1970 con 0x7f9e440ca5b0 2024-09-16T15:37:55.036 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.995+0000 7f5b55ffb640 1 -- 172.21.15.98:0/3780492099 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7f5b5c04b020 con 0x7f5b4c003aa0 2024-09-16T15:37:55.037 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.995+0000 7f9e4359e640 1 -- 172.21.15.98:0/856460491 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e440695e0 con 0x7f9e440ca5b0 2024-09-16T15:37:55.037 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.997+0000 7f9e32ffd640 1 -- 172.21.15.98:0/856460491 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7f9e3c043020 con 0x7f9e440ca5b0 2024-09-16T15:37:55.037 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.998+0000 7f7479ffb640 1 -- 172.21.15.98:0/885199726 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7f747409be20 con 0x7f74840cefc0 2024-09-16T15:37:55.038 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.998+0000 7f9e32ffd640 1 --2- 172.21.15.98:0/856460491 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f9e2407aa90 0x7f9e2407cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:55.038 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.998+0000 7f9e32ffd640 1 -- 172.21.15.98:0/856460491 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f9e3c0bae80 con 0x7f9e440ca5b0 2024-09-16T15:37:55.038 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.998+0000 7f9e41d9b640 1 --2- 172.21.15.98:0/856460491 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f9e2407aa90 0x7f9e2407cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:55.038 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:54.999+0000 7f9e41d9b640 1 --2- 172.21.15.98:0/856460491 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f9e2407aa90 0x7f9e2407cf50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9e3800a730 tx=0x7f9e38008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:55.038 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.003+0000 7f9e32ffd640 1 -- 172.21.15.98:0/856460491 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7f9e3c04a070 con 0x7f9e440ca5b0 2024-09-16T15:37:55.415 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.413+0000 7f0aaf33d640 1 -- 172.21.15.98:0/2031206777 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f0aa80af810 con 0x7f0aa80b0d60 2024-09-16T15:37:55.416 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.414+0000 7f0a9dffb640 1 -- 172.21.15.98:0/2031206777 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0a980631f0 con 0x7f0aa80b0d60 2024-09-16T15:37:55.416 INFO:teuthology.orchestra.run.smithi098.stdout:64424509448 2024-09-16T15:37:55.416 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.414+0000 7ff28af6b640 1 -- 172.21.15.98:0/1592181633 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7ff264005580 con 0x7ff27c036720 2024-09-16T15:37:55.419 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.417+0000 7efc08a02640 1 -- 172.21.15.98:0/3968432726 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7efbe4005850 con 0x7efbfc0d74c0 2024-09-16T15:37:55.419 INFO:teuthology.orchestra.run.smithi098.stdout:64424509447 2024-09-16T15:37:55.419 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.415+0000 7ff2817fa640 1 -- 172.21.15.98:0/1592181633 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff270063c90 con 0x7ff27c036720 2024-09-16T15:37:55.420 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.418+0000 7f0aaf33d640 1 -- 172.21.15.98:0/2031206777 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f0a8c0788a0 msgr2=0x7f0a8c07ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:55.420 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.418+0000 7efbeb7fe640 1 -- 172.21.15.98:0/3968432726 <== mon.2 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7efbf4067770 con 0x7efbfc0d74c0 2024-09-16T15:37:55.420 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.418+0000 7f0aaf33d640 1 --2- 172.21.15.98:0/2031206777 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f0a8c0788a0 0x7f0a8c07ad60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0aa815eb40 tx=0x7f0aa4006c40 comp rx=0 tx=0).stop 2024-09-16T15:37:55.420 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.418+0000 7f0aaf33d640 1 -- 172.21.15.98:0/2031206777 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0aa80b0d60 msgr2=0x7f0aa81fd060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:55.420 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.418+0000 7f0aaf33d640 1 --2- 172.21.15.98:0/2031206777 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0aa80b0d60 0x7f0aa81fd060 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0a98009fd0 tx=0x7f0a9800b870 comp rx=0 tx=0).stop 2024-09-16T15:37:55.421 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.418+0000 7f0aaf33d640 1 -- 172.21.15.98:0/2031206777 shutdown_connections 2024-09-16T15:37:55.421 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.418+0000 7f0aaf33d640 1 --2- 172.21.15.98:0/2031206777 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f0a8c0788a0 0x7f0a8c07ad60 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:55.421 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.418+0000 7f0aaf33d640 1 --2- 172.21.15.98:0/2031206777 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0aa80b3b90 0x7f0aa80caf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:55.421 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.418+0000 7f0aaf33d640 1 --2- 172.21.15.98:0/2031206777 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0aa80b3270 0x7f0aa8151ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:55.421 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.418+0000 7f0aaf33d640 1 --2- 172.21.15.98:0/2031206777 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0aa80b0d60 0x7f0aa81fd060 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:55.421 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.418+0000 7f0aaf33d640 1 -- 172.21.15.98:0/2031206777 >> 172.21.15.98:0/2031206777 conn(0x7f0aa80d1d80 msgr2=0x7f0aa81601f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:55.421 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.418+0000 7f0aaf33d640 1 -- 172.21.15.98:0/2031206777 shutdown_connections 2024-09-16T15:37:55.421 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.418+0000 7f0aaf33d640 1 -- 172.21.15.98:0/2031206777 wait complete. 2024-09-16T15:37:55.421 INFO:teuthology.orchestra.run.smithi098.stdout:64424509448 2024-09-16T15:37:55.422 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.418+0000 7ff28af6b640 1 -- 172.21.15.98:0/1592181633 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7ff268078920 msgr2=0x7ff26807ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:55.422 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.418+0000 7ff28af6b640 1 --2- 172.21.15.98:0/1592181633 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7ff268078920 0x7ff26807ade0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff28406b7f0 tx=0x7ff2840b0040 comp rx=0 tx=0).stop 2024-09-16T15:37:55.422 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.418+0000 7ff28af6b640 1 -- 172.21.15.98:0/1592181633 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff27c036720 msgr2=0x7ff27c0e16f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:55.422 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.418+0000 7ff28af6b640 1 --2- 172.21.15.98:0/1592181633 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff27c036720 0x7ff27c0e16f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff27c033fa0 tx=0x7ff27000ebd0 comp rx=0 tx=0).stop 2024-09-16T15:37:55.422 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.419+0000 7f0b89f0e640 1 -- 172.21.15.98:0/717941948 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f0b84070ad0 con 0x7f0b8406eeb0 2024-09-16T15:37:55.422 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.419+0000 7ff28af6b640 1 -- 172.21.15.98:0/1592181633 shutdown_connections 2024-09-16T15:37:55.423 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.419+0000 7f5aea394640 1 -- 172.21.15.98:0/1058346880 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f5ac4005580 con 0x7f5ae40710c0 2024-09-16T15:37:55.423 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.419+0000 7ff28af6b640 1 --2- 172.21.15.98:0/1592181633 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7ff268078920 0x7ff26807ade0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:55.424 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.419+0000 7ff28af6b640 1 --2- 172.21.15.98:0/1592181633 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff27c036720 0x7ff27c0e16f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:55.424 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.419+0000 7ff28af6b640 1 --2- 172.21.15.98:0/1592181633 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff27c01c8c0 0x7ff27c0dfca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:55.424 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.419+0000 7ff28af6b640 1 --2- 172.21.15.98:0/1592181633 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff27c005a90 0x7ff27c049080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:55.424 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.419+0000 7ff28af6b640 1 -- 172.21.15.98:0/1592181633 >> 172.21.15.98:0/1592181633 conn(0x7ff27c054590 msgr2=0x7ff27c053910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:55.424 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.419+0000 7ff28af6b640 1 -- 172.21.15.98:0/1592181633 shutdown_connections 2024-09-16T15:37:55.424 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.419+0000 7ff28af6b640 1 -- 172.21.15.98:0/1592181633 wait complete. 2024-09-16T15:37:55.424 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.419+0000 7f0b6bfff640 1 -- 172.21.15.98:0/717941948 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0b7c062600 con 0x7f0b8406eeb0 2024-09-16T15:37:55.425 INFO:teuthology.orchestra.run.smithi098.stdout:64424509447 2024-09-16T15:37:55.425 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.419+0000 7f5ae0ff9640 1 -- 172.21.15.98:0/1058346880 <== mon.2 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5adc083880 con 0x7f5ae40710c0 2024-09-16T15:37:55.425 INFO:teuthology.orchestra.run.smithi098.stdout:64424509447 2024-09-16T15:37:55.425 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.423+0000 7f5b67a16640 1 -- 172.21.15.98:0/3780492099 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f5b600afae0 con 0x7f5b4c003aa0 2024-09-16T15:37:55.426 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.423+0000 7efc08a02640 1 -- 172.21.15.98:0/3968432726 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7efbf0078920 msgr2=0x7efbf007ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:55.426 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.423+0000 7efc08a02640 1 --2- 172.21.15.98:0/3968432726 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7efbf0078920 0x7efbf007ade0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7efbfc00d3f0 tx=0x7efc040a8070 comp rx=0 tx=0).stop 2024-09-16T15:37:55.426 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.423+0000 7efc08a02640 1 -- 172.21.15.98:0/3968432726 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efbfc0d74c0 msgr2=0x7efbfc0333f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:55.426 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.423+0000 7efc08a02640 1 --2- 172.21.15.98:0/3968432726 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efbfc0d74c0 0x7efbfc0333f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7efbf400d780 tx=0x7efbf400dc40 comp rx=0 tx=0).stop 2024-09-16T15:37:55.426 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.423+0000 7efc08a02640 1 -- 172.21.15.98:0/3968432726 shutdown_connections 2024-09-16T15:37:55.426 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.423+0000 7efc08a02640 1 --2- 172.21.15.98:0/3968432726 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efbfc0d74c0 0x7efbfc0333f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:55.426 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.423+0000 7efc08a02640 1 --2- 172.21.15.98:0/3968432726 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efbfc034ba0 0x7efbfc0d6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:55.426 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.423+0000 7efc08a02640 1 --2- 172.21.15.98:0/3968432726 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7efbf0078920 0x7efbf007ade0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:55.427 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.423+0000 7efc08a02640 1 --2- 172.21.15.98:0/3968432726 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efbfc034650 0x7efbfc0d79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:55.427 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.423+0000 7efc08a02640 1 -- 172.21.15.98:0/3968432726 >> 172.21.15.98:0/3968432726 conn(0x7efbfc01e890 msgr2=0x7efbfc00b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:55.427 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.423+0000 7f5aea394640 1 -- 172.21.15.98:0/1058346880 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f5ad0078920 msgr2=0x7f5ad007ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:55.427 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.423+0000 7f5aea394640 1 --2- 172.21.15.98:0/1058346880 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f5ad0078920 0x7f5ad007ade0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5ae41fc3a0 tx=0x7f5ad4009110 comp rx=0 tx=0).stop 2024-09-16T15:37:55.427 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.423+0000 7efc08a02640 1 -- 172.21.15.98:0/3968432726 shutdown_connections 2024-09-16T15:37:55.427 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.423+0000 7efc08a02640 1 -- 172.21.15.98:0/3968432726 wait complete. 2024-09-16T15:37:55.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.423+0000 7f5aea394640 1 -- 172.21.15.98:0/1058346880 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5ae40710c0 msgr2=0x7f5ae40c6880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:55.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.423+0000 7f5aea394640 1 --2- 172.21.15.98:0/1058346880 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5ae40710c0 0x7f5ae40c6880 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5adc032000 tx=0x7f5adc003f90 comp rx=0 tx=0).stop 2024-09-16T15:37:55.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.423+0000 7f0b89f0e640 1 -- 172.21.15.98:0/717941948 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f0b70078920 msgr2=0x7f0b7007ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:55.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.423+0000 7f5b55ffb640 1 -- 172.21.15.98:0/3780492099 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5b5c082df0 con 0x7f5b4c003aa0 2024-09-16T15:37:55.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.423+0000 7f0b89f0e640 1 --2- 172.21.15.98:0/717941948 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f0b70078920 0x7f0b7007ade0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0b78033000 tx=0x7f0b78004730 comp rx=0 tx=0).stop 2024-09-16T15:37:55.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.423+0000 7f5aea394640 1 -- 172.21.15.98:0/1058346880 shutdown_connections 2024-09-16T15:37:55.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.423+0000 7f5aea394640 1 --2- 172.21.15.98:0/1058346880 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ae415df90 0x7f5ae41570a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:55.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.424+0000 7f5aea394640 1 --2- 172.21.15.98:0/1058346880 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f5ad0078920 0x7f5ad007ade0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:55.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.424+0000 7f0b89f0e640 1 -- 172.21.15.98:0/717941948 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b8406eeb0 msgr2=0x7f0b8415cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:55.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.424+0000 7f5aea394640 1 --2- 172.21.15.98:0/1058346880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ae40d01f0 0x7f5ae4156b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:55.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.424+0000 7f5aea394640 1 --2- 172.21.15.98:0/1058346880 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5ae40710c0 0x7f5ae40c6880 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:55.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.424+0000 7f0b89f0e640 1 --2- 172.21.15.98:0/717941948 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b8406eeb0 0x7f0b8415cb90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c00c730 tx=0x7f0b7c00cbf0 comp rx=0 tx=0).stop 2024-09-16T15:37:55.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.424+0000 7f5aea394640 1 -- 172.21.15.98:0/1058346880 >> 172.21.15.98:0/1058346880 conn(0x7f5ae40b2850 msgr2=0x7f5ae40b06c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:55.431 INFO:teuthology.orchestra.run.smithi098.stdout:64424509448 2024-09-16T15:37:55.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.424+0000 7f0b89f0e640 1 -- 172.21.15.98:0/717941948 shutdown_connections 2024-09-16T15:37:55.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.424+0000 7f0b89f0e640 1 --2- 172.21.15.98:0/717941948 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f0b70078920 0x7f0b7007ade0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:55.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.424+0000 7f0b89f0e640 1 --2- 172.21.15.98:0/717941948 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b8406eeb0 0x7f0b8415cb90 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:55.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.424+0000 7f0b89f0e640 1 --2- 172.21.15.98:0/717941948 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b8406ead0 0x7f0b8415c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:55.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.424+0000 7f0b89f0e640 1 --2- 172.21.15.98:0/717941948 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b8406aaf0 0x7f0b84150230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:55.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.424+0000 7f0b89f0e640 1 -- 172.21.15.98:0/717941948 >> 172.21.15.98:0/717941948 conn(0x7f0b840cffe0 msgr2=0x7f0b8415e410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:55.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.424+0000 7f5aea394640 1 -- 172.21.15.98:0/1058346880 shutdown_connections 2024-09-16T15:37:55.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.424+0000 7f5aea394640 1 -- 172.21.15.98:0/1058346880 wait complete. 2024-09-16T15:37:55.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.424+0000 7f0b89f0e640 1 -- 172.21.15.98:0/717941948 shutdown_connections 2024-09-16T15:37:55.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.424+0000 7f0b89f0e640 1 -- 172.21.15.98:0/717941948 wait complete. 2024-09-16T15:37:55.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.424+0000 7f748b42b640 1 -- 172.21.15.98:0/885199726 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f74840cdd70 con 0x7f74840cefc0 2024-09-16T15:37:55.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.425+0000 7f7479ffb640 1 -- 172.21.15.98:0/885199726 <== mon.2 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7474063c60 con 0x7f74840cefc0 2024-09-16T15:37:55.434 INFO:teuthology.orchestra.run.smithi098.stdout:55834574854 2024-09-16T15:37:55.434 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.428+0000 7f9e4359e640 1 -- 172.21.15.98:0/856460491 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f9e441f12a0 con 0x7f9e440ca5b0 2024-09-16T15:37:55.434 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.428+0000 7f5b67a16640 1 -- 172.21.15.98:0/3780492099 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f5b440788d0 msgr2=0x7f5b4407ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:55.435 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.428+0000 7f5b67a16640 1 --2- 172.21.15.98:0/3780492099 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f5b440788d0 0x7f5b4407ad90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5b601f9c80 tx=0x7f5b5000b260 comp rx=0 tx=0).stop 2024-09-16T15:37:55.435 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.428+0000 7f5b67a16640 1 -- 172.21.15.98:0/3780492099 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b4c003aa0 msgr2=0x7f5b60141520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:55.435 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.428+0000 7f5b67a16640 1 --2- 172.21.15.98:0/3780492099 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b4c003aa0 0x7f5b60141520 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c00c350 tx=0x7f5b5c003de0 comp rx=0 tx=0).stop 2024-09-16T15:37:55.435 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.428+0000 7f5b67a16640 1 -- 172.21.15.98:0/3780492099 shutdown_connections 2024-09-16T15:37:55.435 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.428+0000 7f5b67a16640 1 --2- 172.21.15.98:0/3780492099 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f5b440788d0 0x7f5b4407ad90 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:55.435 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.428+0000 7f5b67a16640 1 --2- 172.21.15.98:0/3780492099 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b60142580 0x7f5b60142a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:55.435 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.428+0000 7f5b67a16640 1 --2- 172.21.15.98:0/3780492099 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5b600b1ea0 0x7f5b60142040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:55.435 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.428+0000 7f5b67a16640 1 --2- 172.21.15.98:0/3780492099 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b4c003aa0 0x7f5b60141520 secure :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c00c350 tx=0x7f5b5c003de0 comp rx=0 tx=0).stop 2024-09-16T15:37:55.435 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.428+0000 7f5b67a16640 1 -- 172.21.15.98:0/3780492099 >> 172.21.15.98:0/3780492099 conn(0x7f5b6006cb70 msgr2=0x7f5b60152760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:55.435 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.428+0000 7f5b67a16640 1 -- 172.21.15.98:0/3780492099 shutdown_connections 2024-09-16T15:37:55.435 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.428+0000 7f9e32ffd640 1 -- 172.21.15.98:0/856460491 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9e3c083450 con 0x7f9e440ca5b0 2024-09-16T15:37:55.436 INFO:teuthology.orchestra.run.smithi098.stdout:64424509447 2024-09-16T15:37:55.436 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.428+0000 7f5b67a16640 1 -- 172.21.15.98:0/3780492099 wait complete. 2024-09-16T15:37:55.437 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.429+0000 7f748b42b640 1 -- 172.21.15.98:0/885199726 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f7468078920 msgr2=0x7f746807ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:55.437 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.429+0000 7f748b42b640 1 --2- 172.21.15.98:0/885199726 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f7468078920 0x7f746807ade0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7480033000 tx=0x7f7480004730 comp rx=0 tx=0).stop 2024-09-16T15:37:55.437 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.429+0000 7f748b42b640 1 -- 172.21.15.98:0/885199726 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f74840cefc0 msgr2=0x7f74841f8bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:55.437 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.429+0000 7f748b42b640 1 --2- 172.21.15.98:0/885199726 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f74840cefc0 0x7f74841f8bd0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f747400e710 tx=0x7f747400ebd0 comp rx=0 tx=0).stop 2024-09-16T15:37:55.437 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.430+0000 7f748b42b640 1 -- 172.21.15.98:0/885199726 shutdown_connections 2024-09-16T15:37:55.438 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.430+0000 7f748b42b640 1 --2- 172.21.15.98:0/885199726 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f74840d2050 0x7f74840c9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:55.438 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.430+0000 7f748b42b640 1 --2- 172.21.15.98:0/885199726 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f7468078920 0x7f746807ade0 secure :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7480033000 tx=0x7f7480004730 comp rx=0 tx=0).stop 2024-09-16T15:37:55.438 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.430+0000 7f748b42b640 1 --2- 172.21.15.98:0/885199726 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74840d16d0 0x7f74840b2450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:55.438 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.430+0000 7f748b42b640 1 --2- 172.21.15.98:0/885199726 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f74840cefc0 0x7f74841f8bd0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:55.438 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.430+0000 7f748b42b640 1 -- 172.21.15.98:0/885199726 >> 172.21.15.98:0/885199726 conn(0x7f74840688b0 msgr2=0x7f7484160980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:55.438 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.430+0000 7f748b42b640 1 -- 172.21.15.98:0/885199726 shutdown_connections 2024-09-16T15:37:55.438 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.430+0000 7f748b42b640 1 -- 172.21.15.98:0/885199726 wait complete. 2024-09-16T15:37:55.439 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.433+0000 7f9e4359e640 1 -- 172.21.15.98:0/856460491 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f9e2407aa90 msgr2=0x7f9e2407cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:55.439 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.433+0000 7f9e4359e640 1 --2- 172.21.15.98:0/856460491 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f9e2407aa90 0x7f9e2407cf50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9e3800a730 tx=0x7f9e38008040 comp rx=0 tx=0).stop 2024-09-16T15:37:55.439 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.433+0000 7f9e4359e640 1 -- 172.21.15.98:0/856460491 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e440ca5b0 msgr2=0x7f9e440b5370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:55.439 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.433+0000 7f9e4359e640 1 --2- 172.21.15.98:0/856460491 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e440ca5b0 0x7f9e440b5370 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c007780 tx=0x7f9e3c00a820 comp rx=0 tx=0).stop 2024-09-16T15:37:55.440 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.433+0000 7f9e4359e640 1 -- 172.21.15.98:0/856460491 shutdown_connections 2024-09-16T15:37:55.440 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.433+0000 7f9e4359e640 1 --2- 172.21.15.98:0/856460491 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e44159f50 0x7f9e4415b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:55.440 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.433+0000 7f9e4359e640 1 --2- 172.21.15.98:0/856460491 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9e44159b70 0x7f9e440b3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:55.440 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.433+0000 7f9e4359e640 1 --2- 172.21.15.98:0/856460491 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f9e2407aa90 0x7f9e2407cf50 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:55.440 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.433+0000 7f9e4359e640 1 --2- 172.21.15.98:0/856460491 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e440ca5b0 0x7f9e440b5370 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:55.440 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.433+0000 7f9e4359e640 1 -- 172.21.15.98:0/856460491 >> 172.21.15.98:0/856460491 conn(0x7f9e440b15f0 msgr2=0x7f9e44158f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:55.440 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.434+0000 7f9e4359e640 1 -- 172.21.15.98:0/856460491 shutdown_connections 2024-09-16T15:37:55.440 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:55.434+0000 7f9e4359e640 1 -- 172.21.15.98:0/856460491 wait complete. 2024-09-16T15:37:55.443 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.4 2024-09-16T15:37:55.444 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.5 2024-09-16T15:37:55.449 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.3 2024-09-16T15:37:55.450 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.7 2024-09-16T15:37:55.450 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.0 2024-09-16T15:37:55.451 DEBUG:teuthology.parallel:result is None 2024-09-16T15:37:55.452 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.6 2024-09-16T15:37:55.453 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.1 2024-09-16T15:37:55.454 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.2 2024-09-16T15:37:56.444 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-16T15:37:56.445 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-16T15:37:56.450 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-16T15:37:56.451 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-16T15:37:56.452 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-16T15:37:56.454 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-16T15:37:56.454 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-16T15:37:56.578 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.576+0000 7fdbe97f8640 1 -- 172.21.15.98:0/3699483610 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdbe40d08e0 msgr2=0x7fdbe40b4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:56.579 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.576+0000 7fdbe97f8640 1 --2- 172.21.15.98:0/3699483610 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdbe40d08e0 0x7fdbe40b4c70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc005fd0 tx=0x7fdbdc02a8a0 comp rx=0 tx=0).stop 2024-09-16T15:37:56.579 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.576+0000 7fdbe97f8640 1 -- 172.21.15.98:0/3699483610 shutdown_connections 2024-09-16T15:37:56.579 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.576+0000 7fdbe97f8640 1 --2- 172.21.15.98:0/3699483610 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdbe40d08e0 0x7fdbe40b4c70 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:56.579 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.576+0000 7fdbe97f8640 1 --2- 172.21.15.98:0/3699483610 >> v2:172.21.15.135:3300/0 conn(0x7fdbe415bf10 0x7fdbe41604b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:56.579 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.576+0000 7fdbe97f8640 1 -- 172.21.15.98:0/3699483610 >> 172.21.15.98:0/3699483610 conn(0x7fdbe40d1e20 msgr2=0x7fdbe40d2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:56.579 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.576+0000 7fdbe97f8640 1 -- 172.21.15.98:0/3699483610 shutdown_connections 2024-09-16T15:37:56.579 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.576+0000 7fdbe97f8640 1 -- 172.21.15.98:0/3699483610 wait complete. 2024-09-16T15:37:56.580 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.578+0000 7fdbe97f8640 1 Processor -- start 2024-09-16T15:37:56.580 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.578+0000 7fdbe97f8640 1 -- start start 2024-09-16T15:37:56.582 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.579+0000 7fdbe97f8640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdbe40cd6f0 0x7fdbe41f4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:56.582 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.579+0000 7fdbe97f8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbe40d08e0 0x7fdbe415f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:56.582 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.579+0000 7fdbe97f8640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdbe415bf10 0x7fdbe409e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:56.582 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.579+0000 7fdbe97f8640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe40cf9f0 con 0x7fdbe415bf10 2024-09-16T15:37:56.582 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.579+0000 7fdbe97f8640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe415c400 con 0x7fdbe40d08e0 2024-09-16T15:37:56.582 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.579+0000 7fdbe97f8640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fdbe40cfb70 con 0x7fdbe40cd6f0 2024-09-16T15:37:56.583 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.579+0000 7fdbe2ffd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdbe40cd6f0 0x7fdbe41f4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:56.583 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.579+0000 7fdbe2ffd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdbe40cd6f0 0x7fdbe41f4990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.98:39782/0 (socket says 172.21.15.98:39782) 2024-09-16T15:37:56.583 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.579+0000 7fdbe2ffd640 1 -- 172.21.15.98:0/47310755 learned_addr learned my addr 172.21.15.98:0/47310755 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:37:56.583 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.579+0000 7fdbe27fc640 1 --2- 172.21.15.98:0/47310755 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbe40d08e0 0x7fdbe415f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:56.583 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.579+0000 7fdbe37fe640 1 --2- 172.21.15.98:0/47310755 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdbe415bf10 0x7fdbe409e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:56.583 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.579+0000 7fdbe37fe640 1 -- 172.21.15.98:0/47310755 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdbe40cd6f0 msgr2=0x7fdbe41f4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:56.583 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.579+0000 7fdbe37fe640 1 --2- 172.21.15.98:0/47310755 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdbe40cd6f0 0x7fdbe41f4990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:56.583 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.580+0000 7fdbe37fe640 1 -- 172.21.15.98:0/47310755 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbe40d08e0 msgr2=0x7fdbe415f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:56.583 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.580+0000 7fdbe37fe640 1 --2- 172.21.15.98:0/47310755 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbe40d08e0 0x7fdbe415f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:56.583 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.580+0000 7fdbe37fe640 1 -- 172.21.15.98:0/47310755 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbe415fb90 con 0x7fdbe415bf10 2024-09-16T15:37:56.583 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.580+0000 7fdbe27fc640 1 --2- 172.21.15.98:0/47310755 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbe40d08e0 0x7fdbe415f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T15:37:56.583 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.580+0000 7fdbe37fe640 1 --2- 172.21.15.98:0/47310755 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdbe415bf10 0x7fdbe409e590 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc009000 tx=0x7fdbdc032d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:56.583 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.580+0000 7fdbdb7fe640 1 -- 172.21.15.98:0/47310755 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbdc031430 con 0x7fdbe415bf10 2024-09-16T15:37:56.583 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.580+0000 7fdbe97f8640 1 -- 172.21.15.98:0/47310755 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbe409ead0 con 0x7fdbe415bf10 2024-09-16T15:37:56.584 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.580+0000 7fdbe97f8640 1 -- 172.21.15.98:0/47310755 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbe409f050 con 0x7fdbe415bf10 2024-09-16T15:37:56.584 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.582+0000 7fdbdb7fe640 1 -- 172.21.15.98:0/47310755 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdbdc004490 con 0x7fdbe415bf10 2024-09-16T15:37:56.584 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.582+0000 7fdbdb7fe640 1 -- 172.21.15.98:0/47310755 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbdc045410 con 0x7fdbe415bf10 2024-09-16T15:37:56.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.583+0000 7fdbd97fa640 1 -- 172.21.15.98:0/47310755 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbc8005290 con 0x7fdbe415bf10 2024-09-16T15:37:56.586 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.583+0000 7fdbdb7fe640 1 -- 172.21.15.98:0/47310755 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7fdbdc043020 con 0x7fdbe415bf10 2024-09-16T15:37:56.586 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.584+0000 7fdbdb7fe640 1 --2- 172.21.15.98:0/47310755 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fdbc4078850 0x7fdbc407ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:56.586 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.584+0000 7fdbdb7fe640 1 -- 172.21.15.98:0/47310755 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fdbdc02e030 con 0x7fdbe415bf10 2024-09-16T15:37:56.586 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.584+0000 7fdbe2ffd640 1 --2- 172.21.15.98:0/47310755 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fdbc4078850 0x7fdbc407ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:56.587 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.585+0000 7fdbe2ffd640 1 --2- 172.21.15.98:0/47310755 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fdbc4078850 0x7fdbc407ad10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdbe415dc80 tx=0x7fdbd4005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:56.590 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.589+0000 7fdbdb7fe640 1 -- 172.21.15.98:0/47310755 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7fdbdc04a060 con 0x7fdbe415bf10 2024-09-16T15:37:56.608 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.605+0000 7f649cc48640 1 -- 172.21.15.98:0/2445580816 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f64980cd220 msgr2=0x7f649806f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:56.608 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.605+0000 7f649cc48640 1 --2- 172.21.15.98:0/2445580816 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f64980cd220 0x7f649806f7f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f64980b6b00 tx=0x7f648802a560 comp rx=0 tx=0).stop 2024-09-16T15:37:56.608 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.606+0000 7f649cc48640 1 -- 172.21.15.98:0/2445580816 shutdown_connections 2024-09-16T15:37:56.608 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.606+0000 7f649cc48640 1 --2- 172.21.15.98:0/2445580816 >> v2:172.21.15.135:3300/0 conn(0x7f649806cb70 0x7f649806d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:56.608 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.606+0000 7f649cc48640 1 --2- 172.21.15.98:0/2445580816 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f64980cd220 0x7f649806f7f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:56.608 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.606+0000 7f649cc48640 1 --2- 172.21.15.98:0/2445580816 >> v2:172.21.15.98:3300/0 conn(0x7f649815bb80 0x7f6498160340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:56.608 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.606+0000 7f649cc48640 1 -- 172.21.15.98:0/2445580816 >> 172.21.15.98:0/2445580816 conn(0x7f64980d0cb0 msgr2=0x7f64980d10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:56.609 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.606+0000 7f649cc48640 1 -- 172.21.15.98:0/2445580816 shutdown_connections 2024-09-16T15:37:56.609 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.606+0000 7f649cc48640 1 -- 172.21.15.98:0/2445580816 wait complete. 2024-09-16T15:37:56.610 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.609+0000 7f649cc48640 1 Processor -- start 2024-09-16T15:37:56.610 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.609+0000 7f649cc48640 1 -- start start 2024-09-16T15:37:56.613 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.610+0000 7f649cc48640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f649806cb70 0x7f6498158380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:56.613 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.610+0000 7f649cc48640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64980cd220 0x7f649814aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:56.613 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.611+0000 7f649cc48640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f649815bb80 0x7f64980ca850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:56.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.611+0000 7f649659c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f649806cb70 0x7f6498158380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:56.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.611+0000 7f649659c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f649806cb70 0x7f6498158380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:32866/0 (socket says 172.21.15.98:32866) 2024-09-16T15:37:56.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.611+0000 7f649659c640 1 -- 172.21.15.98:0/2873305458 learned_addr learned my addr 172.21.15.98:0/2873305458 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:37:56.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.611+0000 7f6496d9d640 1 --2- 172.21.15.98:0/2873305458 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f649815bb80 0x7f64980ca850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:56.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.611+0000 7f6495d9b640 1 --2- 172.21.15.98:0/2873305458 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64980cd220 0x7f649814aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:56.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.611+0000 7f649cc48640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f64980cb8a0 con 0x7f649806cb70 2024-09-16T15:37:56.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.611+0000 7f649cc48640 1 -- 172.21.15.98:0/2873305458 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f64980cb720 con 0x7f64980cd220 2024-09-16T15:37:56.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.611+0000 7f649cc48640 1 -- 172.21.15.98:0/2873305458 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f64980cba20 con 0x7f649815bb80 2024-09-16T15:37:56.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.612+0000 7f6496d9d640 1 -- 172.21.15.98:0/2873305458 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64980cd220 msgr2=0x7f649814aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:56.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.612+0000 7f6496d9d640 1 --2- 172.21.15.98:0/2873305458 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64980cd220 0x7f649814aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:56.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.612+0000 7f6496d9d640 1 -- 172.21.15.98:0/2873305458 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f649806cb70 msgr2=0x7f6498158380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:56.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.612+0000 7f6496d9d640 1 --2- 172.21.15.98:0/2873305458 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f649806cb70 0x7f6498158380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:56.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.612+0000 7f6496d9d640 1 -- 172.21.15.98:0/2873305458 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64980c9a90 con 0x7f649815bb80 2024-09-16T15:37:56.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.612+0000 7f649659c640 1 --2- 172.21.15.98:0/2873305458 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f649806cb70 0x7f6498158380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T15:37:56.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.612+0000 7f6496d9d640 1 --2- 172.21.15.98:0/2873305458 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f649815bb80 0x7f64980ca850 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f649000ea80 tx=0x7f649000ef40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:56.617 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.612+0000 7f6486ffd640 1 -- 172.21.15.98:0/2873305458 <== mon.2 v2:172.21.15.135:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f649000cea0 con 0x7f649815bb80 2024-09-16T15:37:56.617 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.613+0000 7f6486ffd640 1 -- 172.21.15.98:0/2873305458 <== mon.2 v2:172.21.15.135:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6490004c10 con 0x7f649815bb80 2024-09-16T15:37:56.617 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.613+0000 7f6486ffd640 1 -- 172.21.15.98:0/2873305458 <== mon.2 v2:172.21.15.135:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64900137d0 con 0x7f649815bb80 2024-09-16T15:37:56.617 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.613+0000 7f649cc48640 1 -- 172.21.15.98:0/2873305458 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64980c9d70 con 0x7f649815bb80 2024-09-16T15:37:56.617 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.613+0000 7f649cc48640 1 -- 172.21.15.98:0/2873305458 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f64981e5960 con 0x7f649815bb80 2024-09-16T15:37:56.617 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.614+0000 7f649cc48640 1 -- 172.21.15.98:0/2873305458 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f649806f7f0 con 0x7f649815bb80 2024-09-16T15:37:56.617 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.616+0000 7f6486ffd640 1 -- 172.21.15.98:0/2873305458 <== mon.2 v2:172.21.15.135:3301/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7f6490013970 con 0x7f649815bb80 2024-09-16T15:37:56.618 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.616+0000 7f6486ffd640 1 --2- 172.21.15.98:0/2873305458 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f6478078850 0x7f647807ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:56.618 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.617+0000 7f6486ffd640 1 -- 172.21.15.98:0/2873305458 <== mon.2 v2:172.21.15.135:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f649009f4a0 con 0x7f649815bb80 2024-09-16T15:37:56.619 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.617+0000 7f649659c640 1 --2- 172.21.15.98:0/2873305458 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f6478078850 0x7f647807ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:56.619 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.617+0000 7f649659c640 1 --2- 172.21.15.98:0/2873305458 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f6478078850 0x7f647807ad10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f648c009670 tx=0x7f648c005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:56.623 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.621+0000 7f6486ffd640 1 -- 172.21.15.98:0/2873305458 <== mon.2 v2:172.21.15.135:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7f64900674b0 con 0x7f649815bb80 2024-09-16T15:37:56.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.638+0000 7f6cd9d32640 1 -- 172.21.15.98:0/3059203006 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6cd4073cd0 msgr2=0x7f6cd415e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:56.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.638+0000 7f6cd9d32640 1 --2- 172.21.15.98:0/3059203006 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6cd4073cd0 0x7f6cd415e7a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6cd406f5a0 tx=0x7f6ccc02aa10 comp rx=0 tx=0).stop 2024-09-16T15:37:56.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.638+0000 7f6cd9d32640 1 -- 172.21.15.98:0/3059203006 shutdown_connections 2024-09-16T15:37:56.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.638+0000 7f6cd9d32640 1 --2- 172.21.15.98:0/3059203006 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6cd4073cd0 0x7f6cd415e7a0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:56.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.638+0000 7f6cd9d32640 1 --2- 172.21.15.98:0/3059203006 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6cd40ce910 0x7f6cd4073790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:56.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.638+0000 7f6cd9d32640 1 --2- 172.21.15.98:0/3059203006 >> v2:172.21.15.135:3300/0 conn(0x7f6cd415ac00 0x7f6cd40cf830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:56.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.638+0000 7f6cd9d32640 1 -- 172.21.15.98:0/3059203006 >> 172.21.15.98:0/3059203006 conn(0x7f6cd40d0d40 msgr2=0x7f6cd40d1120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:56.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.638+0000 7f6cd9d32640 1 -- 172.21.15.98:0/3059203006 shutdown_connections 2024-09-16T15:37:56.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.638+0000 7f6cd9d32640 1 -- 172.21.15.98:0/3059203006 wait complete. 2024-09-16T15:37:56.643 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.640+0000 7f6cd9d32640 1 Processor -- start 2024-09-16T15:37:56.643 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.640+0000 7f6cd9d32640 1 -- start start 2024-09-16T15:37:56.643 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.641+0000 7f6cd9d32640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6cd4073cd0 0x7f6cd4153b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:56.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.642+0000 7f6cd37fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6cd4073cd0 0x7f6cd4153b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:56.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.642+0000 7f6cd37fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6cd4073cd0 0x7f6cd4153b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:32876/0 (socket says 172.21.15.98:32876) 2024-09-16T15:37:56.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.642+0000 7f6cd37fe640 1 -- 172.21.15.98:0/3692398232 learned_addr learned my addr 172.21.15.98:0/3692398232 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:37:56.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.642+0000 7f6cd9d32640 1 --2- 172.21.15.98:0/3692398232 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6cd40ce910 0x7f6cd415ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:56.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.642+0000 7f6cd9d32640 1 --2- 172.21.15.98:0/3692398232 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6cd415ac00 0x7f6cd40c9950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:56.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.642+0000 7f6cd2ffd640 1 --2- 172.21.15.98:0/3692398232 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6cd40ce910 0x7f6cd415ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:56.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.642+0000 7f6cd3fff640 1 --2- 172.21.15.98:0/3692398232 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6cd415ac00 0x7f6cd40c9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:56.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.642+0000 7f6cd9d32640 1 -- 172.21.15.98:0/3692398232 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd4071a70 con 0x7f6cd4073cd0 2024-09-16T15:37:56.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.643+0000 7f6cd9d32640 1 -- 172.21.15.98:0/3692398232 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd415ece0 con 0x7f6cd415ac00 2024-09-16T15:37:56.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.643+0000 7f6cd9d32640 1 -- 172.21.15.98:0/3692398232 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f6cd415ee60 con 0x7f6cd40ce910 2024-09-16T15:37:56.646 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.643+0000 7f6cd37fe640 1 -- 172.21.15.98:0/3692398232 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6cd40ce910 msgr2=0x7f6cd415ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:56.646 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.643+0000 7f6cd37fe640 1 --2- 172.21.15.98:0/3692398232 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6cd40ce910 0x7f6cd415ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:56.646 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.643+0000 7f6cd37fe640 1 -- 172.21.15.98:0/3692398232 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6cd415ac00 msgr2=0x7f6cd40c9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:56.646 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.643+0000 7f6cd37fe640 1 --2- 172.21.15.98:0/3692398232 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6cd415ac00 0x7f6cd40c9950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:56.647 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.643+0000 7f6cd37fe640 1 -- 172.21.15.98:0/3692398232 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cd415e410 con 0x7f6cd4073cd0 2024-09-16T15:37:56.647 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.644+0000 7f6cd3fff640 1 --2- 172.21.15.98:0/3692398232 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6cd415ac00 0x7f6cd40c9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T15:37:56.647 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.644+0000 7f6cd37fe640 1 --2- 172.21.15.98:0/3692398232 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6cd4073cd0 0x7f6cd4153b90 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6cc400d9a0 tx=0x7f6cc400de60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:56.647 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.644+0000 7f6cbbfff640 1 -- 172.21.15.98:0/3692398232 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc4017070 con 0x7f6cd4073cd0 2024-09-16T15:37:56.647 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.644+0000 7f6cbbfff640 1 -- 172.21.15.98:0/3692398232 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6cc4009bd0 con 0x7f6cd4073cd0 2024-09-16T15:37:56.647 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.644+0000 7f6cd9d32640 1 -- 172.21.15.98:0/3692398232 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cd40cbf40 con 0x7f6cd4073cd0 2024-09-16T15:37:56.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.647+0000 7f6cbbfff640 1 -- 172.21.15.98:0/3692398232 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc4010460 con 0x7f6cd4073cd0 2024-09-16T15:37:56.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.647+0000 7f6cd9d32640 1 -- 172.21.15.98:0/3692398232 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cd40cbb80 con 0x7f6cd4073cd0 2024-09-16T15:37:56.650 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.648+0000 7f6cbbfff640 1 -- 172.21.15.98:0/3692398232 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7f6cc401a070 con 0x7f6cd4073cd0 2024-09-16T15:37:56.650 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.649+0000 7f6cd9d32640 1 -- 172.21.15.98:0/3692398232 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cd40d0740 con 0x7f6cd4073cd0 2024-09-16T15:37:56.651 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.649+0000 7f6cbbfff640 1 --2- 172.21.15.98:0/3692398232 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f6cc0078850 0x7f6cc007ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:56.651 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.649+0000 7f6cbbfff640 1 -- 172.21.15.98:0/3692398232 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f6cc4099fe0 con 0x7f6cd4073cd0 2024-09-16T15:37:56.652 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.650+0000 7f6cd2ffd640 1 --2- 172.21.15.98:0/3692398232 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f6cc0078850 0x7f6cc007ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:56.652 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.651+0000 7f6cd2ffd640 1 --2- 172.21.15.98:0/3692398232 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f6cc0078850 0x7f6cc007ad10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6cd415ccf0 tx=0x7f6cc800b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:56.661 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.660+0000 7f6cbbfff640 1 -- 172.21.15.98:0/3692398232 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7f6cd40d0740 con 0x7f6cd4073cd0 2024-09-16T15:37:56.662 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.660+0000 7fda32c80640 1 -- 172.21.15.98:0/2821059645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda2c074ca0 msgr2=0x7fda2c160140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:56.662 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.660+0000 7fda32c80640 1 --2- 172.21.15.98:0/2821059645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda2c074ca0 0x7fda2c160140 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fda24005fd0 tx=0x7fda2402a940 comp rx=0 tx=0).stop 2024-09-16T15:37:56.662 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.660+0000 7f38e8247640 1 -- 172.21.15.98:0/1388780338 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f38e0073840 msgr2=0x7f38e015bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:56.662 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.660+0000 7f38e8247640 1 --2- 172.21.15.98:0/1388780338 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f38e0073840 0x7f38e015bb90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f38dc009830 tx=0x7f38dc02a520 comp rx=0 tx=0).stop 2024-09-16T15:37:56.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.660+0000 7fda32c80640 1 -- 172.21.15.98:0/2821059645 shutdown_connections 2024-09-16T15:37:56.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.660+0000 7fda32c80640 1 --2- 172.21.15.98:0/2821059645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda2c074ca0 0x7fda2c160140 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:56.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.660+0000 7fda32c80640 1 -- 172.21.15.98:0/2821059645 >> 172.21.15.98:0/2821059645 conn(0x7fda2c0733e0 msgr2=0x7fda2c0d02b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:56.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.660+0000 7f38e8247640 1 -- 172.21.15.98:0/1388780338 shutdown_connections 2024-09-16T15:37:56.664 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.660+0000 7f38e8247640 1 --2- 172.21.15.98:0/1388780338 >> v2:172.21.15.98:3300/0 conn(0x7f38e0073c20 0x7f38e015e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:56.664 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.660+0000 7f38e8247640 1 --2- 172.21.15.98:0/1388780338 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f38e0073840 0x7f38e015bb90 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:56.664 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.660+0000 7f38e8247640 1 -- 172.21.15.98:0/1388780338 >> 172.21.15.98:0/1388780338 conn(0x7f38e00d0cb0 msgr2=0x7f38e00d10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:56.664 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.660+0000 7fda32c80640 1 -- 172.21.15.98:0/2821059645 shutdown_connections 2024-09-16T15:37:56.664 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.660+0000 7fda32c80640 1 -- 172.21.15.98:0/2821059645 wait complete. 2024-09-16T15:37:56.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.660+0000 7f38e8247640 1 -- 172.21.15.98:0/1388780338 shutdown_connections 2024-09-16T15:37:56.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.660+0000 7f38e8247640 1 -- 172.21.15.98:0/1388780338 wait complete. 2024-09-16T15:37:56.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.661+0000 7fe0e985a640 1 -- 172.21.15.98:0/2903764575 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe0e40cf720 msgr2=0x7fe0e40b41d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:56.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.661+0000 7fe0e985a640 1 --2- 172.21.15.98:0/2903764575 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe0e40cf720 0x7fe0e40b41d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe0e406fc10 tx=0x7fe0dc02aa30 comp rx=0 tx=0).stop 2024-09-16T15:37:56.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.661+0000 7fec5bfc2640 1 -- 172.21.15.98:0/2900455974 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fec540737d0 msgr2=0x7fec54073c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:56.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.661+0000 7fec5bfc2640 1 --2- 172.21.15.98:0/2900455974 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fec540737d0 0x7fec54073c20 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fec540cb320 tx=0x7fec4c02a8b0 comp rx=0 tx=0).stop 2024-09-16T15:37:56.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.661+0000 7fe0e985a640 1 -- 172.21.15.98:0/2903764575 shutdown_connections 2024-09-16T15:37:56.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.661+0000 7fe0e985a640 1 --2- 172.21.15.98:0/2903764575 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe0e40cf720 0x7fe0e40b41d0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:56.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.661+0000 7fe0e985a640 1 --2- 172.21.15.98:0/2903764575 >> v2:172.21.15.135:3300/0 conn(0x7fe0e415e240 0x7fe0e40cead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:56.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.661+0000 7fe0e985a640 1 -- 172.21.15.98:0/2903764575 >> 172.21.15.98:0/2903764575 conn(0x7fe0e40d3fc0 msgr2=0x7fe0e40d43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:56.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.661+0000 7fe0e985a640 1 -- 172.21.15.98:0/2903764575 shutdown_connections 2024-09-16T15:37:56.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.661+0000 7fe0e985a640 1 -- 172.21.15.98:0/2903764575 wait complete. 2024-09-16T15:37:56.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.662+0000 7fda32c80640 1 Processor -- start 2024-09-16T15:37:56.667 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.662+0000 7f38e8247640 1 Processor -- start 2024-09-16T15:37:56.667 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.662+0000 7fda32c80640 1 -- start start 2024-09-16T15:37:56.667 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.662+0000 7fec5bfc2640 1 -- 172.21.15.98:0/2900455974 shutdown_connections 2024-09-16T15:37:56.667 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.662+0000 7fec5bfc2640 1 --2- 172.21.15.98:0/2900455974 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fec540737d0 0x7fec54073c20 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:56.667 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.662+0000 7fec5bfc2640 1 --2- 172.21.15.98:0/2900455974 >> v2:172.21.15.135:3300/0 conn(0x7fec5415be40 0x7fec5415f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:56.668 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.662+0000 7fec5bfc2640 1 -- 172.21.15.98:0/2900455974 >> 172.21.15.98:0/2900455974 conn(0x7fec540d0d40 msgr2=0x7fec540d1150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:56.668 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.662+0000 7fec5bfc2640 1 -- 172.21.15.98:0/2900455974 shutdown_connections 2024-09-16T15:37:56.668 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.662+0000 7f38e8247640 1 -- start start 2024-09-16T15:37:56.668 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.662+0000 7fec5bfc2640 1 -- 172.21.15.98:0/2900455974 wait complete. 2024-09-16T15:37:56.668 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.663+0000 7fda32c80640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda2c074ca0 0x7fda2c1f3100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:56.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.663+0000 7fe0e985a640 1 Processor -- start 2024-09-16T15:37:56.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.663+0000 7fda32c80640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda2c0cf2d0 0x7fda2c0c9440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:56.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.663+0000 7fe0e985a640 1 -- start start 2024-09-16T15:37:56.670 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.663+0000 7fda32c80640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fda2c0d0f80 0x7fda2c0c9980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:56.670 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.663+0000 7fda32c80640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fda2c0cc290 con 0x7fda2c0d0f80 2024-09-16T15:37:56.670 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.663+0000 7fda32c80640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fda2c0cc410 con 0x7fda2c0cf2d0 2024-09-16T15:37:56.670 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.663+0000 7fda32c80640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fda2c0cc590 con 0x7fda2c074ca0 2024-09-16T15:37:56.670 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.663+0000 7fda3247f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fda2c0d0f80 0x7fda2c0c9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:56.671 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.663+0000 7f38e8247640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f38e0073840 0x7f38e0158e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:56.671 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.663+0000 7fda3147d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda2c0cf2d0 0x7fda2c0c9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:56.671 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.663+0000 7fda3147d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda2c0cf2d0 0x7fda2c0c9440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.98:32946/0 (socket says 172.21.15.98:32946) 2024-09-16T15:37:56.671 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.663+0000 7f38e8247640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f38e0073c20 0x7f38e00c6e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:56.672 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.663+0000 7fda3147d640 1 -- 172.21.15.98:0/4180696438 learned_addr learned my addr 172.21.15.98:0/4180696438 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:37:56.672 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.664+0000 7f38e8247640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38e015ec90 0x7f38e00c73d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:56.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.664+0000 7f38e5fe3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f38e0073840 0x7f38e0158e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:56.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.664+0000 7f38e5fe3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f38e0073840 0x7f38e0158e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:32904/0 (socket says 172.21.15.98:32904) 2024-09-16T15:37:56.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.664+0000 7f38e5fe3640 1 -- 172.21.15.98:0/2092917254 learned_addr learned my addr 172.21.15.98:0/2092917254 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:37:56.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.664+0000 7f38e8247640 1 -- 172.21.15.98:0/2092917254 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f38e00cd000 con 0x7f38e0073840 2024-09-16T15:37:56.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.664+0000 7f38e67e4640 1 --2- 172.21.15.98:0/2092917254 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38e015ec90 0x7f38e00c73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:56.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.664+0000 7fda3147d640 1 -- 172.21.15.98:0/4180696438 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda2c074ca0 msgr2=0x7fda2c1f3100 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-16T15:37:56.674 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.664+0000 7f38e8247640 1 -- 172.21.15.98:0/2092917254 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f38e00d04a0 con 0x7f38e015ec90 2024-09-16T15:37:56.674 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.664+0000 7f38e8247640 1 -- 172.21.15.98:0/2092917254 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f38e00cd180 con 0x7f38e0073c20 2024-09-16T15:37:56.674 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.664+0000 7fda3147d640 1 --2- 172.21.15.98:0/4180696438 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda2c074ca0 0x7fda2c1f3100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:56.674 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.664+0000 7fda3147d640 1 -- 172.21.15.98:0/4180696438 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fda2c0d0f80 msgr2=0x7fda2c0c9980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:56.674 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.664+0000 7fda3147d640 1 --2- 172.21.15.98:0/4180696438 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fda2c0d0f80 0x7fda2c0c9980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:56.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.664+0000 7fda3147d640 1 -- 172.21.15.98:0/4180696438 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda2c0c7aa0 con 0x7fda2c0cf2d0 2024-09-16T15:37:56.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.664+0000 7fda3147d640 1 --2- 172.21.15.98:0/4180696438 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda2c0cf2d0 0x7fda2c0c9440 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fda1c00c400 tx=0x7fda1c00c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:56.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.665+0000 7fda227fc640 1 -- 172.21.15.98:0/4180696438 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda1c011790 con 0x7fda2c0cf2d0 2024-09-16T15:37:56.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.665+0000 7fec5bfc2640 1 Processor -- start 2024-09-16T15:37:56.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.664+0000 7f38e5fe3640 1 -- 172.21.15.98:0/2092917254 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f38e0073c20 msgr2=0x7f38e00c6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:56.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.664+0000 7f38e5fe3640 1 --2- 172.21.15.98:0/2092917254 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f38e0073c20 0x7f38e00c6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:56.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.664+0000 7f38e5fe3640 1 -- 172.21.15.98:0/2092917254 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38e015ec90 msgr2=0x7f38e00c73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:56.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.664+0000 7f38e5fe3640 1 --2- 172.21.15.98:0/2092917254 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38e015ec90 0x7f38e00c73d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:56.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.664+0000 7f38e5fe3640 1 -- 172.21.15.98:0/2092917254 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38e00c9c60 con 0x7f38e0073840 2024-09-16T15:37:56.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.665+0000 7fe0e985a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0e40cf720 0x7fe0e415b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:56.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.665+0000 7fec5bfc2640 1 -- start start 2024-09-16T15:37:56.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.665+0000 7fda32c80640 1 -- 172.21.15.98:0/4180696438 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda2c0c7d80 con 0x7fda2c0cf2d0 2024-09-16T15:37:56.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.665+0000 7fe0e985a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe0e415e240 0x7fe0e414d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:56.677 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.665+0000 7fda32c80640 1 -- 172.21.15.98:0/4180696438 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda2c0c8340 con 0x7fda2c0cf2d0 2024-09-16T15:37:56.677 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.665+0000 7fe0e2ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0e40cf720 0x7fe0e415b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:56.678 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.665+0000 7fe0e2ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0e40cf720 0x7fe0e415b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.98:32970/0 (socket says 172.21.15.98:32970) 2024-09-16T15:37:56.678 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.665+0000 7fe0e985a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe0e415ccb0 0x7fe0e40b8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:56.678 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.665+0000 7fe0e2ffd640 1 -- 172.21.15.98:0/4256659351 learned_addr learned my addr 172.21.15.98:0/4256659351 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:37:56.678 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.665+0000 7fe0e985a640 1 -- 172.21.15.98:0/4256659351 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe0e40b4890 con 0x7fe0e415e240 2024-09-16T15:37:56.678 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.665+0000 7fe0e985a640 1 -- 172.21.15.98:0/4256659351 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe0e40b4710 con 0x7fe0e40cf720 2024-09-16T15:37:56.678 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.665+0000 7fe0e985a640 1 -- 172.21.15.98:0/4256659351 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fe0e40b4a10 con 0x7fe0e415ccb0 2024-09-16T15:37:56.678 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.665+0000 7fda227fc640 1 -- 172.21.15.98:0/4180696438 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fda1c017070 con 0x7fda2c0cf2d0 2024-09-16T15:37:56.678 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.665+0000 7fda227fc640 1 -- 172.21.15.98:0/4180696438 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda1c011ce0 con 0x7fda2c0cf2d0 2024-09-16T15:37:56.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.665+0000 7fe0e37fe640 1 --2- 172.21.15.98:0/4256659351 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe0e415ccb0 0x7fe0e40b8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:56.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.666+0000 7fe0dbfff640 1 --2- 172.21.15.98:0/4256659351 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe0e415e240 0x7fe0e414d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:56.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.666+0000 7fe0e2ffd640 1 -- 172.21.15.98:0/4256659351 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe0e415ccb0 msgr2=0x7fe0e40b8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:56.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.666+0000 7fe0e2ffd640 1 --2- 172.21.15.98:0/4256659351 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe0e415ccb0 0x7fe0e40b8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:56.680 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.665+0000 7f38e5fe3640 1 --2- 172.21.15.98:0/2092917254 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f38e0073840 0x7f38e0158e10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f38dc02ab10 tx=0x7f38dc032c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:56.680 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.665+0000 7f38d67fc640 1 -- 172.21.15.98:0/2092917254 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38dc040070 con 0x7f38e0073840 2024-09-16T15:37:56.680 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.665+0000 7f38d67fc640 1 -- 172.21.15.98:0/2092917254 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f38dc005310 con 0x7f38e0073840 2024-09-16T15:37:56.680 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.665+0000 7f38d67fc640 1 -- 172.21.15.98:0/2092917254 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38dc0047a0 con 0x7f38e0073840 2024-09-16T15:37:56.680 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.666+0000 7fe0e2ffd640 1 -- 172.21.15.98:0/4256659351 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe0e415e240 msgr2=0x7fe0e414d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:56.680 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.666+0000 7f38e8247640 1 -- 172.21.15.98:0/2092917254 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38e015abe0 con 0x7f38e0073840 2024-09-16T15:37:56.681 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.666+0000 7fe0e2ffd640 1 --2- 172.21.15.98:0/4256659351 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe0e415e240 0x7fe0e414d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:56.681 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.666+0000 7fec5bfc2640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fec540737d0 0x7fec54147750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:56.681 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.666+0000 7fe0e2ffd640 1 -- 172.21.15.98:0/4256659351 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0e415bc80 con 0x7fe0e40cf720 2024-09-16T15:37:56.681 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.666+0000 7fe0e37fe640 1 --2- 172.21.15.98:0/4256659351 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe0e415ccb0 0x7fe0e40b8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T15:37:56.681 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.666+0000 7f38e8247640 1 -- 172.21.15.98:0/2092917254 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38e015b1a0 con 0x7f38e0073840 2024-09-16T15:37:56.682 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.666+0000 7fe0dbfff640 1 --2- 172.21.15.98:0/4256659351 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe0e415e240 0x7fe0e414d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T15:37:56.682 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.666+0000 7fe0e2ffd640 1 --2- 172.21.15.98:0/4256659351 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0e40cf720 0x7fe0e415b430 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe0d400e790 tx=0x7fe0d400ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:56.683 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.666+0000 7fec59d5e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fec540737d0 0x7fec54147750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:56.683 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.666+0000 7fec5bfc2640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fec5415be40 0x7fec541f27c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:56.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.666+0000 7fec59d5e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fec540737d0 0x7fec54147750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:32920/0 (socket says 172.21.15.98:32920) 2024-09-16T15:37:56.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.666+0000 7fec5bfc2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fec5415ede0 0x7fec540b58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:56.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.667+0000 7fec5955d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fec5415be40 0x7fec541f27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:56.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.667+0000 7fec5955d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fec5415be40 0x7fec541f27c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.98:39852/0 (socket says 172.21.15.98:39852) 2024-09-16T15:37:56.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.667+0000 7fec5bfc2640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fec540af010 con 0x7fec540737d0 2024-09-16T15:37:56.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.667+0000 7fec5bfc2640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fec540aee90 con 0x7fec5415ede0 2024-09-16T15:37:56.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.667+0000 7fec5bfc2640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fec540af190 con 0x7fec5415be40 2024-09-16T15:37:56.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.667+0000 7fec5a55f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fec5415ede0 0x7fec540b58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:56.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.667+0000 7fec59d5e640 1 -- 172.21.15.98:0/2605213320 learned_addr learned my addr 172.21.15.98:0/2605213320 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:37:56.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.668+0000 7fec5a55f640 1 -- 172.21.15.98:0/2605213320 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fec5415be40 msgr2=0x7fec541f27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:56.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.668+0000 7fec5a55f640 1 --2- 172.21.15.98:0/2605213320 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fec5415be40 0x7fec541f27c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:56.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.668+0000 7fec5a55f640 1 -- 172.21.15.98:0/2605213320 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fec540737d0 msgr2=0x7fec54147750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:56.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.668+0000 7fec5a55f640 1 --2- 172.21.15.98:0/2605213320 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fec540737d0 0x7fec54147750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:56.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.668+0000 7fec5a55f640 1 -- 172.21.15.98:0/2605213320 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec54147c90 con 0x7fec5415ede0 2024-09-16T15:37:56.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.668+0000 7fda227fc640 1 -- 172.21.15.98:0/4180696438 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7fda1c01c460 con 0x7fda2c0cf2d0 2024-09-16T15:37:56.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.668+0000 7fec59d5e640 1 --2- 172.21.15.98:0/2605213320 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fec540737d0 0x7fec54147750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T15:37:56.686 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.667+0000 7fe0e0ff9640 1 -- 172.21.15.98:0/4256659351 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d400eea0 con 0x7fe0e40cf720 2024-09-16T15:37:56.686 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.667+0000 7fe0e0ff9640 1 -- 172.21.15.98:0/4256659351 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe0d400cdb0 con 0x7fe0e40cf720 2024-09-16T15:37:56.686 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.668+0000 7fe0e0ff9640 1 -- 172.21.15.98:0/4256659351 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d4010690 con 0x7fe0e40cf720 2024-09-16T15:37:56.686 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.668+0000 7fec5a55f640 1 --2- 172.21.15.98:0/2605213320 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fec5415ede0 0x7fec540b58b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fec4c009000 tx=0x7fec4c003ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:56.687 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.668+0000 7fe0e985a640 1 -- 172.21.15.98:0/4256659351 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0e40b7fd0 con 0x7fe0e40cf720 2024-09-16T15:37:56.687 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.668+0000 7fe0e985a640 1 -- 172.21.15.98:0/4256659351 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0e40b8590 con 0x7fe0e40cf720 2024-09-16T15:37:56.688 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.668+0000 7fec4a7fc640 1 -- 172.21.15.98:0/2605213320 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec4c040070 con 0x7fec5415ede0 2024-09-16T15:37:56.688 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.669+0000 7fec4a7fc640 1 -- 172.21.15.98:0/2605213320 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fec4c004370 con 0x7fec5415ede0 2024-09-16T15:37:56.688 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.669+0000 7fec5bfc2640 1 -- 172.21.15.98:0/2605213320 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec54152450 con 0x7fec5415ede0 2024-09-16T15:37:56.688 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.669+0000 7fda227fc640 1 --2- 172.21.15.98:0/4180696438 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fda10078850 0x7fda1007ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:56.688 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.669+0000 7fec5bfc2640 1 -- 172.21.15.98:0/2605213320 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec54152a10 con 0x7fec5415ede0 2024-09-16T15:37:56.689 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.669+0000 7fda227fc640 1 -- 172.21.15.98:0/4180696438 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fda1c09a5c0 con 0x7fda2c0cf2d0 2024-09-16T15:37:56.689 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.669+0000 7f38d67fc640 1 -- 172.21.15.98:0/2092917254 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7f38dc039040 con 0x7f38e0073840 2024-09-16T15:37:56.689 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.669+0000 7fec4a7fc640 1 -- 172.21.15.98:0/2605213320 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec4c0047c0 con 0x7fec5415ede0 2024-09-16T15:37:56.689 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.669+0000 7f38d67fc640 1 --2- 172.21.15.98:0/2092917254 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f38c407cd30 0x7f38c407f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:56.690 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.669+0000 7fe0e985a640 1 -- 172.21.15.98:0/4256659351 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0e40b41d0 con 0x7fe0e40cf720 2024-09-16T15:37:56.690 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.670+0000 7fda31c7e640 1 --2- 172.21.15.98:0/4180696438 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fda10078850 0x7fda1007ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:56.690 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.670+0000 7fda31c7e640 1 --2- 172.21.15.98:0/4180696438 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fda10078850 0x7fda1007ad10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fda2c0d0870 tx=0x7fda280079b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:56.690 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.671+0000 7fe0e0ff9640 1 -- 172.21.15.98:0/4256659351 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7fe0d4010830 con 0x7fe0e40cf720 2024-09-16T15:37:56.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.670+0000 7f38e57e2640 1 --2- 172.21.15.98:0/2092917254 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f38c407cd30 0x7f38c407f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:56.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.670+0000 7f38e8247640 1 -- 172.21.15.98:0/2092917254 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38c8005290 con 0x7f38e0073840 2024-09-16T15:37:56.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.671+0000 7f38e57e2640 1 --2- 172.21.15.98:0/2092917254 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f38c407cd30 0x7f38c407f1f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f38e00caea0 tx=0x7f38d0005a20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:56.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.670+0000 7f38d67fc640 1 -- 172.21.15.98:0/2092917254 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f38dc0bbb90 con 0x7f38e0073840 2024-09-16T15:37:56.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.671+0000 7fda32c80640 1 -- 172.21.15.98:0/4180696438 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda14005290 con 0x7fda2c0cf2d0 2024-09-16T15:37:56.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.671+0000 7fec37fff640 1 -- 172.21.15.98:0/2605213320 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec30005290 con 0x7fec5415ede0 2024-09-16T15:37:56.692 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.672+0000 7fe0e0ff9640 1 --2- 172.21.15.98:0/4256659351 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fe0c4078950 0x7fe0c407ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:56.692 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.672+0000 7fec4a7fc640 1 -- 172.21.15.98:0/2605213320 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7fec4c039040 con 0x7fec5415ede0 2024-09-16T15:37:56.692 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.672+0000 7fe0e0ff9640 1 -- 172.21.15.98:0/4256659351 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fe0d409b6c0 con 0x7fe0e40cf720 2024-09-16T15:37:56.692 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.672+0000 7fe0dbfff640 1 --2- 172.21.15.98:0/4256659351 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fe0c4078950 0x7fe0c407ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:56.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.672+0000 7fec4a7fc640 1 --2- 172.21.15.98:0/2605213320 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fec38078920 0x7fec3807ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:56.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.672+0000 7fec4a7fc640 1 -- 172.21.15.98:0/2605213320 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fec4c0bbd80 con 0x7fec5415ede0 2024-09-16T15:37:56.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.672+0000 7fec59d5e640 1 --2- 172.21.15.98:0/2605213320 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fec38078920 0x7fec3807ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:56.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.673+0000 7fe0dbfff640 1 --2- 172.21.15.98:0/4256659351 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fe0c4078950 0x7fe0c407ae10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc007fd0 tx=0x7fe0cc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:56.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.673+0000 7fec59d5e640 1 --2- 172.21.15.98:0/2605213320 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fec38078920 0x7fec3807ade0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fec50001bd0 tx=0x7fec50007f50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:56.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.675+0000 7fe0e0ff9640 1 -- 172.21.15.98:0/4256659351 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7fe0d40636c0 con 0x7fe0e40cf720 2024-09-16T15:37:56.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.676+0000 7f38d67fc640 1 -- 172.21.15.98:0/2092917254 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7f38dc0841e0 con 0x7f38e0073840 2024-09-16T15:37:56.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.679+0000 7fda227fc640 1 -- 172.21.15.98:0/4180696438 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7fda1c062c30 con 0x7fda2c0cf2d0 2024-09-16T15:37:56.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.684+0000 7fec4a7fc640 1 -- 172.21.15.98:0/2605213320 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7fec4c084550 con 0x7fec5415ede0 2024-09-16T15:37:56.890 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.888+0000 7f649cc48640 1 -- 172.21.15.98:0/2873305458 --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f64980b5950 con 0x7f649815bb80 2024-09-16T15:37:56.890 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.888+0000 7f6486ffd640 1 -- 172.21.15.98:0/2873305458 <== mon.2 v2:172.21.15.135:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f649006bee0 con 0x7f649815bb80 2024-09-16T15:37:56.890 INFO:teuthology.orchestra.run.smithi098.stdout:64424509449 2024-09-16T15:37:56.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.890+0000 7f649cc48640 1 -- 172.21.15.98:0/2873305458 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f6478078850 msgr2=0x7f647807ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:56.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.890+0000 7f649cc48640 1 --2- 172.21.15.98:0/2873305458 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f6478078850 0x7f647807ad10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f648c009670 tx=0x7f648c005f90 comp rx=0 tx=0).stop 2024-09-16T15:37:56.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.890+0000 7f649cc48640 1 -- 172.21.15.98:0/2873305458 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f649815bb80 msgr2=0x7f64980ca850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:56.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.890+0000 7f649cc48640 1 --2- 172.21.15.98:0/2873305458 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f649815bb80 0x7f64980ca850 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f649000ea80 tx=0x7f649000ef40 comp rx=0 tx=0).stop 2024-09-16T15:37:56.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.891+0000 7f649cc48640 1 -- 172.21.15.98:0/2873305458 shutdown_connections 2024-09-16T15:37:56.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.891+0000 7f649cc48640 1 --2- 172.21.15.98:0/2873305458 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f649815bb80 0x7f64980ca850 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:56.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.891+0000 7f649cc48640 1 --2- 172.21.15.98:0/2873305458 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f6478078850 0x7f647807ad10 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:56.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.891+0000 7f649cc48640 1 --2- 172.21.15.98:0/2873305458 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64980cd220 0x7f649814aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:56.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.891+0000 7f649cc48640 1 --2- 172.21.15.98:0/2873305458 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f649806cb70 0x7f6498158380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:56.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.891+0000 7f649cc48640 1 -- 172.21.15.98:0/2873305458 >> 172.21.15.98:0/2873305458 conn(0x7f64980d0cb0 msgr2=0x7f64980b0670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:56.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.891+0000 7f649cc48640 1 -- 172.21.15.98:0/2873305458 shutdown_connections 2024-09-16T15:37:56.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.891+0000 7f649cc48640 1 -- 172.21.15.98:0/2873305458 wait complete. 2024-09-16T15:37:56.904 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.4 2024-09-16T15:37:56.904 DEBUG:teuthology.parallel:result is None 2024-09-16T15:37:56.958 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.956+0000 7fe0e985a640 1 -- 172.21.15.98:0/4256659351 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fe0e40d45f0 con 0x7fe0e40cf720 2024-09-16T15:37:56.958 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.957+0000 7fe0e0ff9640 1 -- 172.21.15.98:0/4256659351 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe0d40680f0 con 0x7fe0e40cf720 2024-09-16T15:37:56.959 INFO:teuthology.orchestra.run.smithi098.stdout:64424509449 2024-09-16T15:37:56.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.959+0000 7fe0e985a640 1 -- 172.21.15.98:0/4256659351 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fe0c4078950 msgr2=0x7fe0c407ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:56.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.959+0000 7fe0e985a640 1 --2- 172.21.15.98:0/4256659351 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fe0c4078950 0x7fe0c407ae10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc007fd0 tx=0x7fe0cc009040 comp rx=0 tx=0).stop 2024-09-16T15:37:56.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.959+0000 7fe0e985a640 1 -- 172.21.15.98:0/4256659351 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0e40cf720 msgr2=0x7fe0e415b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:56.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.959+0000 7fe0e985a640 1 --2- 172.21.15.98:0/4256659351 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0e40cf720 0x7fe0e415b430 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe0d400e790 tx=0x7fe0d400ec50 comp rx=0 tx=0).stop 2024-09-16T15:37:56.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.959+0000 7fe0e985a640 1 -- 172.21.15.98:0/4256659351 shutdown_connections 2024-09-16T15:37:56.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.959+0000 7fe0e985a640 1 --2- 172.21.15.98:0/4256659351 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe0e415ccb0 0x7fe0e40b8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:56.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.959+0000 7fe0e985a640 1 --2- 172.21.15.98:0/4256659351 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe0e415e240 0x7fe0e414d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:56.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.959+0000 7fe0e985a640 1 --2- 172.21.15.98:0/4256659351 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fe0c4078950 0x7fe0c407ae10 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:56.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.959+0000 7fe0e985a640 1 --2- 172.21.15.98:0/4256659351 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0e40cf720 0x7fe0e415b430 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:56.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.959+0000 7fe0e985a640 1 -- 172.21.15.98:0/4256659351 >> 172.21.15.98:0/4256659351 conn(0x7fe0e40d3fc0 msgr2=0x7fe0e406ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:56.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.959+0000 7fe0e985a640 1 -- 172.21.15.98:0/4256659351 shutdown_connections 2024-09-16T15:37:56.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.959+0000 7fe0e985a640 1 -- 172.21.15.98:0/4256659351 wait complete. 2024-09-16T15:37:56.976 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.3 2024-09-16T15:37:56.977 DEBUG:teuthology.parallel:result is None 2024-09-16T15:37:56.987 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.985+0000 7fdbd97fa640 1 -- 172.21.15.98:0/47310755 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fdbc8005580 con 0x7fdbe415bf10 2024-09-16T15:37:56.987 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.985+0000 7fdbdb7fe640 1 -- 172.21.15.98:0/47310755 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fdbe415fb90 con 0x7fdbe415bf10 2024-09-16T15:37:56.987 INFO:teuthology.orchestra.run.smithi098.stdout:64424509448 2024-09-16T15:37:56.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.988+0000 7fdbd97fa640 1 -- 172.21.15.98:0/47310755 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fdbc4078850 msgr2=0x7fdbc407ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:56.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.988+0000 7fdbd97fa640 1 --2- 172.21.15.98:0/47310755 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fdbc4078850 0x7fdbc407ad10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdbe415dc80 tx=0x7fdbd4005f90 comp rx=0 tx=0).stop 2024-09-16T15:37:56.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.989+0000 7fdbd97fa640 1 -- 172.21.15.98:0/47310755 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdbe415bf10 msgr2=0x7fdbe409e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:56.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.989+0000 7fdbd97fa640 1 --2- 172.21.15.98:0/47310755 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdbe415bf10 0x7fdbe409e590 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc009000 tx=0x7fdbdc032d30 comp rx=0 tx=0).stop 2024-09-16T15:37:56.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.989+0000 7fdbd97fa640 1 -- 172.21.15.98:0/47310755 shutdown_connections 2024-09-16T15:37:56.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.989+0000 7fdbd97fa640 1 --2- 172.21.15.98:0/47310755 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdbe415bf10 0x7fdbe409e590 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:56.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.989+0000 7fdbd97fa640 1 --2- 172.21.15.98:0/47310755 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fdbc4078850 0x7fdbc407ad10 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:56.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.989+0000 7fdbd97fa640 1 --2- 172.21.15.98:0/47310755 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdbe40d08e0 0x7fdbe415f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:56.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.989+0000 7fdbd97fa640 1 --2- 172.21.15.98:0/47310755 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdbe40cd6f0 0x7fdbe41f4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:56.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.989+0000 7fdbd97fa640 1 -- 172.21.15.98:0/47310755 >> 172.21.15.98:0/47310755 conn(0x7fdbe40d1e20 msgr2=0x7fdbe40caf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:56.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.989+0000 7fdbd97fa640 1 -- 172.21.15.98:0/47310755 shutdown_connections 2024-09-16T15:37:56.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.989+0000 7fdbd97fa640 1 -- 172.21.15.98:0/47310755 wait complete. 2024-09-16T15:37:56.999 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.998+0000 7fec37fff640 1 -- 172.21.15.98:0/2605213320 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fec30005580 con 0x7fec5415ede0 2024-09-16T15:37:57.000 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:56.998+0000 7fec4a7fc640 1 -- 172.21.15.98:0/2605213320 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fec4c088f80 con 0x7fec5415ede0 2024-09-16T15:37:57.000 INFO:teuthology.orchestra.run.smithi098.stdout:55834574855 2024-09-16T15:37:57.003 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.000+0000 7fec37fff640 1 -- 172.21.15.98:0/2605213320 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fec38078920 msgr2=0x7fec3807ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:57.003 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.000+0000 7fec37fff640 1 --2- 172.21.15.98:0/2605213320 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fec38078920 0x7fec3807ade0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fec50001bd0 tx=0x7fec50007f50 comp rx=0 tx=0).stop 2024-09-16T15:37:57.003 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.000+0000 7fec37fff640 1 -- 172.21.15.98:0/2605213320 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fec5415ede0 msgr2=0x7fec540b58b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:57.003 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.000+0000 7fec37fff640 1 --2- 172.21.15.98:0/2605213320 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fec5415ede0 0x7fec540b58b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fec4c009000 tx=0x7fec4c003ba0 comp rx=0 tx=0).stop 2024-09-16T15:37:57.003 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.000+0000 7fec37fff640 1 -- 172.21.15.98:0/2605213320 shutdown_connections 2024-09-16T15:37:57.003 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.000+0000 7fec37fff640 1 --2- 172.21.15.98:0/2605213320 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fec38078920 0x7fec3807ade0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:57.003 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.000+0000 7fec37fff640 1 --2- 172.21.15.98:0/2605213320 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fec5415ede0 0x7fec540b58b0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:57.003 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.000+0000 7fec37fff640 1 --2- 172.21.15.98:0/2605213320 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fec5415be40 0x7fec541f27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:57.003 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.000+0000 7fec37fff640 1 --2- 172.21.15.98:0/2605213320 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fec540737d0 0x7fec54147750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:57.003 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.000+0000 7fec37fff640 1 -- 172.21.15.98:0/2605213320 >> 172.21.15.98:0/2605213320 conn(0x7fec540d0d40 msgr2=0x7fec540cdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:57.003 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.001+0000 7fec37fff640 1 -- 172.21.15.98:0/2605213320 shutdown_connections 2024-09-16T15:37:57.003 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.001+0000 7fec37fff640 1 -- 172.21.15.98:0/2605213320 wait complete. 2024-09-16T15:37:57.005 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.5 2024-09-16T15:37:57.005 DEBUG:teuthology.parallel:result is None 2024-09-16T15:37:57.014 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.6 2024-09-16T15:37:57.014 DEBUG:teuthology.parallel:result is None 2024-09-16T15:37:57.033 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.031+0000 7fda32c80640 1 -- 172.21.15.98:0/4180696438 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fda14005850 con 0x7fda2c0cf2d0 2024-09-16T15:37:57.033 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.031+0000 7fda227fc640 1 -- 172.21.15.98:0/4180696438 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fda1c062530 con 0x7fda2c0cf2d0 2024-09-16T15:37:57.033 INFO:teuthology.orchestra.run.smithi098.stdout:64424509448 2024-09-16T15:37:57.035 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.033+0000 7f6cd9d32640 1 -- 172.21.15.98:0/3692398232 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f6cd40d0a90 con 0x7f6cd4073cd0 2024-09-16T15:37:57.035 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.033+0000 7fda32c80640 1 -- 172.21.15.98:0/4180696438 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fda10078850 msgr2=0x7fda1007ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:57.035 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.033+0000 7fda32c80640 1 --2- 172.21.15.98:0/4180696438 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fda10078850 0x7fda1007ad10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fda2c0d0870 tx=0x7fda280079b0 comp rx=0 tx=0).stop 2024-09-16T15:37:57.035 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.033+0000 7fda32c80640 1 -- 172.21.15.98:0/4180696438 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda2c0cf2d0 msgr2=0x7fda2c0c9440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:57.035 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.033+0000 7fda32c80640 1 --2- 172.21.15.98:0/4180696438 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda2c0cf2d0 0x7fda2c0c9440 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fda1c00c400 tx=0x7fda1c00c8c0 comp rx=0 tx=0).stop 2024-09-16T15:37:57.036 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.033+0000 7f6cbbfff640 1 -- 172.21.15.98:0/3692398232 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6cd415e410 con 0x7f6cd4073cd0 2024-09-16T15:37:57.036 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.034+0000 7fda32c80640 1 -- 172.21.15.98:0/4180696438 shutdown_connections 2024-09-16T15:37:57.036 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.034+0000 7fda32c80640 1 --2- 172.21.15.98:0/4180696438 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fda2c0d0f80 0x7fda2c0c9980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:57.036 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.034+0000 7fda32c80640 1 --2- 172.21.15.98:0/4180696438 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fda10078850 0x7fda1007ad10 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:57.036 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.034+0000 7fda32c80640 1 --2- 172.21.15.98:0/4180696438 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda2c0cf2d0 0x7fda2c0c9440 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:57.037 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.034+0000 7fda32c80640 1 --2- 172.21.15.98:0/4180696438 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fda2c074ca0 0x7fda2c1f3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:57.037 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.034+0000 7fda32c80640 1 -- 172.21.15.98:0/4180696438 >> 172.21.15.98:0/4180696438 conn(0x7fda2c0733e0 msgr2=0x7fda2c0b4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:57.037 INFO:teuthology.orchestra.run.smithi098.stdout:64424509449 2024-09-16T15:37:57.037 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.034+0000 7fda32c80640 1 -- 172.21.15.98:0/4180696438 shutdown_connections 2024-09-16T15:37:57.037 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.034+0000 7fda32c80640 1 -- 172.21.15.98:0/4180696438 wait complete. 2024-09-16T15:37:57.038 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.036+0000 7f6cd9d32640 1 -- 172.21.15.98:0/3692398232 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f6cc0078850 msgr2=0x7f6cc007ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:57.038 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.036+0000 7f6cd9d32640 1 --2- 172.21.15.98:0/3692398232 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f6cc0078850 0x7f6cc007ad10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6cd415ccf0 tx=0x7f6cc800b2e0 comp rx=0 tx=0).stop 2024-09-16T15:37:57.038 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.036+0000 7f6cd9d32640 1 -- 172.21.15.98:0/3692398232 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6cd4073cd0 msgr2=0x7f6cd4153b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:57.038 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.036+0000 7f6cd9d32640 1 --2- 172.21.15.98:0/3692398232 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6cd4073cd0 0x7f6cd4153b90 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6cc400d9a0 tx=0x7f6cc400de60 comp rx=0 tx=0).stop 2024-09-16T15:37:57.038 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.036+0000 7f6cd9d32640 1 -- 172.21.15.98:0/3692398232 shutdown_connections 2024-09-16T15:37:57.039 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.036+0000 7f6cd9d32640 1 --2- 172.21.15.98:0/3692398232 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f6cc0078850 0x7f6cc007ad10 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:57.039 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.036+0000 7f6cd9d32640 1 --2- 172.21.15.98:0/3692398232 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6cd415ac00 0x7f6cd40c9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:57.039 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.036+0000 7f6cd9d32640 1 --2- 172.21.15.98:0/3692398232 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6cd40ce910 0x7f6cd415ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:57.039 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.036+0000 7f6cd9d32640 1 --2- 172.21.15.98:0/3692398232 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6cd4073cd0 0x7f6cd4153b90 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:57.039 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.036+0000 7f6cd9d32640 1 -- 172.21.15.98:0/3692398232 >> 172.21.15.98:0/3692398232 conn(0x7f6cd40d0d40 msgr2=0x7f6cd40d1120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:57.039 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.036+0000 7f6cd9d32640 1 -- 172.21.15.98:0/3692398232 shutdown_connections 2024-09-16T15:37:57.039 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.036+0000 7f6cd9d32640 1 -- 172.21.15.98:0/3692398232 wait complete. 2024-09-16T15:37:57.047 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.7 2024-09-16T15:37:57.047 DEBUG:teuthology.parallel:result is None 2024-09-16T15:37:57.049 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.1 2024-09-16T15:37:57.049 DEBUG:teuthology.parallel:result is None 2024-09-16T15:37:57.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.058+0000 7f38e8247640 1 -- 172.21.15.98:0/2092917254 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f38c8005580 con 0x7f38e0073840 2024-09-16T15:37:57.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.058+0000 7f38d67fc640 1 -- 172.21.15.98:0/2092917254 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f38dc0bb070 con 0x7f38e0073840 2024-09-16T15:37:57.060 INFO:teuthology.orchestra.run.smithi098.stdout:64424509448 2024-09-16T15:37:57.063 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.060+0000 7f38e8247640 1 -- 172.21.15.98:0/2092917254 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f38c407cd30 msgr2=0x7f38c407f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:57.063 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.060+0000 7f38e8247640 1 --2- 172.21.15.98:0/2092917254 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f38c407cd30 0x7f38c407f1f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f38e00caea0 tx=0x7f38d0005a20 comp rx=0 tx=0).stop 2024-09-16T15:37:57.063 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.060+0000 7f38e8247640 1 -- 172.21.15.98:0/2092917254 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f38e0073840 msgr2=0x7f38e0158e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:57.063 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.060+0000 7f38e8247640 1 --2- 172.21.15.98:0/2092917254 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f38e0073840 0x7f38e0158e10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f38dc02ab10 tx=0x7f38dc032c10 comp rx=0 tx=0).stop 2024-09-16T15:37:57.063 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.060+0000 7f38e8247640 1 -- 172.21.15.98:0/2092917254 shutdown_connections 2024-09-16T15:37:57.063 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.060+0000 7f38e8247640 1 --2- 172.21.15.98:0/2092917254 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f38c407cd30 0x7f38c407f1f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:57.063 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.060+0000 7f38e8247640 1 --2- 172.21.15.98:0/2092917254 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38e015ec90 0x7f38e00c73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:57.063 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.060+0000 7f38e8247640 1 --2- 172.21.15.98:0/2092917254 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f38e0073c20 0x7f38e00c6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:57.063 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.060+0000 7f38e8247640 1 --2- 172.21.15.98:0/2092917254 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f38e0073840 0x7f38e0158e10 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:57.063 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.060+0000 7f38e8247640 1 -- 172.21.15.98:0/2092917254 >> 172.21.15.98:0/2092917254 conn(0x7f38e00d0cb0 msgr2=0x7f38e015dd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:57.063 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.060+0000 7f38e8247640 1 -- 172.21.15.98:0/2092917254 shutdown_connections 2024-09-16T15:37:57.063 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.061+0000 7f38e8247640 1 -- 172.21.15.98:0/2092917254 wait complete. 2024-09-16T15:37:57.072 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.2 2024-09-16T15:37:57.072 DEBUG:teuthology.parallel:result is None 2024-09-16T15:37:57.073 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-16T15:37:57.073 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T15:37:57.215 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.213+0000 7faebdda0640 1 -- 172.21.15.98:0/3947345606 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faeb80ce910 msgr2=0x7faeb8073790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:57.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.213+0000 7faebdda0640 1 --2- 172.21.15.98:0/3947345606 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faeb80ce910 0x7faeb8073790 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7faeb806f5a0 tx=0x7faea002a530 comp rx=0 tx=0).stop 2024-09-16T15:37:57.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.213+0000 7faebdda0640 1 -- 172.21.15.98:0/3947345606 shutdown_connections 2024-09-16T15:37:57.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.213+0000 7faebdda0640 1 --2- 172.21.15.98:0/3947345606 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faeb80ce910 0x7faeb8073790 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:57.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.213+0000 7faebdda0640 1 --2- 172.21.15.98:0/3947345606 >> v2:172.21.15.135:3300/0 conn(0x7faeb815ac00 0x7faeb80cf830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:57.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.213+0000 7faebdda0640 1 -- 172.21.15.98:0/3947345606 >> 172.21.15.98:0/3947345606 conn(0x7faeb80d0d40 msgr2=0x7faeb80d1120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:57.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.213+0000 7faebdda0640 1 -- 172.21.15.98:0/3947345606 shutdown_connections 2024-09-16T15:37:57.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.213+0000 7faebdda0640 1 -- 172.21.15.98:0/3947345606 wait complete. 2024-09-16T15:37:57.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.214+0000 7faebdda0640 1 Processor -- start 2024-09-16T15:37:57.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.215+0000 7faebdda0640 1 -- start start 2024-09-16T15:37:57.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.215+0000 7faebdda0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faeb8073cd0 0x7faeb80b59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:57.219 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.215+0000 7faebdda0640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faeb80ce910 0x7faeb80c3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:57.219 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.215+0000 7faebdda0640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faeb815ac00 0x7faeb814c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:57.219 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.215+0000 7faebdda0640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7faeb80719e0 con 0x7faeb80ce910 2024-09-16T15:37:57.219 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.215+0000 7faebdda0640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7faeb8071860 con 0x7faeb8073cd0 2024-09-16T15:37:57.219 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.215+0000 7faebdda0640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7faeb815eeb0 con 0x7faeb815ac00 2024-09-16T15:37:57.219 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.215+0000 7faeaffff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faeb80ce910 0x7faeb80c3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:57.219 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.215+0000 7faeaffff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faeb80ce910 0x7faeb80c3a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:32932/0 (socket says 172.21.15.98:32932) 2024-09-16T15:37:57.219 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.215+0000 7faeaffff640 1 -- 172.21.15.98:0/220544118 learned_addr learned my addr 172.21.15.98:0/220544118 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:37:57.219 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.216+0000 7faeb7fff640 1 --2- 172.21.15.98:0/220544118 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faeb815ac00 0x7faeb814c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:57.219 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.216+0000 7faeb77fe640 1 --2- 172.21.15.98:0/220544118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faeb8073cd0 0x7faeb80b59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:57.219 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.216+0000 7faeaffff640 1 -- 172.21.15.98:0/220544118 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faeb815ac00 msgr2=0x7faeb814c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:57.219 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.216+0000 7faeaffff640 1 --2- 172.21.15.98:0/220544118 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faeb815ac00 0x7faeb814c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:57.220 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.216+0000 7faeaffff640 1 -- 172.21.15.98:0/220544118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faeb8073cd0 msgr2=0x7faeb80b59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:57.220 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.216+0000 7faeaffff640 1 --2- 172.21.15.98:0/220544118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faeb8073cd0 0x7faeb80b59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:57.220 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.216+0000 7faeaffff640 1 -- 172.21.15.98:0/220544118 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faeb80b6a50 con 0x7faeb80ce910 2024-09-16T15:37:57.220 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.216+0000 7faeb77fe640 1 --2- 172.21.15.98:0/220544118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faeb8073cd0 0x7faeb80b59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T15:37:57.220 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.216+0000 7faeaffff640 1 --2- 172.21.15.98:0/220544118 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faeb80ce910 0x7faeb80c3a10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7faea0009780 tx=0x7faea0032d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:57.220 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.216+0000 7faeb4ff9640 1 -- 172.21.15.98:0/220544118 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea0040070 con 0x7faeb80ce910 2024-09-16T15:37:57.220 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.216+0000 7faeb4ff9640 1 -- 172.21.15.98:0/220544118 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faea0005310 con 0x7faeb80ce910 2024-09-16T15:37:57.220 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.216+0000 7faebdda0640 1 -- 172.21.15.98:0/220544118 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faeb80b5ee0 con 0x7faeb80ce910 2024-09-16T15:37:57.220 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.216+0000 7faeb4ff9640 1 -- 172.21.15.98:0/220544118 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea0003800 con 0x7faeb80ce910 2024-09-16T15:37:57.220 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.216+0000 7faebdda0640 1 -- 172.21.15.98:0/220544118 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faeb80b6490 con 0x7faeb80ce910 2024-09-16T15:37:57.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.217+0000 7faebdda0640 1 -- 172.21.15.98:0/220544118 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faeb815f370 con 0x7faeb80ce910 2024-09-16T15:37:57.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.218+0000 7faeb4ff9640 1 -- 172.21.15.98:0/220544118 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7faea0039040 con 0x7faeb80ce910 2024-09-16T15:37:57.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.218+0000 7faeb4ff9640 1 --2- 172.21.15.98:0/220544118 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fae98078850 0x7fae9807ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:57.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.218+0000 7faeb4ff9640 1 -- 172.21.15.98:0/220544118 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7faea00bbb90 con 0x7faeb80ce910 2024-09-16T15:37:57.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.219+0000 7faeb77fe640 1 --2- 172.21.15.98:0/220544118 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fae98078850 0x7fae9807ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:57.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.219+0000 7faeb77fe640 1 --2- 172.21.15.98:0/220544118 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fae98078850 0x7fae9807ad10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7faea8005fd0 tx=0x7faea8005e20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:57.224 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.223+0000 7faeb4ff9640 1 -- 172.21.15.98:0/220544118 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7faea0084200 con 0x7faeb80ce910 2024-09-16T15:37:57.398 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.396+0000 7faebdda0640 1 -- 172.21.15.98:0/220544118 --> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7faeb80b48a0 con 0x7fae98078850 2024-09-16T15:37:57.402 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.401+0000 7faeb4ff9640 1 -- 172.21.15.98:0/220544118 <== mgr.4100 v2:172.21.15.135:6800/699234772 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251822 (secure 0 0 0) 0x7faeb80b48a0 con 0x7fae98078850 2024-09-16T15:37:57.405 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:37:57.406 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2024-09-16T15:37:57.408 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.404+0000 7faebdda0640 1 -- 172.21.15.98:0/220544118 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fae98078850 msgr2=0x7fae9807ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:57.408 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.404+0000 7faebdda0640 1 --2- 172.21.15.98:0/220544118 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fae98078850 0x7fae9807ad10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7faea8005fd0 tx=0x7faea8005e20 comp rx=0 tx=0).stop 2024-09-16T15:37:57.408 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.404+0000 7faebdda0640 1 -- 172.21.15.98:0/220544118 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faeb80ce910 msgr2=0x7faeb80c3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:57.408 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.404+0000 7faebdda0640 1 --2- 172.21.15.98:0/220544118 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faeb80ce910 0x7faeb80c3a10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7faea0009780 tx=0x7faea0032d50 comp rx=0 tx=0).stop 2024-09-16T15:37:57.408 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.404+0000 7faebdda0640 1 -- 172.21.15.98:0/220544118 shutdown_connections 2024-09-16T15:37:57.408 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.404+0000 7faebdda0640 1 --2- 172.21.15.98:0/220544118 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7faeb815ac00 0x7faeb814c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:57.408 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.404+0000 7faebdda0640 1 --2- 172.21.15.98:0/220544118 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faeb80ce910 0x7faeb80c3a10 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:57.408 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.404+0000 7faebdda0640 1 --2- 172.21.15.98:0/220544118 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fae98078850 0x7fae9807ad10 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:57.408 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.404+0000 7faebdda0640 1 --2- 172.21.15.98:0/220544118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faeb8073cd0 0x7faeb80b59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:57.409 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.404+0000 7faebdda0640 1 -- 172.21.15.98:0/220544118 >> 172.21.15.98:0/220544118 conn(0x7faeb80d0d40 msgr2=0x7faeb80b3b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:57.409 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.404+0000 7faebdda0640 1 -- 172.21.15.98:0/220544118 shutdown_connections 2024-09-16T15:37:57.409 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.404+0000 7faebdda0640 1 -- 172.21.15.98:0/220544118 wait complete. 2024-09-16T15:37:57.417 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2024-09-16T15:37:56.711898+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219288,"kb_used_data":3048,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755432,"statfs":{"total":773094113280,"available":772869562368,"internally_reserved":0,"allocated":3121152,"data_stored":1835436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.189936"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.157551+0000","last_change":"2024-09-16T15:37:44.522255+0000","last_active":"2024-09-16T15:37:47.157551+0000","last_peered":"2024-09-16T15:37:47.157551+0000","last_clean":"2024-09-16T15:37:47.157551+0000","last_became_active":"2024-09-16T15:37:44.521954+0000","last_became_peered":"2024-09-16T15:37:44.521954+0000","last_unstale":"2024-09-16T15:37:47.157551+0000","last_undegraded":"2024-09-16T15:37:47.157551+0000","last_fullsized":"2024-09-16T15:37:47.157551+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:04:08.210631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.295767+0000","last_change":"2024-09-16T15:37:44.521698+0000","last_active":"2024-09-16T15:37:47.295767+0000","last_peered":"2024-09-16T15:37:47.295767+0000","last_clean":"2024-09-16T15:37:47.295767+0000","last_became_active":"2024-09-16T15:37:44.521108+0000","last_became_peered":"2024-09-16T15:37:44.521108+0000","last_unstale":"2024-09-16T15:37:47.295767+0000","last_undegraded":"2024-09-16T15:37:47.295767+0000","last_fullsized":"2024-09-16T15:37:47.295767+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:36:30.703573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.295614+0000","last_change":"2024-09-16T15:37:44.526656+0000","last_active":"2024-09-16T15:37:47.295614+0000","last_peered":"2024-09-16T15:37:47.295614+0000","last_clean":"2024-09-16T15:37:47.295614+0000","last_became_active":"2024-09-16T15:37:44.526371+0000","last_became_peered":"2024-09-16T15:37:44.526371+0000","last_unstale":"2024-09-16T15:37:47.295614+0000","last_undegraded":"2024-09-16T15:37:47.295614+0000","last_fullsized":"2024-09-16T15:37:47.295614+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:58:21.450388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:46.943693+0000","last_change":"2024-09-16T15:37:44.512933+0000","last_active":"2024-09-16T15:37:46.943693+0000","last_peered":"2024-09-16T15:37:46.943693+0000","last_clean":"2024-09-16T15:37:46.943693+0000","last_became_active":"2024-09-16T15:37:44.512675+0000","last_became_peered":"2024-09-16T15:37:44.512675+0000","last_unstale":"2024-09-16T15:37:46.943693+0000","last_undegraded":"2024-09-16T15:37:46.943693+0000","last_fullsized":"2024-09-16T15:37:46.943693+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:13:55.812269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.157367+0000","last_change":"2024-09-16T15:37:44.519918+0000","last_active":"2024-09-16T15:37:47.157367+0000","last_peered":"2024-09-16T15:37:47.157367+0000","last_clean":"2024-09-16T15:37:47.157367+0000","last_became_active":"2024-09-16T15:37:44.519424+0000","last_became_peered":"2024-09-16T15:37:44.519424+0000","last_unstale":"2024-09-16T15:37:47.157367+0000","last_undegraded":"2024-09-16T15:37:47.157367+0000","last_fullsized":"2024-09-16T15:37:47.157367+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:14:56.128121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:46.943654+0000","last_change":"2024-09-16T15:37:44.515343+0000","last_active":"2024-09-16T15:37:46.943654+0000","last_peered":"2024-09-16T15:37:46.943654+0000","last_clean":"2024-09-16T15:37:46.943654+0000","last_became_active":"2024-09-16T15:37:44.515130+0000","last_became_peered":"2024-09-16T15:37:44.515130+0000","last_unstale":"2024-09-16T15:37:46.943654+0000","last_undegraded":"2024-09-16T15:37:46.943654+0000","last_fullsized":"2024-09-16T15:37:46.943654+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:57:47.143508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.157210+0000","last_change":"2024-09-16T15:37:44.522713+0000","last_active":"2024-09-16T15:37:47.157210+0000","last_peered":"2024-09-16T15:37:47.157210+0000","last_clean":"2024-09-16T15:37:47.157210+0000","last_became_active":"2024-09-16T15:37:44.522455+0000","last_became_peered":"2024-09-16T15:37:44.522455+0000","last_unstale":"2024-09-16T15:37:47.157210+0000","last_undegraded":"2024-09-16T15:37:47.157210+0000","last_fullsized":"2024-09-16T15:37:47.157210+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:34:32.134838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.295408+0000","last_change":"2024-09-16T15:37:44.530623+0000","last_active":"2024-09-16T15:37:47.295408+0000","last_peered":"2024-09-16T15:37:47.295408+0000","last_clean":"2024-09-16T15:37:47.295408+0000","last_became_active":"2024-09-16T15:37:44.530278+0000","last_became_peered":"2024-09-16T15:37:44.530278+0000","last_unstale":"2024-09-16T15:37:47.295408+0000","last_undegraded":"2024-09-16T15:37:47.295408+0000","last_fullsized":"2024-09-16T15:37:47.295408+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T23:12:12.374603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.850903+0000","last_change":"2024-09-16T15:37:44.526860+0000","last_active":"2024-09-16T15:37:45.850903+0000","last_peered":"2024-09-16T15:37:45.850903+0000","last_clean":"2024-09-16T15:37:45.850903+0000","last_became_active":"2024-09-16T15:37:44.526611+0000","last_became_peered":"2024-09-16T15:37:44.526611+0000","last_unstale":"2024-09-16T15:37:45.850903+0000","last_undegraded":"2024-09-16T15:37:45.850903+0000","last_fullsized":"2024-09-16T15:37:45.850903+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:10:17.354173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.157550+0000","last_change":"2024-09-16T15:37:44.519349+0000","last_active":"2024-09-16T15:37:47.157550+0000","last_peered":"2024-09-16T15:37:47.157550+0000","last_clean":"2024-09-16T15:37:47.157550+0000","last_became_active":"2024-09-16T15:37:44.519074+0000","last_became_peered":"2024-09-16T15:37:44.519074+0000","last_unstale":"2024-09-16T15:37:47.157550+0000","last_undegraded":"2024-09-16T15:37:47.157550+0000","last_fullsized":"2024-09-16T15:37:47.157550+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T21:46:25.013947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.157206+0000","last_change":"2024-09-16T15:37:44.520396+0000","last_active":"2024-09-16T15:37:47.157206+0000","last_peered":"2024-09-16T15:37:47.157206+0000","last_clean":"2024-09-16T15:37:47.157206+0000","last_became_active":"2024-09-16T15:37:44.520166+0000","last_became_peered":"2024-09-16T15:37:44.520166+0000","last_unstale":"2024-09-16T15:37:47.157206+0000","last_undegraded":"2024-09-16T15:37:47.157206+0000","last_fullsized":"2024-09-16T15:37:47.157206+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:19:57.119675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.157296+0000","last_change":"2024-09-16T15:37:44.517541+0000","last_active":"2024-09-16T15:37:47.157296+0000","last_peered":"2024-09-16T15:37:47.157296+0000","last_clean":"2024-09-16T15:37:47.157296+0000","last_became_active":"2024-09-16T15:37:44.517304+0000","last_became_peered":"2024-09-16T15:37:44.517304+0000","last_unstale":"2024-09-16T15:37:47.157296+0000","last_undegraded":"2024-09-16T15:37:47.157296+0000","last_fullsized":"2024-09-16T15:37:47.157296+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:40:14.841427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.526086+0000","last_change":"2024-09-16T15:37:44.515572+0000","last_active":"2024-09-16T15:37:45.526086+0000","last_peered":"2024-09-16T15:37:45.526086+0000","last_clean":"2024-09-16T15:37:45.526086+0000","last_became_active":"2024-09-16T15:37:44.514667+0000","last_became_peered":"2024-09-16T15:37:44.514667+0000","last_unstale":"2024-09-16T15:37:45.526086+0000","last_undegraded":"2024-09-16T15:37:45.526086+0000","last_fullsized":"2024-09-16T15:37:45.526086+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:37:31.235473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.526350+0000","last_change":"2024-09-16T15:37:44.517134+0000","last_active":"2024-09-16T15:37:45.526350+0000","last_peered":"2024-09-16T15:37:45.526350+0000","last_clean":"2024-09-16T15:37:45.526350+0000","last_became_active":"2024-09-16T15:37:44.515946+0000","last_became_peered":"2024-09-16T15:37:44.515946+0000","last_unstale":"2024-09-16T15:37:45.526350+0000","last_undegraded":"2024-09-16T15:37:45.526350+0000","last_fullsized":"2024-09-16T15:37:45.526350+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:01:35.813267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.295391+0000","last_change":"2024-09-16T15:37:44.530620+0000","last_active":"2024-09-16T15:37:47.295391+0000","last_peered":"2024-09-16T15:37:47.295391+0000","last_clean":"2024-09-16T15:37:47.295391+0000","last_became_active":"2024-09-16T15:37:44.530286+0000","last_became_peered":"2024-09-16T15:37:44.530286+0000","last_unstale":"2024-09-16T15:37:47.295391+0000","last_undegraded":"2024-09-16T15:37:47.295391+0000","last_fullsized":"2024-09-16T15:37:47.295391+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T23:21:00.721426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.522970+0000","last_change":"2024-09-16T15:37:44.524560+0000","last_active":"2024-09-16T15:37:45.522970+0000","last_peered":"2024-09-16T15:37:45.522970+0000","last_clean":"2024-09-16T15:37:45.522970+0000","last_became_active":"2024-09-16T15:37:44.524314+0000","last_became_peered":"2024-09-16T15:37:44.524314+0000","last_unstale":"2024-09-16T15:37:45.522970+0000","last_undegraded":"2024-09-16T15:37:45.522970+0000","last_fullsized":"2024-09-16T15:37:45.522970+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:36:30.703573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.523673+0000","last_change":"2024-09-16T15:37:44.528374+0000","last_active":"2024-09-16T15:37:45.523673+0000","last_peered":"2024-09-16T15:37:45.523673+0000","last_clean":"2024-09-16T15:37:45.523673+0000","last_became_active":"2024-09-16T15:37:44.528131+0000","last_became_peered":"2024-09-16T15:37:44.528131+0000","last_unstale":"2024-09-16T15:37:45.523673+0000","last_undegraded":"2024-09-16T15:37:45.523673+0000","last_fullsized":"2024-09-16T15:37:45.523673+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:58:17.522035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:46.570682+0000","last_change":"2024-09-16T15:37:44.526873+0000","last_active":"2024-09-16T15:37:46.570682+0000","last_peered":"2024-09-16T15:37:46.570682+0000","last_clean":"2024-09-16T15:37:46.570682+0000","last_became_active":"2024-09-16T15:37:44.526627+0000","last_became_peered":"2024-09-16T15:37:44.526627+0000","last_unstale":"2024-09-16T15:37:46.570682+0000","last_undegraded":"2024-09-16T15:37:46.570682+0000","last_fullsized":"2024-09-16T15:37:46.570682+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:59:08.559983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.523655+0000","last_change":"2024-09-16T15:37:44.528216+0000","last_active":"2024-09-16T15:37:45.523655+0000","last_peered":"2024-09-16T15:37:45.523655+0000","last_clean":"2024-09-16T15:37:45.523655+0000","last_became_active":"2024-09-16T15:37:44.527905+0000","last_became_peered":"2024-09-16T15:37:44.527905+0000","last_unstale":"2024-09-16T15:37:45.523655+0000","last_undegraded":"2024-09-16T15:37:45.523655+0000","last_fullsized":"2024-09-16T15:37:45.523655+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:05:13.190051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.157271+0000","last_change":"2024-09-16T15:37:44.516828+0000","last_active":"2024-09-16T15:37:47.157271+0000","last_peered":"2024-09-16T15:37:47.157271+0000","last_clean":"2024-09-16T15:37:47.157271+0000","last_became_active":"2024-09-16T15:37:44.516568+0000","last_became_peered":"2024-09-16T15:37:44.516568+0000","last_unstale":"2024-09-16T15:37:47.157271+0000","last_undegraded":"2024-09-16T15:37:47.157271+0000","last_fullsized":"2024-09-16T15:37:47.157271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:15:29.298840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.525704+0000","last_change":"2024-09-16T15:37:44.512013+0000","last_active":"2024-09-16T15:37:45.525704+0000","last_peered":"2024-09-16T15:37:45.525704+0000","last_clean":"2024-09-16T15:37:45.525704+0000","last_became_active":"2024-09-16T15:37:44.511686+0000","last_became_peered":"2024-09-16T15:37:44.511686+0000","last_unstale":"2024-09-16T15:37:45.525704+0000","last_undegraded":"2024-09-16T15:37:45.525704+0000","last_fullsized":"2024-09-16T15:37:45.525704+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:50:11.538129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.850574+0000","last_change":"2024-09-16T15:37:44.517626+0000","last_active":"2024-09-16T15:37:45.850574+0000","last_peered":"2024-09-16T15:37:45.850574+0000","last_clean":"2024-09-16T15:37:45.850574+0000","last_became_active":"2024-09-16T15:37:44.516514+0000","last_became_peered":"2024-09-16T15:37:44.516514+0000","last_unstale":"2024-09-16T15:37:45.850574+0000","last_undegraded":"2024-09-16T15:37:45.850574+0000","last_fullsized":"2024-09-16T15:37:45.850574+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:54:51.338019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.295511+0000","last_change":"2024-09-16T15:37:44.524190+0000","last_active":"2024-09-16T15:37:47.295511+0000","last_peered":"2024-09-16T15:37:47.295511+0000","last_clean":"2024-09-16T15:37:47.295511+0000","last_became_active":"2024-09-16T15:37:44.523875+0000","last_became_peered":"2024-09-16T15:37:44.523875+0000","last_unstale":"2024-09-16T15:37:47.295511+0000","last_undegraded":"2024-09-16T15:37:47.295511+0000","last_fullsized":"2024-09-16T15:37:47.295511+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:20:20.809747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.522981+0000","last_change":"2024-09-16T15:37:44.524747+0000","last_active":"2024-09-16T15:37:45.522981+0000","last_peered":"2024-09-16T15:37:45.522981+0000","last_clean":"2024-09-16T15:37:45.522981+0000","last_became_active":"2024-09-16T15:37:44.524500+0000","last_became_peered":"2024-09-16T15:37:44.524500+0000","last_unstale":"2024-09-16T15:37:45.522981+0000","last_undegraded":"2024-09-16T15:37:45.522981+0000","last_fullsized":"2024-09-16T15:37:45.522981+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:04:08.210631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.295685+0000","last_change":"2024-09-16T15:37:44.517306+0000","last_active":"2024-09-16T15:37:47.295685+0000","last_peered":"2024-09-16T15:37:47.295685+0000","last_clean":"2024-09-16T15:37:47.295685+0000","last_became_active":"2024-09-16T15:37:44.516741+0000","last_became_peered":"2024-09-16T15:37:44.516741+0000","last_unstale":"2024-09-16T15:37:47.295685+0000","last_undegraded":"2024-09-16T15:37:47.295685+0000","last_fullsized":"2024-09-16T15:37:47.295685+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:40:00.773616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:46.943914+0000","last_change":"2024-09-16T15:37:44.519625+0000","last_active":"2024-09-16T15:37:46.943914+0000","last_peered":"2024-09-16T15:37:46.943914+0000","last_clean":"2024-09-16T15:37:46.943914+0000","last_became_active":"2024-09-16T15:37:44.519337+0000","last_became_peered":"2024-09-16T15:37:44.519337+0000","last_unstale":"2024-09-16T15:37:46.943914+0000","last_undegraded":"2024-09-16T15:37:46.943914+0000","last_fullsized":"2024-09-16T15:37:46.943914+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T21:56:02.373459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.526539+0000","last_change":"2024-09-16T15:37:44.519708+0000","last_active":"2024-09-16T15:37:45.526539+0000","last_peered":"2024-09-16T15:37:45.526539+0000","last_clean":"2024-09-16T15:37:45.526539+0000","last_became_active":"2024-09-16T15:37:44.519439+0000","last_became_peered":"2024-09-16T15:37:44.519439+0000","last_unstale":"2024-09-16T15:37:45.526539+0000","last_undegraded":"2024-09-16T15:37:45.526539+0000","last_fullsized":"2024-09-16T15:37:45.526539+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:56:40.956164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.526026+0000","last_change":"2024-09-16T15:37:44.518861+0000","last_active":"2024-09-16T15:37:45.526026+0000","last_peered":"2024-09-16T15:37:45.526026+0000","last_clean":"2024-09-16T15:37:45.526026+0000","last_became_active":"2024-09-16T15:37:44.518600+0000","last_became_peered":"2024-09-16T15:37:44.518600+0000","last_unstale":"2024-09-16T15:37:45.526026+0000","last_undegraded":"2024-09-16T15:37:45.526026+0000","last_fullsized":"2024-09-16T15:37:45.526026+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:52:07.454732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.295825+0000","last_change":"2024-09-16T15:37:44.524203+0000","last_active":"2024-09-16T15:37:47.295825+0000","last_peered":"2024-09-16T15:37:47.295825+0000","last_clean":"2024-09-16T15:37:47.295825+0000","last_became_active":"2024-09-16T15:37:44.523934+0000","last_became_peered":"2024-09-16T15:37:44.523934+0000","last_unstale":"2024-09-16T15:37:47.295825+0000","last_undegraded":"2024-09-16T15:37:47.295825+0000","last_fullsized":"2024-09-16T15:37:47.295825+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:51:41.621542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.523056+0000","last_change":"2024-09-16T15:37:44.524033+0000","last_active":"2024-09-16T15:37:45.523056+0000","last_peered":"2024-09-16T15:37:45.523056+0000","last_clean":"2024-09-16T15:37:45.523056+0000","last_became_active":"2024-09-16T15:37:44.523487+0000","last_became_peered":"2024-09-16T15:37:44.523487+0000","last_unstale":"2024-09-16T15:37:45.523056+0000","last_undegraded":"2024-09-16T15:37:45.523056+0000","last_fullsized":"2024-09-16T15:37:45.523056+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:27:29.507738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:46.570433+0000","last_change":"2024-09-16T15:37:44.522595+0000","last_active":"2024-09-16T15:37:46.570433+0000","last_peered":"2024-09-16T15:37:46.570433+0000","last_clean":"2024-09-16T15:37:46.570433+0000","last_became_active":"2024-09-16T15:37:44.522271+0000","last_became_peered":"2024-09-16T15:37:44.522271+0000","last_unstale":"2024-09-16T15:37:46.570433+0000","last_undegraded":"2024-09-16T15:37:46.570433+0000","last_fullsized":"2024-09-16T15:37:46.570433+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:55:59.838134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:46.943654+0000","last_change":"2024-09-16T15:37:44.515292+0000","last_active":"2024-09-16T15:37:46.943654+0000","last_peered":"2024-09-16T15:37:46.943654+0000","last_clean":"2024-09-16T15:37:46.943654+0000","last_became_active":"2024-09-16T15:37:44.513909+0000","last_became_peered":"2024-09-16T15:37:44.513909+0000","last_unstale":"2024-09-16T15:37:46.943654+0000","last_undegraded":"2024-09-16T15:37:46.943654+0000","last_fullsized":"2024-09-16T15:37:46.943654+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:54:51.338019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.850677+0000","last_change":"2024-09-16T15:37:44.517890+0000","last_active":"2024-09-16T15:37:45.850677+0000","last_peered":"2024-09-16T15:37:45.850677+0000","last_clean":"2024-09-16T15:37:45.850677+0000","last_became_active":"2024-09-16T15:37:44.517373+0000","last_became_peered":"2024-09-16T15:37:44.517373+0000","last_unstale":"2024-09-16T15:37:45.850677+0000","last_undegraded":"2024-09-16T15:37:45.850677+0000","last_fullsized":"2024-09-16T15:37:45.850677+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:16:32.486922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.295709+0000","last_change":"2024-09-16T15:37:43.510897+0000","last_active":"2024-09-16T15:37:47.295709+0000","last_peered":"2024-09-16T15:37:47.295709+0000","last_clean":"2024-09-16T15:37:47.295709+0000","last_became_active":"2024-09-16T15:37:43.510468+0000","last_became_peered":"2024-09-16T15:37:43.510468+0000","last_unstale":"2024-09-16T15:37:47.295709+0000","last_undegraded":"2024-09-16T15:37:47.295709+0000","last_fullsized":"2024-09-16T15:37:47.295709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:48:05.099286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.525914+0000","last_change":"2024-09-16T15:37:44.517344+0000","last_active":"2024-09-16T15:37:45.525914+0000","last_peered":"2024-09-16T15:37:45.525914+0000","last_clean":"2024-09-16T15:37:45.525914+0000","last_became_active":"2024-09-16T15:37:44.516446+0000","last_became_peered":"2024-09-16T15:37:44.516446+0000","last_unstale":"2024-09-16T15:37:45.525914+0000","last_undegraded":"2024-09-16T15:37:45.525914+0000","last_fullsized":"2024-09-16T15:37:45.525914+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:07:19.107946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.523251+0000","last_change":"2024-09-16T15:37:43.521672+0000","last_active":"2024-09-16T15:37:45.523251+0000","last_peered":"2024-09-16T15:37:45.523251+0000","last_clean":"2024-09-16T15:37:45.523251+0000","last_became_active":"2024-09-16T15:37:43.521418+0000","last_became_peered":"2024-09-16T15:37:43.521418+0000","last_unstale":"2024-09-16T15:37:45.523251+0000","last_undegraded":"2024-09-16T15:37:45.523251+0000","last_fullsized":"2024-09-16T15:37:45.523251+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:16:31.480042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.525828+0000","last_change":"2024-09-16T15:37:43.517465+0000","last_active":"2024-09-16T15:37:45.525828+0000","last_peered":"2024-09-16T15:37:45.525828+0000","last_clean":"2024-09-16T15:37:45.525828+0000","last_became_active":"2024-09-16T15:37:43.517177+0000","last_became_peered":"2024-09-16T15:37:43.517177+0000","last_unstale":"2024-09-16T15:37:45.525828+0000","last_undegraded":"2024-09-16T15:37:45.525828+0000","last_fullsized":"2024-09-16T15:37:45.525828+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T21:38:37.823375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.295924+0000","last_change":"2024-09-16T15:37:44.522976+0000","last_active":"2024-09-16T15:37:47.295924+0000","last_peered":"2024-09-16T15:37:47.295924+0000","last_clean":"2024-09-16T15:37:47.295924+0000","last_became_active":"2024-09-16T15:37:44.522718+0000","last_became_peered":"2024-09-16T15:37:44.522718+0000","last_unstale":"2024-09-16T15:37:47.295924+0000","last_undegraded":"2024-09-16T15:37:47.295924+0000","last_fullsized":"2024-09-16T15:37:47.295924+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:44:42.608817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.523077+0000","last_change":"2024-09-16T15:37:43.519319+0000","last_active":"2024-09-16T15:37:45.523077+0000","last_peered":"2024-09-16T15:37:45.523077+0000","last_clean":"2024-09-16T15:37:45.523077+0000","last_became_active":"2024-09-16T15:37:43.518711+0000","last_became_peered":"2024-09-16T15:37:43.518711+0000","last_unstale":"2024-09-16T15:37:45.523077+0000","last_undegraded":"2024-09-16T15:37:45.523077+0000","last_fullsized":"2024-09-16T15:37:45.523077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:39:24.887816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.525985+0000","last_change":"2024-09-16T15:37:44.517222+0000","last_active":"2024-09-16T15:37:45.525985+0000","last_peered":"2024-09-16T15:37:45.525985+0000","last_clean":"2024-09-16T15:37:45.525985+0000","last_became_active":"2024-09-16T15:37:44.516380+0000","last_became_peered":"2024-09-16T15:37:44.516380+0000","last_unstale":"2024-09-16T15:37:45.525985+0000","last_undegraded":"2024-09-16T15:37:45.525985+0000","last_fullsized":"2024-09-16T15:37:45.525985+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T21:34:31.159339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.850923+0000","last_change":"2024-09-16T15:37:43.514400+0000","last_active":"2024-09-16T15:37:45.850923+0000","last_peered":"2024-09-16T15:37:45.850923+0000","last_clean":"2024-09-16T15:37:45.850923+0000","last_became_active":"2024-09-16T15:37:43.514124+0000","last_became_peered":"2024-09-16T15:37:43.514124+0000","last_unstale":"2024-09-16T15:37:45.850923+0000","last_undegraded":"2024-09-16T15:37:45.850923+0000","last_fullsized":"2024-09-16T15:37:45.850923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:24:48.654268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:46.943985+0000","last_change":"2024-09-16T15:37:44.519856+0000","last_active":"2024-09-16T15:37:46.943985+0000","last_peered":"2024-09-16T15:37:46.943985+0000","last_clean":"2024-09-16T15:37:46.943985+0000","last_became_active":"2024-09-16T15:37:44.519014+0000","last_became_peered":"2024-09-16T15:37:44.519014+0000","last_unstale":"2024-09-16T15:37:46.943985+0000","last_undegraded":"2024-09-16T15:37:46.943985+0000","last_fullsized":"2024-09-16T15:37:46.943985+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:08:42.429536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.157585+0000","last_change":"2024-09-16T15:37:43.515976+0000","last_active":"2024-09-16T15:37:47.157585+0000","last_peered":"2024-09-16T15:37:47.157585+0000","last_clean":"2024-09-16T15:37:47.157585+0000","last_became_active":"2024-09-16T15:37:43.515426+0000","last_became_peered":"2024-09-16T15:37:43.515426+0000","last_unstale":"2024-09-16T15:37:47.157585+0000","last_undegraded":"2024-09-16T15:37:47.157585+0000","last_fullsized":"2024-09-16T15:37:47.157585+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:45:27.227739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.296046+0000","last_change":"2024-09-16T15:37:44.526711+0000","last_active":"2024-09-16T15:37:47.296046+0000","last_peered":"2024-09-16T15:37:47.296046+0000","last_clean":"2024-09-16T15:37:47.296046+0000","last_became_active":"2024-09-16T15:37:44.526458+0000","last_became_peered":"2024-09-16T15:37:44.526458+0000","last_unstale":"2024-09-16T15:37:47.296046+0000","last_undegraded":"2024-09-16T15:37:47.296046+0000","last_fullsized":"2024-09-16T15:37:47.296046+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:04:08.210631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:46.570594+0000","last_change":"2024-09-16T15:37:43.516257+0000","last_active":"2024-09-16T15:37:46.570594+0000","last_peered":"2024-09-16T15:37:46.570594+0000","last_clean":"2024-09-16T15:37:46.570594+0000","last_became_active":"2024-09-16T15:37:43.515944+0000","last_became_peered":"2024-09-16T15:37:43.515944+0000","last_unstale":"2024-09-16T15:37:46.570594+0000","last_undegraded":"2024-09-16T15:37:46.570594+0000","last_fullsized":"2024-09-16T15:37:46.570594+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:25:01.970817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.523356+0000","last_change":"2024-09-16T15:37:44.519159+0000","last_active":"2024-09-16T15:37:45.523356+0000","last_peered":"2024-09-16T15:37:45.523356+0000","last_clean":"2024-09-16T15:37:45.523356+0000","last_became_active":"2024-09-16T15:37:44.518920+0000","last_became_peered":"2024-09-16T15:37:44.518920+0000","last_unstale":"2024-09-16T15:37:45.523356+0000","last_undegraded":"2024-09-16T15:37:45.523356+0000","last_fullsized":"2024-09-16T15:37:45.523356+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:59:53.751921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:46.943754+0000","last_change":"2024-09-16T15:37:43.514513+0000","last_active":"2024-09-16T15:37:46.943754+0000","last_peered":"2024-09-16T15:37:46.943754+0000","last_clean":"2024-09-16T15:37:46.943754+0000","last_became_active":"2024-09-16T15:37:43.514196+0000","last_became_peered":"2024-09-16T15:37:43.514196+0000","last_unstale":"2024-09-16T15:37:46.943754+0000","last_undegraded":"2024-09-16T15:37:46.943754+0000","last_fullsized":"2024-09-16T15:37:46.943754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T21:42:39.448578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.157298+0000","last_change":"2024-09-16T15:37:44.518597+0000","last_active":"2024-09-16T15:37:47.157298+0000","last_peered":"2024-09-16T15:37:47.157298+0000","last_clean":"2024-09-16T15:37:47.157298+0000","last_became_active":"2024-09-16T15:37:44.518334+0000","last_became_peered":"2024-09-16T15:37:44.518334+0000","last_unstale":"2024-09-16T15:37:47.157298+0000","last_undegraded":"2024-09-16T15:37:47.157298+0000","last_fullsized":"2024-09-16T15:37:47.157298+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:18:49.770991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:46.570525+0000","last_change":"2024-09-16T15:37:43.521768+0000","last_active":"2024-09-16T15:37:46.570525+0000","last_peered":"2024-09-16T15:37:46.570525+0000","last_clean":"2024-09-16T15:37:46.570525+0000","last_became_active":"2024-09-16T15:37:43.521541+0000","last_became_peered":"2024-09-16T15:37:43.521541+0000","last_unstale":"2024-09-16T15:37:46.570525+0000","last_undegraded":"2024-09-16T15:37:46.570525+0000","last_fullsized":"2024-09-16T15:37:46.570525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:48:05.099286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.526567+0000","last_change":"2024-09-16T15:37:44.520303+0000","last_active":"2024-09-16T15:37:45.526567+0000","last_peered":"2024-09-16T15:37:45.526567+0000","last_clean":"2024-09-16T15:37:45.526567+0000","last_became_active":"2024-09-16T15:37:44.520036+0000","last_became_peered":"2024-09-16T15:37:44.520036+0000","last_unstale":"2024-09-16T15:37:45.526567+0000","last_undegraded":"2024-09-16T15:37:45.526567+0000","last_fullsized":"2024-09-16T15:37:45.526567+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:02:45.771447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.523462+0000","last_change":"2024-09-16T15:37:43.519519+0000","last_active":"2024-09-16T15:37:45.523462+0000","last_peered":"2024-09-16T15:37:45.523462+0000","last_clean":"2024-09-16T15:37:45.523462+0000","last_became_active":"2024-09-16T15:37:43.518682+0000","last_became_peered":"2024-09-16T15:37:43.518682+0000","last_unstale":"2024-09-16T15:37:45.523462+0000","last_undegraded":"2024-09-16T15:37:45.523462+0000","last_fullsized":"2024-09-16T15:37:45.523462+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:02:59.404804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.523248+0000","last_change":"2024-09-16T15:37:44.526644+0000","last_active":"2024-09-16T15:37:45.523248+0000","last_peered":"2024-09-16T15:37:45.523248+0000","last_clean":"2024-09-16T15:37:45.523248+0000","last_became_active":"2024-09-16T15:37:44.526382+0000","last_became_peered":"2024-09-16T15:37:44.526382+0000","last_unstale":"2024-09-16T15:37:45.523248+0000","last_undegraded":"2024-09-16T15:37:45.523248+0000","last_fullsized":"2024-09-16T15:37:45.523248+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:10:42.230703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.157113+0000","last_change":"2024-09-16T15:37:43.519576+0000","last_active":"2024-09-16T15:37:47.157113+0000","last_peered":"2024-09-16T15:37:47.157113+0000","last_clean":"2024-09-16T15:37:47.157113+0000","last_became_active":"2024-09-16T15:37:43.517609+0000","last_became_peered":"2024-09-16T15:37:43.517609+0000","last_unstale":"2024-09-16T15:37:47.157113+0000","last_undegraded":"2024-09-16T15:37:47.157113+0000","last_fullsized":"2024-09-16T15:37:47.157113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:54:50.331139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.850548+0000","last_change":"2024-09-16T15:37:44.525100+0000","last_active":"2024-09-16T15:37:45.850548+0000","last_peered":"2024-09-16T15:37:45.850548+0000","last_clean":"2024-09-16T15:37:45.850548+0000","last_became_active":"2024-09-16T15:37:44.524811+0000","last_became_peered":"2024-09-16T15:37:44.524811+0000","last_unstale":"2024-09-16T15:37:45.850548+0000","last_undegraded":"2024-09-16T15:37:45.850548+0000","last_fullsized":"2024-09-16T15:37:45.850548+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:51:54.814659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.525619+0000","last_change":"2024-09-16T15:37:43.514266+0000","last_active":"2024-09-16T15:37:45.525619+0000","last_peered":"2024-09-16T15:37:45.525619+0000","last_clean":"2024-09-16T15:37:45.525619+0000","last_became_active":"2024-09-16T15:37:43.513980+0000","last_became_peered":"2024-09-16T15:37:43.513980+0000","last_unstale":"2024-09-16T15:37:45.525619+0000","last_undegraded":"2024-09-16T15:37:45.525619+0000","last_fullsized":"2024-09-16T15:37:45.525619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:03:21.436525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.523013+0000","last_change":"2024-09-16T15:37:44.518537+0000","last_active":"2024-09-16T15:37:45.523013+0000","last_peered":"2024-09-16T15:37:45.523013+0000","last_clean":"2024-09-16T15:37:45.523013+0000","last_became_active":"2024-09-16T15:37:44.518264+0000","last_became_peered":"2024-09-16T15:37:44.518264+0000","last_unstale":"2024-09-16T15:37:45.523013+0000","last_undegraded":"2024-09-16T15:37:45.523013+0000","last_fullsized":"2024-09-16T15:37:45.523013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:03:18.944435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.157740+0000","last_change":"2024-09-16T15:37:43.518884+0000","last_active":"2024-09-16T15:37:47.157740+0000","last_peered":"2024-09-16T15:37:47.157740+0000","last_clean":"2024-09-16T15:37:47.157740+0000","last_became_active":"2024-09-16T15:37:43.517494+0000","last_became_peered":"2024-09-16T15:37:43.517494+0000","last_unstale":"2024-09-16T15:37:47.157740+0000","last_undegraded":"2024-09-16T15:37:47.157740+0000","last_fullsized":"2024-09-16T15:37:47.157740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:51:53.807779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:46.944015+0000","last_change":"2024-09-16T15:37:44.513568+0000","last_active":"2024-09-16T15:37:46.944015+0000","last_peered":"2024-09-16T15:37:46.944015+0000","last_clean":"2024-09-16T15:37:46.944015+0000","last_became_active":"2024-09-16T15:37:44.513308+0000","last_became_peered":"2024-09-16T15:37:44.513308+0000","last_unstale":"2024-09-16T15:37:46.944015+0000","last_undegraded":"2024-09-16T15:37:46.944015+0000","last_fullsized":"2024-09-16T15:37:46.944015+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:58:10.612197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.526185+0000","last_change":"2024-09-16T15:37:43.514250+0000","last_active":"2024-09-16T15:37:45.526185+0000","last_peered":"2024-09-16T15:37:45.526185+0000","last_clean":"2024-09-16T15:37:45.526185+0000","last_became_active":"2024-09-16T15:37:43.513954+0000","last_became_peered":"2024-09-16T15:37:43.513954+0000","last_unstale":"2024-09-16T15:37:45.526185+0000","last_undegraded":"2024-09-16T15:37:45.526185+0000","last_fullsized":"2024-09-16T15:37:45.526185+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:57:46.136628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.157747+0000","last_change":"2024-09-16T15:37:44.515874+0000","last_active":"2024-09-16T15:37:47.157747+0000","last_peered":"2024-09-16T15:37:47.157747+0000","last_clean":"2024-09-16T15:37:47.157747+0000","last_became_active":"2024-09-16T15:37:44.515608+0000","last_became_peered":"2024-09-16T15:37:44.515608+0000","last_unstale":"2024-09-16T15:37:47.157747+0000","last_undegraded":"2024-09-16T15:37:47.157747+0000","last_fullsized":"2024-09-16T15:37:47.157747+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:09:09.464477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.295751+0000","last_change":"2024-09-16T15:37:43.514330+0000","last_active":"2024-09-16T15:37:47.295751+0000","last_peered":"2024-09-16T15:37:47.295751+0000","last_clean":"2024-09-16T15:37:47.295751+0000","last_became_active":"2024-09-16T15:37:43.513900+0000","last_became_peered":"2024-09-16T15:37:43.513900+0000","last_unstale":"2024-09-16T15:37:47.295751+0000","last_undegraded":"2024-09-16T15:37:47.295751+0000","last_fullsized":"2024-09-16T15:37:47.295751+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:45:27.227739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.157504+0000","last_change":"2024-09-16T15:37:44.523100+0000","last_active":"2024-09-16T15:37:47.157504+0000","last_peered":"2024-09-16T15:37:47.157504+0000","last_clean":"2024-09-16T15:37:47.157504+0000","last_became_active":"2024-09-16T15:37:44.522300+0000","last_became_peered":"2024-09-16T15:37:44.522300+0000","last_unstale":"2024-09-16T15:37:47.157504+0000","last_undegraded":"2024-09-16T15:37:47.157504+0000","last_fullsized":"2024-09-16T15:37:47.157504+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:46:13.128386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.526586+0000","last_change":"2024-09-16T15:37:43.520873+0000","last_active":"2024-09-16T15:37:45.526586+0000","last_peered":"2024-09-16T15:37:45.526586+0000","last_clean":"2024-09-16T15:37:45.526586+0000","last_became_active":"2024-09-16T15:37:43.520561+0000","last_became_peered":"2024-09-16T15:37:43.520561+0000","last_unstale":"2024-09-16T15:37:45.526586+0000","last_undegraded":"2024-09-16T15:37:45.526586+0000","last_fullsized":"2024-09-16T15:37:45.526586+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:08:30.145981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.523562+0000","last_change":"2024-09-16T15:37:44.521919+0000","last_active":"2024-09-16T15:37:45.523562+0000","last_peered":"2024-09-16T15:37:45.523562+0000","last_clean":"2024-09-16T15:37:45.523562+0000","last_became_active":"2024-09-16T15:37:44.521672+0000","last_became_peered":"2024-09-16T15:37:44.521672+0000","last_unstale":"2024-09-16T15:37:45.523562+0000","last_undegraded":"2024-09-16T15:37:45.523562+0000","last_fullsized":"2024-09-16T15:37:45.523562+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:50:08.196173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":111,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.850562+0000","last_change":"2024-09-16T15:37:37.258601+0000","last_active":"2024-09-16T15:37:45.850562+0000","last_peered":"2024-09-16T15:37:45.850562+0000","last_clean":"2024-09-16T15:37:45.850562+0000","last_became_active":"2024-09-16T15:37:37.257584+0000","last_became_peered":"2024-09-16T15:37:37.257584+0000","last_unstale":"2024-09-16T15:37:45.850562+0000","last_undegraded":"2024-09-16T15:37:45.850562+0000","last_fullsized":"2024-09-16T15:37:45.850562+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:35.447043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:35.447043+0000","last_clean_scrub_stamp":"2024-09-16T15:37:35.447043+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:43:17.464894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.523369+0000","last_change":"2024-09-16T15:37:43.510139+0000","last_active":"2024-09-16T15:37:45.523369+0000","last_peered":"2024-09-16T15:37:45.523369+0000","last_clean":"2024-09-16T15:37:45.523369+0000","last_became_active":"2024-09-16T15:37:43.509820+0000","last_became_peered":"2024-09-16T15:37:43.509820+0000","last_unstale":"2024-09-16T15:37:45.523369+0000","last_undegraded":"2024-09-16T15:37:45.523369+0000","last_fullsized":"2024-09-16T15:37:45.523369+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:59:50.127383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.526700+0000","last_change":"2024-09-16T15:37:44.513059+0000","last_active":"2024-09-16T15:37:45.526700+0000","last_peered":"2024-09-16T15:37:45.526700+0000","last_clean":"2024-09-16T15:37:45.526700+0000","last_became_active":"2024-09-16T15:37:44.511241+0000","last_became_peered":"2024-09-16T15:37:44.511241+0000","last_unstale":"2024-09-16T15:37:45.526700+0000","last_undegraded":"2024-09-16T15:37:45.526700+0000","last_fullsized":"2024-09-16T15:37:45.526700+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:34:32.134838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.523129+0000","last_change":"2024-09-16T15:37:43.519442+0000","last_active":"2024-09-16T15:37:45.523129+0000","last_peered":"2024-09-16T15:37:45.523129+0000","last_clean":"2024-09-16T15:37:45.523129+0000","last_became_active":"2024-09-16T15:37:43.519204+0000","last_became_peered":"2024-09-16T15:37:43.519204+0000","last_unstale":"2024-09-16T15:37:45.523129+0000","last_undegraded":"2024-09-16T15:37:45.523129+0000","last_fullsized":"2024-09-16T15:37:45.523129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:29:35.721810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.525649+0000","last_change":"2024-09-16T15:37:44.511988+0000","last_active":"2024-09-16T15:37:45.525649+0000","last_peered":"2024-09-16T15:37:45.525649+0000","last_clean":"2024-09-16T15:37:45.525649+0000","last_became_active":"2024-09-16T15:37:44.511679+0000","last_became_peered":"2024-09-16T15:37:44.511679+0000","last_unstale":"2024-09-16T15:37:45.525649+0000","last_undegraded":"2024-09-16T15:37:45.525649+0000","last_fullsized":"2024-09-16T15:37:45.525649+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:39:56.702467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:46.570381+0000","last_change":"2024-09-16T15:37:43.515953+0000","last_active":"2024-09-16T15:37:46.570381+0000","last_peered":"2024-09-16T15:37:46.570381+0000","last_clean":"2024-09-16T15:37:46.570381+0000","last_became_active":"2024-09-16T15:37:43.515662+0000","last_became_peered":"2024-09-16T15:37:43.515662+0000","last_unstale":"2024-09-16T15:37:46.570381+0000","last_undegraded":"2024-09-16T15:37:46.570381+0000","last_fullsized":"2024-09-16T15:37:46.570381+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:45:09.277422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.295900+0000","last_change":"2024-09-16T15:37:44.525005+0000","last_active":"2024-09-16T15:37:47.295900+0000","last_peered":"2024-09-16T15:37:47.295900+0000","last_clean":"2024-09-16T15:37:47.295900+0000","last_became_active":"2024-09-16T15:37:44.524613+0000","last_became_peered":"2024-09-16T15:37:44.524613+0000","last_unstale":"2024-09-16T15:37:47.295900+0000","last_undegraded":"2024-09-16T15:37:47.295900+0000","last_fullsized":"2024-09-16T15:37:47.295900+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T23:33:15.012052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.523530+0000","last_change":"2024-09-16T15:37:43.513231+0000","last_active":"2024-09-16T15:37:45.523530+0000","last_peered":"2024-09-16T15:37:45.523530+0000","last_clean":"2024-09-16T15:37:45.523530+0000","last_became_active":"2024-09-16T15:37:43.512954+0000","last_became_peered":"2024-09-16T15:37:43.512954+0000","last_unstale":"2024-09-16T15:37:45.523530+0000","last_undegraded":"2024-09-16T15:37:45.523530+0000","last_fullsized":"2024-09-16T15:37:45.523530+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:50:40.599021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.157434+0000","last_change":"2024-09-16T15:37:44.513200+0000","last_active":"2024-09-16T15:37:47.157434+0000","last_peered":"2024-09-16T15:37:47.157434+0000","last_clean":"2024-09-16T15:37:47.157434+0000","last_became_active":"2024-09-16T15:37:44.512855+0000","last_became_peered":"2024-09-16T15:37:44.512855+0000","last_unstale":"2024-09-16T15:37:47.157434+0000","last_undegraded":"2024-09-16T15:37:47.157434+0000","last_fullsized":"2024-09-16T15:37:47.157434+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:05:31.763584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.295589+0000","last_change":"2024-09-16T15:37:43.510480+0000","last_active":"2024-09-16T15:37:47.295589+0000","last_peered":"2024-09-16T15:37:47.295589+0000","last_clean":"2024-09-16T15:37:47.295589+0000","last_became_active":"2024-09-16T15:37:43.510223+0000","last_became_peered":"2024-09-16T15:37:43.510223+0000","last_unstale":"2024-09-16T15:37:47.295589+0000","last_undegraded":"2024-09-16T15:37:47.295589+0000","last_fullsized":"2024-09-16T15:37:47.295589+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:37:32.374134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:46.943843+0000","last_change":"2024-09-16T15:37:44.516105+0000","last_active":"2024-09-16T15:37:46.943843+0000","last_peered":"2024-09-16T15:37:46.943843+0000","last_clean":"2024-09-16T15:37:46.943843+0000","last_became_active":"2024-09-16T15:37:44.515864+0000","last_became_peered":"2024-09-16T15:37:44.515864+0000","last_unstale":"2024-09-16T15:37:46.943843+0000","last_undegraded":"2024-09-16T15:37:46.943843+0000","last_fullsized":"2024-09-16T15:37:46.943843+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:59:08.559983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.523657+0000","last_change":"2024-09-16T15:37:43.515757+0000","last_active":"2024-09-16T15:37:45.523657+0000","last_peered":"2024-09-16T15:37:45.523657+0000","last_clean":"2024-09-16T15:37:45.523657+0000","last_became_active":"2024-09-16T15:37:43.515199+0000","last_became_peered":"2024-09-16T15:37:43.515199+0000","last_unstale":"2024-09-16T15:37:45.523657+0000","last_undegraded":"2024-09-16T15:37:45.523657+0000","last_fullsized":"2024-09-16T15:37:45.523657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:42:43.736513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.526573+0000","last_change":"2024-09-16T15:37:44.515147+0000","last_active":"2024-09-16T15:37:45.526573+0000","last_peered":"2024-09-16T15:37:45.526573+0000","last_clean":"2024-09-16T15:37:45.526573+0000","last_became_active":"2024-09-16T15:37:44.514518+0000","last_became_peered":"2024-09-16T15:37:44.514518+0000","last_unstale":"2024-09-16T15:37:45.526573+0000","last_undegraded":"2024-09-16T15:37:45.526573+0000","last_fullsized":"2024-09-16T15:37:45.526573+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:57:36.296851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.526280+0000","last_change":"2024-09-16T15:37:43.518081+0000","last_active":"2024-09-16T15:37:45.526280+0000","last_peered":"2024-09-16T15:37:45.526280+0000","last_clean":"2024-09-16T15:37:45.526280+0000","last_became_active":"2024-09-16T15:37:43.517744+0000","last_became_peered":"2024-09-16T15:37:43.517744+0000","last_unstale":"2024-09-16T15:37:45.526280+0000","last_undegraded":"2024-09-16T15:37:45.526280+0000","last_fullsized":"2024-09-16T15:37:45.526280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:55:58.831254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.526362+0000","last_change":"2024-09-16T15:37:44.518787+0000","last_active":"2024-09-16T15:37:45.526362+0000","last_peered":"2024-09-16T15:37:45.526362+0000","last_clean":"2024-09-16T15:37:45.526362+0000","last_became_active":"2024-09-16T15:37:44.517824+0000","last_became_peered":"2024-09-16T15:37:44.517824+0000","last_unstale":"2024-09-16T15:37:45.526362+0000","last_undegraded":"2024-09-16T15:37:45.526362+0000","last_fullsized":"2024-09-16T15:37:45.526362+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:19:57.119675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.523623+0000","last_change":"2024-09-16T15:37:43.519357+0000","last_active":"2024-09-16T15:37:45.523623+0000","last_peered":"2024-09-16T15:37:45.523623+0000","last_clean":"2024-09-16T15:37:45.523623+0000","last_became_active":"2024-09-16T15:37:43.519050+0000","last_became_peered":"2024-09-16T15:37:43.519050+0000","last_unstale":"2024-09-16T15:37:45.523623+0000","last_undegraded":"2024-09-16T15:37:45.523623+0000","last_fullsized":"2024-09-16T15:37:45.523623+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:10:16.347293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.526124+0000","last_change":"2024-09-16T15:37:44.523372+0000","last_active":"2024-09-16T15:37:45.526124+0000","last_peered":"2024-09-16T15:37:45.526124+0000","last_clean":"2024-09-16T15:37:45.526124+0000","last_became_active":"2024-09-16T15:37:44.522397+0000","last_became_peered":"2024-09-16T15:37:44.522397+0000","last_unstale":"2024-09-16T15:37:45.526124+0000","last_undegraded":"2024-09-16T15:37:45.526124+0000","last_fullsized":"2024-09-16T15:37:45.526124+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:32:42.496551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.156909+0000","last_change":"2024-09-16T15:37:43.517924+0000","last_active":"2024-09-16T15:37:47.156909+0000","last_peered":"2024-09-16T15:37:47.156909+0000","last_clean":"2024-09-16T15:37:47.156909+0000","last_became_active":"2024-09-16T15:37:43.516036+0000","last_became_peered":"2024-09-16T15:37:43.516036+0000","last_unstale":"2024-09-16T15:37:47.156909+0000","last_undegraded":"2024-09-16T15:37:47.156909+0000","last_fullsized":"2024-09-16T15:37:47.156909+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:48:05.099286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.523076+0000","last_change":"2024-09-16T15:37:44.527377+0000","last_active":"2024-09-16T15:37:45.523076+0000","last_peered":"2024-09-16T15:37:45.523076+0000","last_clean":"2024-09-16T15:37:45.523076+0000","last_became_active":"2024-09-16T15:37:44.527133+0000","last_became_peered":"2024-09-16T15:37:44.527133+0000","last_unstale":"2024-09-16T15:37:45.523076+0000","last_undegraded":"2024-09-16T15:37:45.523076+0000","last_fullsized":"2024-09-16T15:37:45.523076+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T23:21:37.513059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.525961+0000","last_change":"2024-09-16T15:37:43.518084+0000","last_active":"2024-09-16T15:37:45.525961+0000","last_peered":"2024-09-16T15:37:45.525961+0000","last_clean":"2024-09-16T15:37:45.525961+0000","last_became_active":"2024-09-16T15:37:43.517773+0000","last_became_peered":"2024-09-16T15:37:43.517773+0000","last_unstale":"2024-09-16T15:37:45.525961+0000","last_undegraded":"2024-09-16T15:37:45.525961+0000","last_fullsized":"2024-09-16T15:37:45.525961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:42:35.749344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.525550+0000","last_change":"2024-09-16T15:37:44.519969+0000","last_active":"2024-09-16T15:37:45.525550+0000","last_peered":"2024-09-16T15:37:45.525550+0000","last_clean":"2024-09-16T15:37:45.525550+0000","last_became_active":"2024-09-16T15:37:44.519683+0000","last_became_peered":"2024-09-16T15:37:44.519683+0000","last_unstale":"2024-09-16T15:37:45.525550+0000","last_undegraded":"2024-09-16T15:37:45.525550+0000","last_fullsized":"2024-09-16T15:37:45.525550+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:36:49.054590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.526487+0000","last_change":"2024-09-16T15:37:43.511936+0000","last_active":"2024-09-16T15:37:45.526487+0000","last_peered":"2024-09-16T15:37:45.526487+0000","last_clean":"2024-09-16T15:37:45.526487+0000","last_became_active":"2024-09-16T15:37:43.511709+0000","last_became_peered":"2024-09-16T15:37:43.511709+0000","last_unstale":"2024-09-16T15:37:45.526487+0000","last_undegraded":"2024-09-16T15:37:45.526487+0000","last_fullsized":"2024-09-16T15:37:45.526487+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:22:48.178297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:46.570568+0000","last_change":"2024-09-16T15:37:44.522219+0000","last_active":"2024-09-16T15:37:46.570568+0000","last_peered":"2024-09-16T15:37:46.570568+0000","last_clean":"2024-09-16T15:37:46.570568+0000","last_became_active":"2024-09-16T15:37:44.521913+0000","last_became_peered":"2024-09-16T15:37:44.521913+0000","last_unstale":"2024-09-16T15:37:46.570568+0000","last_undegraded":"2024-09-16T15:37:46.570568+0000","last_fullsized":"2024-09-16T15:37:46.570568+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:13:55.812269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.523265+0000","last_change":"2024-09-16T15:37:43.513406+0000","last_active":"2024-09-16T15:37:45.523265+0000","last_peered":"2024-09-16T15:37:45.523265+0000","last_clean":"2024-09-16T15:37:45.523265+0000","last_became_active":"2024-09-16T15:37:43.512994+0000","last_became_peered":"2024-09-16T15:37:43.512994+0000","last_unstale":"2024-09-16T15:37:45.523265+0000","last_undegraded":"2024-09-16T15:37:45.523265+0000","last_fullsized":"2024-09-16T15:37:45.523265+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:54:50.331139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.523228+0000","last_change":"2024-09-16T15:37:44.521192+0000","last_active":"2024-09-16T15:37:45.523228+0000","last_peered":"2024-09-16T15:37:45.523228+0000","last_clean":"2024-09-16T15:37:45.523228+0000","last_became_active":"2024-09-16T15:37:44.520988+0000","last_became_peered":"2024-09-16T15:37:44.520988+0000","last_unstale":"2024-09-16T15:37:45.523228+0000","last_undegraded":"2024-09-16T15:37:45.523228+0000","last_fullsized":"2024-09-16T15:37:45.523228+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:02:40.289746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.523437+0000","last_change":"2024-09-16T15:37:44.528502+0000","last_active":"2024-09-16T15:37:45.523437+0000","last_peered":"2024-09-16T15:37:45.523437+0000","last_clean":"2024-09-16T15:37:45.523437+0000","last_became_active":"2024-09-16T15:37:44.528265+0000","last_became_peered":"2024-09-16T15:37:44.528265+0000","last_unstale":"2024-09-16T15:37:45.523437+0000","last_undegraded":"2024-09-16T15:37:45.523437+0000","last_fullsized":"2024-09-16T15:37:45.523437+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:19:22.804930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.157531+0000","last_change":"2024-09-16T15:37:43.512302+0000","last_active":"2024-09-16T15:37:47.157531+0000","last_peered":"2024-09-16T15:37:47.157531+0000","last_clean":"2024-09-16T15:37:47.157531+0000","last_became_active":"2024-09-16T15:37:43.511884+0000","last_became_peered":"2024-09-16T15:37:43.511884+0000","last_unstale":"2024-09-16T15:37:47.157531+0000","last_undegraded":"2024-09-16T15:37:47.157531+0000","last_fullsized":"2024-09-16T15:37:47.157531+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:16:31.480042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.850781+0000","last_change":"2024-09-16T15:37:44.520291+0000","last_active":"2024-09-16T15:37:45.850781+0000","last_peered":"2024-09-16T15:37:45.850781+0000","last_clean":"2024-09-16T15:37:45.850781+0000","last_became_active":"2024-09-16T15:37:44.519962+0000","last_became_peered":"2024-09-16T15:37:44.519962+0000","last_unstale":"2024-09-16T15:37:45.850781+0000","last_undegraded":"2024-09-16T15:37:45.850781+0000","last_fullsized":"2024-09-16T15:37:45.850781+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:59:51.134263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.157381+0000","last_change":"2024-09-16T15:37:43.518058+0000","last_active":"2024-09-16T15:37:47.157381+0000","last_peered":"2024-09-16T15:37:47.157381+0000","last_clean":"2024-09-16T15:37:47.157381+0000","last_became_active":"2024-09-16T15:37:43.517743+0000","last_became_peered":"2024-09-16T15:37:43.517743+0000","last_unstale":"2024-09-16T15:37:47.157381+0000","last_undegraded":"2024-09-16T15:37:47.157381+0000","last_fullsized":"2024-09-16T15:37:47.157381+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:49:24.257772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.295758+0000","last_change":"2024-09-16T15:37:44.517004+0000","last_active":"2024-09-16T15:37:47.295758+0000","last_peered":"2024-09-16T15:37:47.295758+0000","last_clean":"2024-09-16T15:37:47.295758+0000","last_became_active":"2024-09-16T15:37:44.516403+0000","last_became_peered":"2024-09-16T15:37:44.516403+0000","last_unstale":"2024-09-16T15:37:47.295758+0000","last_undegraded":"2024-09-16T15:37:47.295758+0000","last_fullsized":"2024-09-16T15:37:47.295758+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:52:48.483425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.296053+0000","last_change":"2024-09-16T15:37:43.513164+0000","last_active":"2024-09-16T15:37:47.296053+0000","last_peered":"2024-09-16T15:37:47.296053+0000","last_clean":"2024-09-16T15:37:47.296053+0000","last_became_active":"2024-09-16T15:37:43.512890+0000","last_became_peered":"2024-09-16T15:37:43.512890+0000","last_unstale":"2024-09-16T15:37:47.296053+0000","last_undegraded":"2024-09-16T15:37:47.296053+0000","last_fullsized":"2024-09-16T15:37:47.296053+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:49:24.257772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.295838+0000","last_change":"2024-09-16T15:37:44.521379+0000","last_active":"2024-09-16T15:37:47.295838+0000","last_peered":"2024-09-16T15:37:47.295838+0000","last_clean":"2024-09-16T15:37:47.295838+0000","last_became_active":"2024-09-16T15:37:44.520724+0000","last_became_peered":"2024-09-16T15:37:44.520724+0000","last_unstale":"2024-09-16T15:37:47.295838+0000","last_undegraded":"2024-09-16T15:37:47.295838+0000","last_fullsized":"2024-09-16T15:37:47.295838+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:40:14.841427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.526555+0000","last_change":"2024-09-16T15:37:43.515725+0000","last_active":"2024-09-16T15:37:45.526555+0000","last_peered":"2024-09-16T15:37:45.526555+0000","last_clean":"2024-09-16T15:37:45.526555+0000","last_became_active":"2024-09-16T15:37:43.515461+0000","last_became_peered":"2024-09-16T15:37:43.515461+0000","last_unstale":"2024-09-16T15:37:45.526555+0000","last_undegraded":"2024-09-16T15:37:45.526555+0000","last_fullsized":"2024-09-16T15:37:45.526555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T21:23:32.133055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509448,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":241664,"data_stored":81359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509448,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":835584,"data_stored":671695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509449,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":253952,"data_stored":83519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509449,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":237568,"data_stored":81817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509448,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":245760,"data_stored":82847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509449,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27840,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344000,"statfs":{"total":96636764160,"available":96608256000,"internally_reserved":0,"allocated":831488,"data_stored":671673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":241664,"data_stored":81291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":233472,"data_stored":81235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T15:37:57.420 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T15:37:57.559 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.556+0000 7fc3ba516640 1 -- 172.21.15.98:0/3562844421 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc39c003a30 msgr2=0x7fc39c003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:57.559 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.556+0000 7fc3ba516640 1 --2- 172.21.15.98:0/3562844421 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc39c003a30 0x7fc39c003e50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc3a4006fd0 tx=0x7fc39c005830 comp rx=0 tx=0).stop 2024-09-16T15:37:57.559 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.556+0000 7fc3b8ab3640 1 -- 172.21.15.98:0/3562844421 reap_dead start 2024-09-16T15:37:57.559 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.556+0000 7fc3ba516640 1 -- 172.21.15.98:0/3562844421 shutdown_connections 2024-09-16T15:37:57.559 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.556+0000 7fc3ba516640 1 -- 172.21.15.98:0/3562844421 >> 172.21.15.98:0/3562844421 conn(0x7fc3b40b2230 msgr2=0x7fc3b40b2610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:57.559 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.557+0000 7fc3ba516640 1 -- 172.21.15.98:0/3562844421 shutdown_connections 2024-09-16T15:37:57.559 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.557+0000 7fc3ba516640 1 -- 172.21.15.98:0/3562844421 wait complete. 2024-09-16T15:37:57.560 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.558+0000 7fc3ba516640 1 Processor -- start 2024-09-16T15:37:57.560 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.558+0000 7fc3ba516640 1 -- start start 2024-09-16T15:37:57.561 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.559+0000 7fc3ba516640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc39c003a30 0x7fc3b415b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:57.561 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.559+0000 7fc3ba516640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3b4145180 0x7fc3b413ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:57.562 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.559+0000 7fc3ba516640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3b415e850 0x7fc3b415ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:57.562 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.559+0000 7fc3ba516640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc3b413f490 con 0x7fc3b415e850 2024-09-16T15:37:57.562 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.559+0000 7fc3ba516640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc3b4068c10 con 0x7fc39c003a30 2024-09-16T15:37:57.562 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.559+0000 7fc3ba516640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fc3b40cf670 con 0x7fc3b4145180 2024-09-16T15:37:57.562 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.559+0000 7fc3b8ab3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3b415e850 0x7fc3b415ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:57.562 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.559+0000 7fc3b8ab3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3b415e850 0x7fc3b415ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:32954/0 (socket says 172.21.15.98:32954) 2024-09-16T15:37:57.562 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.559+0000 7fc3b8ab3640 1 -- 172.21.15.98:0/3421409060 learned_addr learned my addr 172.21.15.98:0/3421409060 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:37:57.562 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.559+0000 7fc3b37fe640 1 --2- 172.21.15.98:0/3421409060 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3b4145180 0x7fc3b413ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:57.562 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.559+0000 7fc3b3fff640 1 --2- 172.21.15.98:0/3421409060 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc39c003a30 0x7fc3b415b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:57.562 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.559+0000 7fc3b8ab3640 1 -- 172.21.15.98:0/3421409060 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3b4145180 msgr2=0x7fc3b413ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:57.562 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.559+0000 7fc3b8ab3640 1 --2- 172.21.15.98:0/3421409060 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3b4145180 0x7fc3b413ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:57.562 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.559+0000 7fc3b8ab3640 1 -- 172.21.15.98:0/3421409060 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc39c003a30 msgr2=0x7fc3b415b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:57.562 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.559+0000 7fc3b8ab3640 1 --2- 172.21.15.98:0/3421409060 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc39c003a30 0x7fc3b415b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:57.562 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.559+0000 7fc3b8ab3640 1 -- 172.21.15.98:0/3421409060 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3b4159ea0 con 0x7fc3b415e850 2024-09-16T15:37:57.563 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.559+0000 7fc3b8ab3640 1 --2- 172.21.15.98:0/3421409060 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3b415e850 0x7fc3b415ed00 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc3b40744f0 tx=0x7fc3ac010f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:57.563 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.559+0000 7fc3b0ff9640 1 -- 172.21.15.98:0/3421409060 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3ac003970 con 0x7fc3b415e850 2024-09-16T15:37:57.563 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.559+0000 7fc3b0ff9640 1 -- 172.21.15.98:0/3421409060 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc3ac015070 con 0x7fc3b415e850 2024-09-16T15:37:57.563 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.559+0000 7fc3ba516640 1 -- 172.21.15.98:0/3421409060 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3b415a180 con 0x7fc3b415e850 2024-09-16T15:37:57.563 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.559+0000 7fc3b0ff9640 1 -- 172.21.15.98:0/3421409060 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3ac004030 con 0x7fc3b415e850 2024-09-16T15:37:57.563 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.559+0000 7fc3ba516640 1 -- 172.21.15.98:0/3421409060 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3b415a740 con 0x7fc3b415e850 2024-09-16T15:37:57.564 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.560+0000 7fc3ba516640 1 -- 172.21.15.98:0/3421409060 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3b40cef60 con 0x7fc3b415e850 2024-09-16T15:37:57.564 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.561+0000 7fc3b0ff9640 1 -- 172.21.15.98:0/3421409060 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7fc3ac0041d0 con 0x7fc3b415e850 2024-09-16T15:37:57.564 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.561+0000 7fc3b0ff9640 1 --2- 172.21.15.98:0/3421409060 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fc3a0078880 0x7fc3a007ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:57.564 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.561+0000 7fc3b0ff9640 1 -- 172.21.15.98:0/3421409060 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fc3ac09b040 con 0x7fc3b415e850 2024-09-16T15:37:57.564 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.562+0000 7fc3b3fff640 1 --2- 172.21.15.98:0/3421409060 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fc3a0078880 0x7fc3a007ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:57.564 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.562+0000 7fc3b3fff640 1 --2- 172.21.15.98:0/3421409060 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fc3a0078880 0x7fc3a007ad40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc3a4033000 tx=0x7fc3b415c910 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:57.567 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.566+0000 7fc3b0ff9640 1 -- 172.21.15.98:0/3421409060 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7fc3ac0636b0 con 0x7fc3b415e850 2024-09-16T15:37:57.739 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.737+0000 7fc3ba516640 1 -- 172.21.15.98:0/3421409060 --> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc3b4159c50 con 0x7fc3a0078880 2024-09-16T15:37:57.743 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.741+0000 7fc3b0ff9640 1 -- 172.21.15.98:0/3421409060 <== mgr.4100 v2:172.21.15.135:6800/699234772 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251822 (secure 0 0 0) 0x7fc3b4159c50 con 0x7fc3a0078880 2024-09-16T15:37:57.746 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:37:57.747 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2024-09-16T15:37:57.748 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.744+0000 7fc3ba516640 1 -- 172.21.15.98:0/3421409060 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fc3a0078880 msgr2=0x7fc3a007ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:57.749 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.744+0000 7fc3ba516640 1 --2- 172.21.15.98:0/3421409060 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fc3a0078880 0x7fc3a007ad40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc3a4033000 tx=0x7fc3b415c910 comp rx=0 tx=0).stop 2024-09-16T15:37:57.749 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.744+0000 7fc3ba516640 1 -- 172.21.15.98:0/3421409060 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3b415e850 msgr2=0x7fc3b415ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:57.749 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.744+0000 7fc3ba516640 1 --2- 172.21.15.98:0/3421409060 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3b415e850 0x7fc3b415ed00 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc3b40744f0 tx=0x7fc3ac010f40 comp rx=0 tx=0).stop 2024-09-16T15:37:57.749 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.744+0000 7fc3ba516640 1 -- 172.21.15.98:0/3421409060 shutdown_connections 2024-09-16T15:37:57.749 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.744+0000 7fc3ba516640 1 --2- 172.21.15.98:0/3421409060 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3b415e850 0x7fc3b415ed00 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:57.749 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.744+0000 7fc3ba516640 1 --2- 172.21.15.98:0/3421409060 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3b4145180 0x7fc3b413ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:57.749 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.744+0000 7fc3ba516640 1 --2- 172.21.15.98:0/3421409060 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fc3a0078880 0x7fc3a007ad40 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:57.749 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.744+0000 7fc3ba516640 1 --2- 172.21.15.98:0/3421409060 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc39c003a30 0x7fc3b415b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:57.749 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.744+0000 7fc3ba516640 1 -- 172.21.15.98:0/3421409060 >> 172.21.15.98:0/3421409060 conn(0x7fc3b40b2230 msgr2=0x7fc3b40b0350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:57.749 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.744+0000 7fc3ba516640 1 -- 172.21.15.98:0/3421409060 shutdown_connections 2024-09-16T15:37:57.749 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.744+0000 7fc3ba516640 1 -- 172.21.15.98:0/3421409060 wait complete. 2024-09-16T15:37:57.757 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2024-09-16T15:37:56.711898+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219288,"kb_used_data":3048,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755432,"statfs":{"total":773094113280,"available":772869562368,"internally_reserved":0,"allocated":3121152,"data_stored":1835436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.189936"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.157551+0000","last_change":"2024-09-16T15:37:44.522255+0000","last_active":"2024-09-16T15:37:47.157551+0000","last_peered":"2024-09-16T15:37:47.157551+0000","last_clean":"2024-09-16T15:37:47.157551+0000","last_became_active":"2024-09-16T15:37:44.521954+0000","last_became_peered":"2024-09-16T15:37:44.521954+0000","last_unstale":"2024-09-16T15:37:47.157551+0000","last_undegraded":"2024-09-16T15:37:47.157551+0000","last_fullsized":"2024-09-16T15:37:47.157551+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:04:08.210631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.295767+0000","last_change":"2024-09-16T15:37:44.521698+0000","last_active":"2024-09-16T15:37:47.295767+0000","last_peered":"2024-09-16T15:37:47.295767+0000","last_clean":"2024-09-16T15:37:47.295767+0000","last_became_active":"2024-09-16T15:37:44.521108+0000","last_became_peered":"2024-09-16T15:37:44.521108+0000","last_unstale":"2024-09-16T15:37:47.295767+0000","last_undegraded":"2024-09-16T15:37:47.295767+0000","last_fullsized":"2024-09-16T15:37:47.295767+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:36:30.703573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.295614+0000","last_change":"2024-09-16T15:37:44.526656+0000","last_active":"2024-09-16T15:37:47.295614+0000","last_peered":"2024-09-16T15:37:47.295614+0000","last_clean":"2024-09-16T15:37:47.295614+0000","last_became_active":"2024-09-16T15:37:44.526371+0000","last_became_peered":"2024-09-16T15:37:44.526371+0000","last_unstale":"2024-09-16T15:37:47.295614+0000","last_undegraded":"2024-09-16T15:37:47.295614+0000","last_fullsized":"2024-09-16T15:37:47.295614+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:58:21.450388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:46.943693+0000","last_change":"2024-09-16T15:37:44.512933+0000","last_active":"2024-09-16T15:37:46.943693+0000","last_peered":"2024-09-16T15:37:46.943693+0000","last_clean":"2024-09-16T15:37:46.943693+0000","last_became_active":"2024-09-16T15:37:44.512675+0000","last_became_peered":"2024-09-16T15:37:44.512675+0000","last_unstale":"2024-09-16T15:37:46.943693+0000","last_undegraded":"2024-09-16T15:37:46.943693+0000","last_fullsized":"2024-09-16T15:37:46.943693+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:13:55.812269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.157367+0000","last_change":"2024-09-16T15:37:44.519918+0000","last_active":"2024-09-16T15:37:47.157367+0000","last_peered":"2024-09-16T15:37:47.157367+0000","last_clean":"2024-09-16T15:37:47.157367+0000","last_became_active":"2024-09-16T15:37:44.519424+0000","last_became_peered":"2024-09-16T15:37:44.519424+0000","last_unstale":"2024-09-16T15:37:47.157367+0000","last_undegraded":"2024-09-16T15:37:47.157367+0000","last_fullsized":"2024-09-16T15:37:47.157367+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:14:56.128121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:46.943654+0000","last_change":"2024-09-16T15:37:44.515343+0000","last_active":"2024-09-16T15:37:46.943654+0000","last_peered":"2024-09-16T15:37:46.943654+0000","last_clean":"2024-09-16T15:37:46.943654+0000","last_became_active":"2024-09-16T15:37:44.515130+0000","last_became_peered":"2024-09-16T15:37:44.515130+0000","last_unstale":"2024-09-16T15:37:46.943654+0000","last_undegraded":"2024-09-16T15:37:46.943654+0000","last_fullsized":"2024-09-16T15:37:46.943654+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:57:47.143508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.157210+0000","last_change":"2024-09-16T15:37:44.522713+0000","last_active":"2024-09-16T15:37:47.157210+0000","last_peered":"2024-09-16T15:37:47.157210+0000","last_clean":"2024-09-16T15:37:47.157210+0000","last_became_active":"2024-09-16T15:37:44.522455+0000","last_became_peered":"2024-09-16T15:37:44.522455+0000","last_unstale":"2024-09-16T15:37:47.157210+0000","last_undegraded":"2024-09-16T15:37:47.157210+0000","last_fullsized":"2024-09-16T15:37:47.157210+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:34:32.134838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.295408+0000","last_change":"2024-09-16T15:37:44.530623+0000","last_active":"2024-09-16T15:37:47.295408+0000","last_peered":"2024-09-16T15:37:47.295408+0000","last_clean":"2024-09-16T15:37:47.295408+0000","last_became_active":"2024-09-16T15:37:44.530278+0000","last_became_peered":"2024-09-16T15:37:44.530278+0000","last_unstale":"2024-09-16T15:37:47.295408+0000","last_undegraded":"2024-09-16T15:37:47.295408+0000","last_fullsized":"2024-09-16T15:37:47.295408+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T23:12:12.374603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.850903+0000","last_change":"2024-09-16T15:37:44.526860+0000","last_active":"2024-09-16T15:37:45.850903+0000","last_peered":"2024-09-16T15:37:45.850903+0000","last_clean":"2024-09-16T15:37:45.850903+0000","last_became_active":"2024-09-16T15:37:44.526611+0000","last_became_peered":"2024-09-16T15:37:44.526611+0000","last_unstale":"2024-09-16T15:37:45.850903+0000","last_undegraded":"2024-09-16T15:37:45.850903+0000","last_fullsized":"2024-09-16T15:37:45.850903+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:10:17.354173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.157550+0000","last_change":"2024-09-16T15:37:44.519349+0000","last_active":"2024-09-16T15:37:47.157550+0000","last_peered":"2024-09-16T15:37:47.157550+0000","last_clean":"2024-09-16T15:37:47.157550+0000","last_became_active":"2024-09-16T15:37:44.519074+0000","last_became_peered":"2024-09-16T15:37:44.519074+0000","last_unstale":"2024-09-16T15:37:47.157550+0000","last_undegraded":"2024-09-16T15:37:47.157550+0000","last_fullsized":"2024-09-16T15:37:47.157550+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T21:46:25.013947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.157206+0000","last_change":"2024-09-16T15:37:44.520396+0000","last_active":"2024-09-16T15:37:47.157206+0000","last_peered":"2024-09-16T15:37:47.157206+0000","last_clean":"2024-09-16T15:37:47.157206+0000","last_became_active":"2024-09-16T15:37:44.520166+0000","last_became_peered":"2024-09-16T15:37:44.520166+0000","last_unstale":"2024-09-16T15:37:47.157206+0000","last_undegraded":"2024-09-16T15:37:47.157206+0000","last_fullsized":"2024-09-16T15:37:47.157206+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:19:57.119675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.157296+0000","last_change":"2024-09-16T15:37:44.517541+0000","last_active":"2024-09-16T15:37:47.157296+0000","last_peered":"2024-09-16T15:37:47.157296+0000","last_clean":"2024-09-16T15:37:47.157296+0000","last_became_active":"2024-09-16T15:37:44.517304+0000","last_became_peered":"2024-09-16T15:37:44.517304+0000","last_unstale":"2024-09-16T15:37:47.157296+0000","last_undegraded":"2024-09-16T15:37:47.157296+0000","last_fullsized":"2024-09-16T15:37:47.157296+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:40:14.841427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.526086+0000","last_change":"2024-09-16T15:37:44.515572+0000","last_active":"2024-09-16T15:37:45.526086+0000","last_peered":"2024-09-16T15:37:45.526086+0000","last_clean":"2024-09-16T15:37:45.526086+0000","last_became_active":"2024-09-16T15:37:44.514667+0000","last_became_peered":"2024-09-16T15:37:44.514667+0000","last_unstale":"2024-09-16T15:37:45.526086+0000","last_undegraded":"2024-09-16T15:37:45.526086+0000","last_fullsized":"2024-09-16T15:37:45.526086+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:37:31.235473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.526350+0000","last_change":"2024-09-16T15:37:44.517134+0000","last_active":"2024-09-16T15:37:45.526350+0000","last_peered":"2024-09-16T15:37:45.526350+0000","last_clean":"2024-09-16T15:37:45.526350+0000","last_became_active":"2024-09-16T15:37:44.515946+0000","last_became_peered":"2024-09-16T15:37:44.515946+0000","last_unstale":"2024-09-16T15:37:45.526350+0000","last_undegraded":"2024-09-16T15:37:45.526350+0000","last_fullsized":"2024-09-16T15:37:45.526350+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:01:35.813267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.295391+0000","last_change":"2024-09-16T15:37:44.530620+0000","last_active":"2024-09-16T15:37:47.295391+0000","last_peered":"2024-09-16T15:37:47.295391+0000","last_clean":"2024-09-16T15:37:47.295391+0000","last_became_active":"2024-09-16T15:37:44.530286+0000","last_became_peered":"2024-09-16T15:37:44.530286+0000","last_unstale":"2024-09-16T15:37:47.295391+0000","last_undegraded":"2024-09-16T15:37:47.295391+0000","last_fullsized":"2024-09-16T15:37:47.295391+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T23:21:00.721426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.522970+0000","last_change":"2024-09-16T15:37:44.524560+0000","last_active":"2024-09-16T15:37:45.522970+0000","last_peered":"2024-09-16T15:37:45.522970+0000","last_clean":"2024-09-16T15:37:45.522970+0000","last_became_active":"2024-09-16T15:37:44.524314+0000","last_became_peered":"2024-09-16T15:37:44.524314+0000","last_unstale":"2024-09-16T15:37:45.522970+0000","last_undegraded":"2024-09-16T15:37:45.522970+0000","last_fullsized":"2024-09-16T15:37:45.522970+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:36:30.703573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.523673+0000","last_change":"2024-09-16T15:37:44.528374+0000","last_active":"2024-09-16T15:37:45.523673+0000","last_peered":"2024-09-16T15:37:45.523673+0000","last_clean":"2024-09-16T15:37:45.523673+0000","last_became_active":"2024-09-16T15:37:44.528131+0000","last_became_peered":"2024-09-16T15:37:44.528131+0000","last_unstale":"2024-09-16T15:37:45.523673+0000","last_undegraded":"2024-09-16T15:37:45.523673+0000","last_fullsized":"2024-09-16T15:37:45.523673+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:58:17.522035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:46.570682+0000","last_change":"2024-09-16T15:37:44.526873+0000","last_active":"2024-09-16T15:37:46.570682+0000","last_peered":"2024-09-16T15:37:46.570682+0000","last_clean":"2024-09-16T15:37:46.570682+0000","last_became_active":"2024-09-16T15:37:44.526627+0000","last_became_peered":"2024-09-16T15:37:44.526627+0000","last_unstale":"2024-09-16T15:37:46.570682+0000","last_undegraded":"2024-09-16T15:37:46.570682+0000","last_fullsized":"2024-09-16T15:37:46.570682+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:59:08.559983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.523655+0000","last_change":"2024-09-16T15:37:44.528216+0000","last_active":"2024-09-16T15:37:45.523655+0000","last_peered":"2024-09-16T15:37:45.523655+0000","last_clean":"2024-09-16T15:37:45.523655+0000","last_became_active":"2024-09-16T15:37:44.527905+0000","last_became_peered":"2024-09-16T15:37:44.527905+0000","last_unstale":"2024-09-16T15:37:45.523655+0000","last_undegraded":"2024-09-16T15:37:45.523655+0000","last_fullsized":"2024-09-16T15:37:45.523655+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:05:13.190051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.157271+0000","last_change":"2024-09-16T15:37:44.516828+0000","last_active":"2024-09-16T15:37:47.157271+0000","last_peered":"2024-09-16T15:37:47.157271+0000","last_clean":"2024-09-16T15:37:47.157271+0000","last_became_active":"2024-09-16T15:37:44.516568+0000","last_became_peered":"2024-09-16T15:37:44.516568+0000","last_unstale":"2024-09-16T15:37:47.157271+0000","last_undegraded":"2024-09-16T15:37:47.157271+0000","last_fullsized":"2024-09-16T15:37:47.157271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:15:29.298840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.525704+0000","last_change":"2024-09-16T15:37:44.512013+0000","last_active":"2024-09-16T15:37:45.525704+0000","last_peered":"2024-09-16T15:37:45.525704+0000","last_clean":"2024-09-16T15:37:45.525704+0000","last_became_active":"2024-09-16T15:37:44.511686+0000","last_became_peered":"2024-09-16T15:37:44.511686+0000","last_unstale":"2024-09-16T15:37:45.525704+0000","last_undegraded":"2024-09-16T15:37:45.525704+0000","last_fullsized":"2024-09-16T15:37:45.525704+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:50:11.538129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.850574+0000","last_change":"2024-09-16T15:37:44.517626+0000","last_active":"2024-09-16T15:37:45.850574+0000","last_peered":"2024-09-16T15:37:45.850574+0000","last_clean":"2024-09-16T15:37:45.850574+0000","last_became_active":"2024-09-16T15:37:44.516514+0000","last_became_peered":"2024-09-16T15:37:44.516514+0000","last_unstale":"2024-09-16T15:37:45.850574+0000","last_undegraded":"2024-09-16T15:37:45.850574+0000","last_fullsized":"2024-09-16T15:37:45.850574+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:54:51.338019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.295511+0000","last_change":"2024-09-16T15:37:44.524190+0000","last_active":"2024-09-16T15:37:47.295511+0000","last_peered":"2024-09-16T15:37:47.295511+0000","last_clean":"2024-09-16T15:37:47.295511+0000","last_became_active":"2024-09-16T15:37:44.523875+0000","last_became_peered":"2024-09-16T15:37:44.523875+0000","last_unstale":"2024-09-16T15:37:47.295511+0000","last_undegraded":"2024-09-16T15:37:47.295511+0000","last_fullsized":"2024-09-16T15:37:47.295511+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:20:20.809747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.522981+0000","last_change":"2024-09-16T15:37:44.524747+0000","last_active":"2024-09-16T15:37:45.522981+0000","last_peered":"2024-09-16T15:37:45.522981+0000","last_clean":"2024-09-16T15:37:45.522981+0000","last_became_active":"2024-09-16T15:37:44.524500+0000","last_became_peered":"2024-09-16T15:37:44.524500+0000","last_unstale":"2024-09-16T15:37:45.522981+0000","last_undegraded":"2024-09-16T15:37:45.522981+0000","last_fullsized":"2024-09-16T15:37:45.522981+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:04:08.210631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.295685+0000","last_change":"2024-09-16T15:37:44.517306+0000","last_active":"2024-09-16T15:37:47.295685+0000","last_peered":"2024-09-16T15:37:47.295685+0000","last_clean":"2024-09-16T15:37:47.295685+0000","last_became_active":"2024-09-16T15:37:44.516741+0000","last_became_peered":"2024-09-16T15:37:44.516741+0000","last_unstale":"2024-09-16T15:37:47.295685+0000","last_undegraded":"2024-09-16T15:37:47.295685+0000","last_fullsized":"2024-09-16T15:37:47.295685+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:40:00.773616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:46.943914+0000","last_change":"2024-09-16T15:37:44.519625+0000","last_active":"2024-09-16T15:37:46.943914+0000","last_peered":"2024-09-16T15:37:46.943914+0000","last_clean":"2024-09-16T15:37:46.943914+0000","last_became_active":"2024-09-16T15:37:44.519337+0000","last_became_peered":"2024-09-16T15:37:44.519337+0000","last_unstale":"2024-09-16T15:37:46.943914+0000","last_undegraded":"2024-09-16T15:37:46.943914+0000","last_fullsized":"2024-09-16T15:37:46.943914+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T21:56:02.373459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.526539+0000","last_change":"2024-09-16T15:37:44.519708+0000","last_active":"2024-09-16T15:37:45.526539+0000","last_peered":"2024-09-16T15:37:45.526539+0000","last_clean":"2024-09-16T15:37:45.526539+0000","last_became_active":"2024-09-16T15:37:44.519439+0000","last_became_peered":"2024-09-16T15:37:44.519439+0000","last_unstale":"2024-09-16T15:37:45.526539+0000","last_undegraded":"2024-09-16T15:37:45.526539+0000","last_fullsized":"2024-09-16T15:37:45.526539+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:56:40.956164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.526026+0000","last_change":"2024-09-16T15:37:44.518861+0000","last_active":"2024-09-16T15:37:45.526026+0000","last_peered":"2024-09-16T15:37:45.526026+0000","last_clean":"2024-09-16T15:37:45.526026+0000","last_became_active":"2024-09-16T15:37:44.518600+0000","last_became_peered":"2024-09-16T15:37:44.518600+0000","last_unstale":"2024-09-16T15:37:45.526026+0000","last_undegraded":"2024-09-16T15:37:45.526026+0000","last_fullsized":"2024-09-16T15:37:45.526026+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:52:07.454732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.295825+0000","last_change":"2024-09-16T15:37:44.524203+0000","last_active":"2024-09-16T15:37:47.295825+0000","last_peered":"2024-09-16T15:37:47.295825+0000","last_clean":"2024-09-16T15:37:47.295825+0000","last_became_active":"2024-09-16T15:37:44.523934+0000","last_became_peered":"2024-09-16T15:37:44.523934+0000","last_unstale":"2024-09-16T15:37:47.295825+0000","last_undegraded":"2024-09-16T15:37:47.295825+0000","last_fullsized":"2024-09-16T15:37:47.295825+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:51:41.621542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.523056+0000","last_change":"2024-09-16T15:37:44.524033+0000","last_active":"2024-09-16T15:37:45.523056+0000","last_peered":"2024-09-16T15:37:45.523056+0000","last_clean":"2024-09-16T15:37:45.523056+0000","last_became_active":"2024-09-16T15:37:44.523487+0000","last_became_peered":"2024-09-16T15:37:44.523487+0000","last_unstale":"2024-09-16T15:37:45.523056+0000","last_undegraded":"2024-09-16T15:37:45.523056+0000","last_fullsized":"2024-09-16T15:37:45.523056+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:27:29.507738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:46.570433+0000","last_change":"2024-09-16T15:37:44.522595+0000","last_active":"2024-09-16T15:37:46.570433+0000","last_peered":"2024-09-16T15:37:46.570433+0000","last_clean":"2024-09-16T15:37:46.570433+0000","last_became_active":"2024-09-16T15:37:44.522271+0000","last_became_peered":"2024-09-16T15:37:44.522271+0000","last_unstale":"2024-09-16T15:37:46.570433+0000","last_undegraded":"2024-09-16T15:37:46.570433+0000","last_fullsized":"2024-09-16T15:37:46.570433+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:55:59.838134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:46.943654+0000","last_change":"2024-09-16T15:37:44.515292+0000","last_active":"2024-09-16T15:37:46.943654+0000","last_peered":"2024-09-16T15:37:46.943654+0000","last_clean":"2024-09-16T15:37:46.943654+0000","last_became_active":"2024-09-16T15:37:44.513909+0000","last_became_peered":"2024-09-16T15:37:44.513909+0000","last_unstale":"2024-09-16T15:37:46.943654+0000","last_undegraded":"2024-09-16T15:37:46.943654+0000","last_fullsized":"2024-09-16T15:37:46.943654+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:54:51.338019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.850677+0000","last_change":"2024-09-16T15:37:44.517890+0000","last_active":"2024-09-16T15:37:45.850677+0000","last_peered":"2024-09-16T15:37:45.850677+0000","last_clean":"2024-09-16T15:37:45.850677+0000","last_became_active":"2024-09-16T15:37:44.517373+0000","last_became_peered":"2024-09-16T15:37:44.517373+0000","last_unstale":"2024-09-16T15:37:45.850677+0000","last_undegraded":"2024-09-16T15:37:45.850677+0000","last_fullsized":"2024-09-16T15:37:45.850677+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:16:32.486922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.295709+0000","last_change":"2024-09-16T15:37:43.510897+0000","last_active":"2024-09-16T15:37:47.295709+0000","last_peered":"2024-09-16T15:37:47.295709+0000","last_clean":"2024-09-16T15:37:47.295709+0000","last_became_active":"2024-09-16T15:37:43.510468+0000","last_became_peered":"2024-09-16T15:37:43.510468+0000","last_unstale":"2024-09-16T15:37:47.295709+0000","last_undegraded":"2024-09-16T15:37:47.295709+0000","last_fullsized":"2024-09-16T15:37:47.295709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:48:05.099286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.525914+0000","last_change":"2024-09-16T15:37:44.517344+0000","last_active":"2024-09-16T15:37:45.525914+0000","last_peered":"2024-09-16T15:37:45.525914+0000","last_clean":"2024-09-16T15:37:45.525914+0000","last_became_active":"2024-09-16T15:37:44.516446+0000","last_became_peered":"2024-09-16T15:37:44.516446+0000","last_unstale":"2024-09-16T15:37:45.525914+0000","last_undegraded":"2024-09-16T15:37:45.525914+0000","last_fullsized":"2024-09-16T15:37:45.525914+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:07:19.107946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.523251+0000","last_change":"2024-09-16T15:37:43.521672+0000","last_active":"2024-09-16T15:37:45.523251+0000","last_peered":"2024-09-16T15:37:45.523251+0000","last_clean":"2024-09-16T15:37:45.523251+0000","last_became_active":"2024-09-16T15:37:43.521418+0000","last_became_peered":"2024-09-16T15:37:43.521418+0000","last_unstale":"2024-09-16T15:37:45.523251+0000","last_undegraded":"2024-09-16T15:37:45.523251+0000","last_fullsized":"2024-09-16T15:37:45.523251+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:16:31.480042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.525828+0000","last_change":"2024-09-16T15:37:43.517465+0000","last_active":"2024-09-16T15:37:45.525828+0000","last_peered":"2024-09-16T15:37:45.525828+0000","last_clean":"2024-09-16T15:37:45.525828+0000","last_became_active":"2024-09-16T15:37:43.517177+0000","last_became_peered":"2024-09-16T15:37:43.517177+0000","last_unstale":"2024-09-16T15:37:45.525828+0000","last_undegraded":"2024-09-16T15:37:45.525828+0000","last_fullsized":"2024-09-16T15:37:45.525828+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T21:38:37.823375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.295924+0000","last_change":"2024-09-16T15:37:44.522976+0000","last_active":"2024-09-16T15:37:47.295924+0000","last_peered":"2024-09-16T15:37:47.295924+0000","last_clean":"2024-09-16T15:37:47.295924+0000","last_became_active":"2024-09-16T15:37:44.522718+0000","last_became_peered":"2024-09-16T15:37:44.522718+0000","last_unstale":"2024-09-16T15:37:47.295924+0000","last_undegraded":"2024-09-16T15:37:47.295924+0000","last_fullsized":"2024-09-16T15:37:47.295924+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:44:42.608817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.523077+0000","last_change":"2024-09-16T15:37:43.519319+0000","last_active":"2024-09-16T15:37:45.523077+0000","last_peered":"2024-09-16T15:37:45.523077+0000","last_clean":"2024-09-16T15:37:45.523077+0000","last_became_active":"2024-09-16T15:37:43.518711+0000","last_became_peered":"2024-09-16T15:37:43.518711+0000","last_unstale":"2024-09-16T15:37:45.523077+0000","last_undegraded":"2024-09-16T15:37:45.523077+0000","last_fullsized":"2024-09-16T15:37:45.523077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:39:24.887816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.525985+0000","last_change":"2024-09-16T15:37:44.517222+0000","last_active":"2024-09-16T15:37:45.525985+0000","last_peered":"2024-09-16T15:37:45.525985+0000","last_clean":"2024-09-16T15:37:45.525985+0000","last_became_active":"2024-09-16T15:37:44.516380+0000","last_became_peered":"2024-09-16T15:37:44.516380+0000","last_unstale":"2024-09-16T15:37:45.525985+0000","last_undegraded":"2024-09-16T15:37:45.525985+0000","last_fullsized":"2024-09-16T15:37:45.525985+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T21:34:31.159339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.850923+0000","last_change":"2024-09-16T15:37:43.514400+0000","last_active":"2024-09-16T15:37:45.850923+0000","last_peered":"2024-09-16T15:37:45.850923+0000","last_clean":"2024-09-16T15:37:45.850923+0000","last_became_active":"2024-09-16T15:37:43.514124+0000","last_became_peered":"2024-09-16T15:37:43.514124+0000","last_unstale":"2024-09-16T15:37:45.850923+0000","last_undegraded":"2024-09-16T15:37:45.850923+0000","last_fullsized":"2024-09-16T15:37:45.850923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:24:48.654268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:46.943985+0000","last_change":"2024-09-16T15:37:44.519856+0000","last_active":"2024-09-16T15:37:46.943985+0000","last_peered":"2024-09-16T15:37:46.943985+0000","last_clean":"2024-09-16T15:37:46.943985+0000","last_became_active":"2024-09-16T15:37:44.519014+0000","last_became_peered":"2024-09-16T15:37:44.519014+0000","last_unstale":"2024-09-16T15:37:46.943985+0000","last_undegraded":"2024-09-16T15:37:46.943985+0000","last_fullsized":"2024-09-16T15:37:46.943985+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:08:42.429536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.157585+0000","last_change":"2024-09-16T15:37:43.515976+0000","last_active":"2024-09-16T15:37:47.157585+0000","last_peered":"2024-09-16T15:37:47.157585+0000","last_clean":"2024-09-16T15:37:47.157585+0000","last_became_active":"2024-09-16T15:37:43.515426+0000","last_became_peered":"2024-09-16T15:37:43.515426+0000","last_unstale":"2024-09-16T15:37:47.157585+0000","last_undegraded":"2024-09-16T15:37:47.157585+0000","last_fullsized":"2024-09-16T15:37:47.157585+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:45:27.227739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.296046+0000","last_change":"2024-09-16T15:37:44.526711+0000","last_active":"2024-09-16T15:37:47.296046+0000","last_peered":"2024-09-16T15:37:47.296046+0000","last_clean":"2024-09-16T15:37:47.296046+0000","last_became_active":"2024-09-16T15:37:44.526458+0000","last_became_peered":"2024-09-16T15:37:44.526458+0000","last_unstale":"2024-09-16T15:37:47.296046+0000","last_undegraded":"2024-09-16T15:37:47.296046+0000","last_fullsized":"2024-09-16T15:37:47.296046+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:04:08.210631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:46.570594+0000","last_change":"2024-09-16T15:37:43.516257+0000","last_active":"2024-09-16T15:37:46.570594+0000","last_peered":"2024-09-16T15:37:46.570594+0000","last_clean":"2024-09-16T15:37:46.570594+0000","last_became_active":"2024-09-16T15:37:43.515944+0000","last_became_peered":"2024-09-16T15:37:43.515944+0000","last_unstale":"2024-09-16T15:37:46.570594+0000","last_undegraded":"2024-09-16T15:37:46.570594+0000","last_fullsized":"2024-09-16T15:37:46.570594+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:25:01.970817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.523356+0000","last_change":"2024-09-16T15:37:44.519159+0000","last_active":"2024-09-16T15:37:45.523356+0000","last_peered":"2024-09-16T15:37:45.523356+0000","last_clean":"2024-09-16T15:37:45.523356+0000","last_became_active":"2024-09-16T15:37:44.518920+0000","last_became_peered":"2024-09-16T15:37:44.518920+0000","last_unstale":"2024-09-16T15:37:45.523356+0000","last_undegraded":"2024-09-16T15:37:45.523356+0000","last_fullsized":"2024-09-16T15:37:45.523356+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:59:53.751921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:46.943754+0000","last_change":"2024-09-16T15:37:43.514513+0000","last_active":"2024-09-16T15:37:46.943754+0000","last_peered":"2024-09-16T15:37:46.943754+0000","last_clean":"2024-09-16T15:37:46.943754+0000","last_became_active":"2024-09-16T15:37:43.514196+0000","last_became_peered":"2024-09-16T15:37:43.514196+0000","last_unstale":"2024-09-16T15:37:46.943754+0000","last_undegraded":"2024-09-16T15:37:46.943754+0000","last_fullsized":"2024-09-16T15:37:46.943754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T21:42:39.448578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.157298+0000","last_change":"2024-09-16T15:37:44.518597+0000","last_active":"2024-09-16T15:37:47.157298+0000","last_peered":"2024-09-16T15:37:47.157298+0000","last_clean":"2024-09-16T15:37:47.157298+0000","last_became_active":"2024-09-16T15:37:44.518334+0000","last_became_peered":"2024-09-16T15:37:44.518334+0000","last_unstale":"2024-09-16T15:37:47.157298+0000","last_undegraded":"2024-09-16T15:37:47.157298+0000","last_fullsized":"2024-09-16T15:37:47.157298+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:18:49.770991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:46.570525+0000","last_change":"2024-09-16T15:37:43.521768+0000","last_active":"2024-09-16T15:37:46.570525+0000","last_peered":"2024-09-16T15:37:46.570525+0000","last_clean":"2024-09-16T15:37:46.570525+0000","last_became_active":"2024-09-16T15:37:43.521541+0000","last_became_peered":"2024-09-16T15:37:43.521541+0000","last_unstale":"2024-09-16T15:37:46.570525+0000","last_undegraded":"2024-09-16T15:37:46.570525+0000","last_fullsized":"2024-09-16T15:37:46.570525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:48:05.099286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.526567+0000","last_change":"2024-09-16T15:37:44.520303+0000","last_active":"2024-09-16T15:37:45.526567+0000","last_peered":"2024-09-16T15:37:45.526567+0000","last_clean":"2024-09-16T15:37:45.526567+0000","last_became_active":"2024-09-16T15:37:44.520036+0000","last_became_peered":"2024-09-16T15:37:44.520036+0000","last_unstale":"2024-09-16T15:37:45.526567+0000","last_undegraded":"2024-09-16T15:37:45.526567+0000","last_fullsized":"2024-09-16T15:37:45.526567+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:02:45.771447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.523462+0000","last_change":"2024-09-16T15:37:43.519519+0000","last_active":"2024-09-16T15:37:45.523462+0000","last_peered":"2024-09-16T15:37:45.523462+0000","last_clean":"2024-09-16T15:37:45.523462+0000","last_became_active":"2024-09-16T15:37:43.518682+0000","last_became_peered":"2024-09-16T15:37:43.518682+0000","last_unstale":"2024-09-16T15:37:45.523462+0000","last_undegraded":"2024-09-16T15:37:45.523462+0000","last_fullsized":"2024-09-16T15:37:45.523462+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:02:59.404804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.523248+0000","last_change":"2024-09-16T15:37:44.526644+0000","last_active":"2024-09-16T15:37:45.523248+0000","last_peered":"2024-09-16T15:37:45.523248+0000","last_clean":"2024-09-16T15:37:45.523248+0000","last_became_active":"2024-09-16T15:37:44.526382+0000","last_became_peered":"2024-09-16T15:37:44.526382+0000","last_unstale":"2024-09-16T15:37:45.523248+0000","last_undegraded":"2024-09-16T15:37:45.523248+0000","last_fullsized":"2024-09-16T15:37:45.523248+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:10:42.230703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.157113+0000","last_change":"2024-09-16T15:37:43.519576+0000","last_active":"2024-09-16T15:37:47.157113+0000","last_peered":"2024-09-16T15:37:47.157113+0000","last_clean":"2024-09-16T15:37:47.157113+0000","last_became_active":"2024-09-16T15:37:43.517609+0000","last_became_peered":"2024-09-16T15:37:43.517609+0000","last_unstale":"2024-09-16T15:37:47.157113+0000","last_undegraded":"2024-09-16T15:37:47.157113+0000","last_fullsized":"2024-09-16T15:37:47.157113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:54:50.331139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.850548+0000","last_change":"2024-09-16T15:37:44.525100+0000","last_active":"2024-09-16T15:37:45.850548+0000","last_peered":"2024-09-16T15:37:45.850548+0000","last_clean":"2024-09-16T15:37:45.850548+0000","last_became_active":"2024-09-16T15:37:44.524811+0000","last_became_peered":"2024-09-16T15:37:44.524811+0000","last_unstale":"2024-09-16T15:37:45.850548+0000","last_undegraded":"2024-09-16T15:37:45.850548+0000","last_fullsized":"2024-09-16T15:37:45.850548+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:51:54.814659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.525619+0000","last_change":"2024-09-16T15:37:43.514266+0000","last_active":"2024-09-16T15:37:45.525619+0000","last_peered":"2024-09-16T15:37:45.525619+0000","last_clean":"2024-09-16T15:37:45.525619+0000","last_became_active":"2024-09-16T15:37:43.513980+0000","last_became_peered":"2024-09-16T15:37:43.513980+0000","last_unstale":"2024-09-16T15:37:45.525619+0000","last_undegraded":"2024-09-16T15:37:45.525619+0000","last_fullsized":"2024-09-16T15:37:45.525619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:03:21.436525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.523013+0000","last_change":"2024-09-16T15:37:44.518537+0000","last_active":"2024-09-16T15:37:45.523013+0000","last_peered":"2024-09-16T15:37:45.523013+0000","last_clean":"2024-09-16T15:37:45.523013+0000","last_became_active":"2024-09-16T15:37:44.518264+0000","last_became_peered":"2024-09-16T15:37:44.518264+0000","last_unstale":"2024-09-16T15:37:45.523013+0000","last_undegraded":"2024-09-16T15:37:45.523013+0000","last_fullsized":"2024-09-16T15:37:45.523013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:03:18.944435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.157740+0000","last_change":"2024-09-16T15:37:43.518884+0000","last_active":"2024-09-16T15:37:47.157740+0000","last_peered":"2024-09-16T15:37:47.157740+0000","last_clean":"2024-09-16T15:37:47.157740+0000","last_became_active":"2024-09-16T15:37:43.517494+0000","last_became_peered":"2024-09-16T15:37:43.517494+0000","last_unstale":"2024-09-16T15:37:47.157740+0000","last_undegraded":"2024-09-16T15:37:47.157740+0000","last_fullsized":"2024-09-16T15:37:47.157740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:51:53.807779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:46.944015+0000","last_change":"2024-09-16T15:37:44.513568+0000","last_active":"2024-09-16T15:37:46.944015+0000","last_peered":"2024-09-16T15:37:46.944015+0000","last_clean":"2024-09-16T15:37:46.944015+0000","last_became_active":"2024-09-16T15:37:44.513308+0000","last_became_peered":"2024-09-16T15:37:44.513308+0000","last_unstale":"2024-09-16T15:37:46.944015+0000","last_undegraded":"2024-09-16T15:37:46.944015+0000","last_fullsized":"2024-09-16T15:37:46.944015+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:58:10.612197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.526185+0000","last_change":"2024-09-16T15:37:43.514250+0000","last_active":"2024-09-16T15:37:45.526185+0000","last_peered":"2024-09-16T15:37:45.526185+0000","last_clean":"2024-09-16T15:37:45.526185+0000","last_became_active":"2024-09-16T15:37:43.513954+0000","last_became_peered":"2024-09-16T15:37:43.513954+0000","last_unstale":"2024-09-16T15:37:45.526185+0000","last_undegraded":"2024-09-16T15:37:45.526185+0000","last_fullsized":"2024-09-16T15:37:45.526185+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:57:46.136628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.157747+0000","last_change":"2024-09-16T15:37:44.515874+0000","last_active":"2024-09-16T15:37:47.157747+0000","last_peered":"2024-09-16T15:37:47.157747+0000","last_clean":"2024-09-16T15:37:47.157747+0000","last_became_active":"2024-09-16T15:37:44.515608+0000","last_became_peered":"2024-09-16T15:37:44.515608+0000","last_unstale":"2024-09-16T15:37:47.157747+0000","last_undegraded":"2024-09-16T15:37:47.157747+0000","last_fullsized":"2024-09-16T15:37:47.157747+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:09:09.464477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.295751+0000","last_change":"2024-09-16T15:37:43.514330+0000","last_active":"2024-09-16T15:37:47.295751+0000","last_peered":"2024-09-16T15:37:47.295751+0000","last_clean":"2024-09-16T15:37:47.295751+0000","last_became_active":"2024-09-16T15:37:43.513900+0000","last_became_peered":"2024-09-16T15:37:43.513900+0000","last_unstale":"2024-09-16T15:37:47.295751+0000","last_undegraded":"2024-09-16T15:37:47.295751+0000","last_fullsized":"2024-09-16T15:37:47.295751+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:45:27.227739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.157504+0000","last_change":"2024-09-16T15:37:44.523100+0000","last_active":"2024-09-16T15:37:47.157504+0000","last_peered":"2024-09-16T15:37:47.157504+0000","last_clean":"2024-09-16T15:37:47.157504+0000","last_became_active":"2024-09-16T15:37:44.522300+0000","last_became_peered":"2024-09-16T15:37:44.522300+0000","last_unstale":"2024-09-16T15:37:47.157504+0000","last_undegraded":"2024-09-16T15:37:47.157504+0000","last_fullsized":"2024-09-16T15:37:47.157504+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:46:13.128386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.526586+0000","last_change":"2024-09-16T15:37:43.520873+0000","last_active":"2024-09-16T15:37:45.526586+0000","last_peered":"2024-09-16T15:37:45.526586+0000","last_clean":"2024-09-16T15:37:45.526586+0000","last_became_active":"2024-09-16T15:37:43.520561+0000","last_became_peered":"2024-09-16T15:37:43.520561+0000","last_unstale":"2024-09-16T15:37:45.526586+0000","last_undegraded":"2024-09-16T15:37:45.526586+0000","last_fullsized":"2024-09-16T15:37:45.526586+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:08:30.145981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.523562+0000","last_change":"2024-09-16T15:37:44.521919+0000","last_active":"2024-09-16T15:37:45.523562+0000","last_peered":"2024-09-16T15:37:45.523562+0000","last_clean":"2024-09-16T15:37:45.523562+0000","last_became_active":"2024-09-16T15:37:44.521672+0000","last_became_peered":"2024-09-16T15:37:44.521672+0000","last_unstale":"2024-09-16T15:37:45.523562+0000","last_undegraded":"2024-09-16T15:37:45.523562+0000","last_fullsized":"2024-09-16T15:37:45.523562+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:50:08.196173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":111,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.850562+0000","last_change":"2024-09-16T15:37:37.258601+0000","last_active":"2024-09-16T15:37:45.850562+0000","last_peered":"2024-09-16T15:37:45.850562+0000","last_clean":"2024-09-16T15:37:45.850562+0000","last_became_active":"2024-09-16T15:37:37.257584+0000","last_became_peered":"2024-09-16T15:37:37.257584+0000","last_unstale":"2024-09-16T15:37:45.850562+0000","last_undegraded":"2024-09-16T15:37:45.850562+0000","last_fullsized":"2024-09-16T15:37:45.850562+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:35.447043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:35.447043+0000","last_clean_scrub_stamp":"2024-09-16T15:37:35.447043+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:43:17.464894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.523369+0000","last_change":"2024-09-16T15:37:43.510139+0000","last_active":"2024-09-16T15:37:45.523369+0000","last_peered":"2024-09-16T15:37:45.523369+0000","last_clean":"2024-09-16T15:37:45.523369+0000","last_became_active":"2024-09-16T15:37:43.509820+0000","last_became_peered":"2024-09-16T15:37:43.509820+0000","last_unstale":"2024-09-16T15:37:45.523369+0000","last_undegraded":"2024-09-16T15:37:45.523369+0000","last_fullsized":"2024-09-16T15:37:45.523369+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:59:50.127383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.526700+0000","last_change":"2024-09-16T15:37:44.513059+0000","last_active":"2024-09-16T15:37:45.526700+0000","last_peered":"2024-09-16T15:37:45.526700+0000","last_clean":"2024-09-16T15:37:45.526700+0000","last_became_active":"2024-09-16T15:37:44.511241+0000","last_became_peered":"2024-09-16T15:37:44.511241+0000","last_unstale":"2024-09-16T15:37:45.526700+0000","last_undegraded":"2024-09-16T15:37:45.526700+0000","last_fullsized":"2024-09-16T15:37:45.526700+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:34:32.134838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.523129+0000","last_change":"2024-09-16T15:37:43.519442+0000","last_active":"2024-09-16T15:37:45.523129+0000","last_peered":"2024-09-16T15:37:45.523129+0000","last_clean":"2024-09-16T15:37:45.523129+0000","last_became_active":"2024-09-16T15:37:43.519204+0000","last_became_peered":"2024-09-16T15:37:43.519204+0000","last_unstale":"2024-09-16T15:37:45.523129+0000","last_undegraded":"2024-09-16T15:37:45.523129+0000","last_fullsized":"2024-09-16T15:37:45.523129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:29:35.721810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.525649+0000","last_change":"2024-09-16T15:37:44.511988+0000","last_active":"2024-09-16T15:37:45.525649+0000","last_peered":"2024-09-16T15:37:45.525649+0000","last_clean":"2024-09-16T15:37:45.525649+0000","last_became_active":"2024-09-16T15:37:44.511679+0000","last_became_peered":"2024-09-16T15:37:44.511679+0000","last_unstale":"2024-09-16T15:37:45.525649+0000","last_undegraded":"2024-09-16T15:37:45.525649+0000","last_fullsized":"2024-09-16T15:37:45.525649+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:39:56.702467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:46.570381+0000","last_change":"2024-09-16T15:37:43.515953+0000","last_active":"2024-09-16T15:37:46.570381+0000","last_peered":"2024-09-16T15:37:46.570381+0000","last_clean":"2024-09-16T15:37:46.570381+0000","last_became_active":"2024-09-16T15:37:43.515662+0000","last_became_peered":"2024-09-16T15:37:43.515662+0000","last_unstale":"2024-09-16T15:37:46.570381+0000","last_undegraded":"2024-09-16T15:37:46.570381+0000","last_fullsized":"2024-09-16T15:37:46.570381+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:45:09.277422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.295900+0000","last_change":"2024-09-16T15:37:44.525005+0000","last_active":"2024-09-16T15:37:47.295900+0000","last_peered":"2024-09-16T15:37:47.295900+0000","last_clean":"2024-09-16T15:37:47.295900+0000","last_became_active":"2024-09-16T15:37:44.524613+0000","last_became_peered":"2024-09-16T15:37:44.524613+0000","last_unstale":"2024-09-16T15:37:47.295900+0000","last_undegraded":"2024-09-16T15:37:47.295900+0000","last_fullsized":"2024-09-16T15:37:47.295900+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T23:33:15.012052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.523530+0000","last_change":"2024-09-16T15:37:43.513231+0000","last_active":"2024-09-16T15:37:45.523530+0000","last_peered":"2024-09-16T15:37:45.523530+0000","last_clean":"2024-09-16T15:37:45.523530+0000","last_became_active":"2024-09-16T15:37:43.512954+0000","last_became_peered":"2024-09-16T15:37:43.512954+0000","last_unstale":"2024-09-16T15:37:45.523530+0000","last_undegraded":"2024-09-16T15:37:45.523530+0000","last_fullsized":"2024-09-16T15:37:45.523530+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:50:40.599021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.157434+0000","last_change":"2024-09-16T15:37:44.513200+0000","last_active":"2024-09-16T15:37:47.157434+0000","last_peered":"2024-09-16T15:37:47.157434+0000","last_clean":"2024-09-16T15:37:47.157434+0000","last_became_active":"2024-09-16T15:37:44.512855+0000","last_became_peered":"2024-09-16T15:37:44.512855+0000","last_unstale":"2024-09-16T15:37:47.157434+0000","last_undegraded":"2024-09-16T15:37:47.157434+0000","last_fullsized":"2024-09-16T15:37:47.157434+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:05:31.763584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.295589+0000","last_change":"2024-09-16T15:37:43.510480+0000","last_active":"2024-09-16T15:37:47.295589+0000","last_peered":"2024-09-16T15:37:47.295589+0000","last_clean":"2024-09-16T15:37:47.295589+0000","last_became_active":"2024-09-16T15:37:43.510223+0000","last_became_peered":"2024-09-16T15:37:43.510223+0000","last_unstale":"2024-09-16T15:37:47.295589+0000","last_undegraded":"2024-09-16T15:37:47.295589+0000","last_fullsized":"2024-09-16T15:37:47.295589+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:37:32.374134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:46.943843+0000","last_change":"2024-09-16T15:37:44.516105+0000","last_active":"2024-09-16T15:37:46.943843+0000","last_peered":"2024-09-16T15:37:46.943843+0000","last_clean":"2024-09-16T15:37:46.943843+0000","last_became_active":"2024-09-16T15:37:44.515864+0000","last_became_peered":"2024-09-16T15:37:44.515864+0000","last_unstale":"2024-09-16T15:37:46.943843+0000","last_undegraded":"2024-09-16T15:37:46.943843+0000","last_fullsized":"2024-09-16T15:37:46.943843+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:59:08.559983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.523657+0000","last_change":"2024-09-16T15:37:43.515757+0000","last_active":"2024-09-16T15:37:45.523657+0000","last_peered":"2024-09-16T15:37:45.523657+0000","last_clean":"2024-09-16T15:37:45.523657+0000","last_became_active":"2024-09-16T15:37:43.515199+0000","last_became_peered":"2024-09-16T15:37:43.515199+0000","last_unstale":"2024-09-16T15:37:45.523657+0000","last_undegraded":"2024-09-16T15:37:45.523657+0000","last_fullsized":"2024-09-16T15:37:45.523657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:42:43.736513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.526573+0000","last_change":"2024-09-16T15:37:44.515147+0000","last_active":"2024-09-16T15:37:45.526573+0000","last_peered":"2024-09-16T15:37:45.526573+0000","last_clean":"2024-09-16T15:37:45.526573+0000","last_became_active":"2024-09-16T15:37:44.514518+0000","last_became_peered":"2024-09-16T15:37:44.514518+0000","last_unstale":"2024-09-16T15:37:45.526573+0000","last_undegraded":"2024-09-16T15:37:45.526573+0000","last_fullsized":"2024-09-16T15:37:45.526573+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:57:36.296851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.526280+0000","last_change":"2024-09-16T15:37:43.518081+0000","last_active":"2024-09-16T15:37:45.526280+0000","last_peered":"2024-09-16T15:37:45.526280+0000","last_clean":"2024-09-16T15:37:45.526280+0000","last_became_active":"2024-09-16T15:37:43.517744+0000","last_became_peered":"2024-09-16T15:37:43.517744+0000","last_unstale":"2024-09-16T15:37:45.526280+0000","last_undegraded":"2024-09-16T15:37:45.526280+0000","last_fullsized":"2024-09-16T15:37:45.526280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:55:58.831254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.526362+0000","last_change":"2024-09-16T15:37:44.518787+0000","last_active":"2024-09-16T15:37:45.526362+0000","last_peered":"2024-09-16T15:37:45.526362+0000","last_clean":"2024-09-16T15:37:45.526362+0000","last_became_active":"2024-09-16T15:37:44.517824+0000","last_became_peered":"2024-09-16T15:37:44.517824+0000","last_unstale":"2024-09-16T15:37:45.526362+0000","last_undegraded":"2024-09-16T15:37:45.526362+0000","last_fullsized":"2024-09-16T15:37:45.526362+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:19:57.119675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.523623+0000","last_change":"2024-09-16T15:37:43.519357+0000","last_active":"2024-09-16T15:37:45.523623+0000","last_peered":"2024-09-16T15:37:45.523623+0000","last_clean":"2024-09-16T15:37:45.523623+0000","last_became_active":"2024-09-16T15:37:43.519050+0000","last_became_peered":"2024-09-16T15:37:43.519050+0000","last_unstale":"2024-09-16T15:37:45.523623+0000","last_undegraded":"2024-09-16T15:37:45.523623+0000","last_fullsized":"2024-09-16T15:37:45.523623+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:10:16.347293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.526124+0000","last_change":"2024-09-16T15:37:44.523372+0000","last_active":"2024-09-16T15:37:45.526124+0000","last_peered":"2024-09-16T15:37:45.526124+0000","last_clean":"2024-09-16T15:37:45.526124+0000","last_became_active":"2024-09-16T15:37:44.522397+0000","last_became_peered":"2024-09-16T15:37:44.522397+0000","last_unstale":"2024-09-16T15:37:45.526124+0000","last_undegraded":"2024-09-16T15:37:45.526124+0000","last_fullsized":"2024-09-16T15:37:45.526124+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:32:42.496551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.156909+0000","last_change":"2024-09-16T15:37:43.517924+0000","last_active":"2024-09-16T15:37:47.156909+0000","last_peered":"2024-09-16T15:37:47.156909+0000","last_clean":"2024-09-16T15:37:47.156909+0000","last_became_active":"2024-09-16T15:37:43.516036+0000","last_became_peered":"2024-09-16T15:37:43.516036+0000","last_unstale":"2024-09-16T15:37:47.156909+0000","last_undegraded":"2024-09-16T15:37:47.156909+0000","last_fullsized":"2024-09-16T15:37:47.156909+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:48:05.099286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.523076+0000","last_change":"2024-09-16T15:37:44.527377+0000","last_active":"2024-09-16T15:37:45.523076+0000","last_peered":"2024-09-16T15:37:45.523076+0000","last_clean":"2024-09-16T15:37:45.523076+0000","last_became_active":"2024-09-16T15:37:44.527133+0000","last_became_peered":"2024-09-16T15:37:44.527133+0000","last_unstale":"2024-09-16T15:37:45.523076+0000","last_undegraded":"2024-09-16T15:37:45.523076+0000","last_fullsized":"2024-09-16T15:37:45.523076+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T23:21:37.513059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.525961+0000","last_change":"2024-09-16T15:37:43.518084+0000","last_active":"2024-09-16T15:37:45.525961+0000","last_peered":"2024-09-16T15:37:45.525961+0000","last_clean":"2024-09-16T15:37:45.525961+0000","last_became_active":"2024-09-16T15:37:43.517773+0000","last_became_peered":"2024-09-16T15:37:43.517773+0000","last_unstale":"2024-09-16T15:37:45.525961+0000","last_undegraded":"2024-09-16T15:37:45.525961+0000","last_fullsized":"2024-09-16T15:37:45.525961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:42:35.749344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.525550+0000","last_change":"2024-09-16T15:37:44.519969+0000","last_active":"2024-09-16T15:37:45.525550+0000","last_peered":"2024-09-16T15:37:45.525550+0000","last_clean":"2024-09-16T15:37:45.525550+0000","last_became_active":"2024-09-16T15:37:44.519683+0000","last_became_peered":"2024-09-16T15:37:44.519683+0000","last_unstale":"2024-09-16T15:37:45.525550+0000","last_undegraded":"2024-09-16T15:37:45.525550+0000","last_fullsized":"2024-09-16T15:37:45.525550+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:36:49.054590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.526487+0000","last_change":"2024-09-16T15:37:43.511936+0000","last_active":"2024-09-16T15:37:45.526487+0000","last_peered":"2024-09-16T15:37:45.526487+0000","last_clean":"2024-09-16T15:37:45.526487+0000","last_became_active":"2024-09-16T15:37:43.511709+0000","last_became_peered":"2024-09-16T15:37:43.511709+0000","last_unstale":"2024-09-16T15:37:45.526487+0000","last_undegraded":"2024-09-16T15:37:45.526487+0000","last_fullsized":"2024-09-16T15:37:45.526487+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:22:48.178297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:46.570568+0000","last_change":"2024-09-16T15:37:44.522219+0000","last_active":"2024-09-16T15:37:46.570568+0000","last_peered":"2024-09-16T15:37:46.570568+0000","last_clean":"2024-09-16T15:37:46.570568+0000","last_became_active":"2024-09-16T15:37:44.521913+0000","last_became_peered":"2024-09-16T15:37:44.521913+0000","last_unstale":"2024-09-16T15:37:46.570568+0000","last_undegraded":"2024-09-16T15:37:46.570568+0000","last_fullsized":"2024-09-16T15:37:46.570568+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:13:55.812269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.523265+0000","last_change":"2024-09-16T15:37:43.513406+0000","last_active":"2024-09-16T15:37:45.523265+0000","last_peered":"2024-09-16T15:37:45.523265+0000","last_clean":"2024-09-16T15:37:45.523265+0000","last_became_active":"2024-09-16T15:37:43.512994+0000","last_became_peered":"2024-09-16T15:37:43.512994+0000","last_unstale":"2024-09-16T15:37:45.523265+0000","last_undegraded":"2024-09-16T15:37:45.523265+0000","last_fullsized":"2024-09-16T15:37:45.523265+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:54:50.331139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.523228+0000","last_change":"2024-09-16T15:37:44.521192+0000","last_active":"2024-09-16T15:37:45.523228+0000","last_peered":"2024-09-16T15:37:45.523228+0000","last_clean":"2024-09-16T15:37:45.523228+0000","last_became_active":"2024-09-16T15:37:44.520988+0000","last_became_peered":"2024-09-16T15:37:44.520988+0000","last_unstale":"2024-09-16T15:37:45.523228+0000","last_undegraded":"2024-09-16T15:37:45.523228+0000","last_fullsized":"2024-09-16T15:37:45.523228+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:02:40.289746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.523437+0000","last_change":"2024-09-16T15:37:44.528502+0000","last_active":"2024-09-16T15:37:45.523437+0000","last_peered":"2024-09-16T15:37:45.523437+0000","last_clean":"2024-09-16T15:37:45.523437+0000","last_became_active":"2024-09-16T15:37:44.528265+0000","last_became_peered":"2024-09-16T15:37:44.528265+0000","last_unstale":"2024-09-16T15:37:45.523437+0000","last_undegraded":"2024-09-16T15:37:45.523437+0000","last_fullsized":"2024-09-16T15:37:45.523437+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:19:22.804930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.157531+0000","last_change":"2024-09-16T15:37:43.512302+0000","last_active":"2024-09-16T15:37:47.157531+0000","last_peered":"2024-09-16T15:37:47.157531+0000","last_clean":"2024-09-16T15:37:47.157531+0000","last_became_active":"2024-09-16T15:37:43.511884+0000","last_became_peered":"2024-09-16T15:37:43.511884+0000","last_unstale":"2024-09-16T15:37:47.157531+0000","last_undegraded":"2024-09-16T15:37:47.157531+0000","last_fullsized":"2024-09-16T15:37:47.157531+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:16:31.480042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.850781+0000","last_change":"2024-09-16T15:37:44.520291+0000","last_active":"2024-09-16T15:37:45.850781+0000","last_peered":"2024-09-16T15:37:45.850781+0000","last_clean":"2024-09-16T15:37:45.850781+0000","last_became_active":"2024-09-16T15:37:44.519962+0000","last_became_peered":"2024-09-16T15:37:44.519962+0000","last_unstale":"2024-09-16T15:37:45.850781+0000","last_undegraded":"2024-09-16T15:37:45.850781+0000","last_fullsized":"2024-09-16T15:37:45.850781+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:59:51.134263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.157381+0000","last_change":"2024-09-16T15:37:43.518058+0000","last_active":"2024-09-16T15:37:47.157381+0000","last_peered":"2024-09-16T15:37:47.157381+0000","last_clean":"2024-09-16T15:37:47.157381+0000","last_became_active":"2024-09-16T15:37:43.517743+0000","last_became_peered":"2024-09-16T15:37:43.517743+0000","last_unstale":"2024-09-16T15:37:47.157381+0000","last_undegraded":"2024-09-16T15:37:47.157381+0000","last_fullsized":"2024-09-16T15:37:47.157381+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:49:24.257772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.295758+0000","last_change":"2024-09-16T15:37:44.517004+0000","last_active":"2024-09-16T15:37:47.295758+0000","last_peered":"2024-09-16T15:37:47.295758+0000","last_clean":"2024-09-16T15:37:47.295758+0000","last_became_active":"2024-09-16T15:37:44.516403+0000","last_became_peered":"2024-09-16T15:37:44.516403+0000","last_unstale":"2024-09-16T15:37:47.295758+0000","last_undegraded":"2024-09-16T15:37:47.295758+0000","last_fullsized":"2024-09-16T15:37:47.295758+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:52:48.483425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.296053+0000","last_change":"2024-09-16T15:37:43.513164+0000","last_active":"2024-09-16T15:37:47.296053+0000","last_peered":"2024-09-16T15:37:47.296053+0000","last_clean":"2024-09-16T15:37:47.296053+0000","last_became_active":"2024-09-16T15:37:43.512890+0000","last_became_peered":"2024-09-16T15:37:43.512890+0000","last_unstale":"2024-09-16T15:37:47.296053+0000","last_undegraded":"2024-09-16T15:37:47.296053+0000","last_fullsized":"2024-09-16T15:37:47.296053+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:49:24.257772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:47.295838+0000","last_change":"2024-09-16T15:37:44.521379+0000","last_active":"2024-09-16T15:37:47.295838+0000","last_peered":"2024-09-16T15:37:47.295838+0000","last_clean":"2024-09-16T15:37:47.295838+0000","last_became_active":"2024-09-16T15:37:44.520724+0000","last_became_peered":"2024-09-16T15:37:44.520724+0000","last_unstale":"2024-09-16T15:37:47.295838+0000","last_undegraded":"2024-09-16T15:37:47.295838+0000","last_fullsized":"2024-09-16T15:37:47.295838+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:43.489547+0000","last_clean_scrub_stamp":"2024-09-16T15:37:43.489547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:40:14.841427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T15:37:45.526555+0000","last_change":"2024-09-16T15:37:43.515725+0000","last_active":"2024-09-16T15:37:45.526555+0000","last_peered":"2024-09-16T15:37:45.526555+0000","last_clean":"2024-09-16T15:37:45.526555+0000","last_became_active":"2024-09-16T15:37:43.515461+0000","last_became_peered":"2024-09-16T15:37:43.515461+0000","last_unstale":"2024-09-16T15:37:45.526555+0000","last_undegraded":"2024-09-16T15:37:45.526555+0000","last_fullsized":"2024-09-16T15:37:45.526555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:42.482667+0000","last_clean_scrub_stamp":"2024-09-16T15:37:42.482667+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T21:23:32.133055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509448,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":241664,"data_stored":81359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509448,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":835584,"data_stored":671695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509449,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":253952,"data_stored":83519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509449,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":237568,"data_stored":81817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509448,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":245760,"data_stored":82847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509449,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27840,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344000,"statfs":{"total":96636764160,"available":96608256000,"internally_reserved":0,"allocated":831488,"data_stored":671673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":241664,"data_stored":81291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":233472,"data_stored":81235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T15:37:57.760 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-16T15:37:57.760 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-16T15:37:57.760 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-16T15:37:57.761 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-16T15:37:57.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.896+0000 7f2441989640 1 -- 172.21.15.98:0/1547598641 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2424004800 msgr2=0x7f2424004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:57.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.896+0000 7f2441989640 1 --2- 172.21.15.98:0/1547598641 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2424004800 0x7f2424004c80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2430001690 tx=0x7f2424005830 comp rx=0 tx=0).stop 2024-09-16T15:37:57.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.896+0000 7f243b7fe640 1 -- 172.21.15.98:0/1547598641 reap_dead start 2024-09-16T15:37:57.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.896+0000 7f2441989640 1 -- 172.21.15.98:0/1547598641 shutdown_connections 2024-09-16T15:37:57.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.896+0000 7f2441989640 1 -- 172.21.15.98:0/1547598641 >> 172.21.15.98:0/1547598641 conn(0x7f243c0d3fe0 msgr2=0x7f243c0d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:57.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.896+0000 7f2441989640 1 -- 172.21.15.98:0/1547598641 shutdown_connections 2024-09-16T15:37:57.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.896+0000 7f2441989640 1 -- 172.21.15.98:0/1547598641 wait complete. 2024-09-16T15:37:57.902 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.897+0000 7f2441989640 1 Processor -- start 2024-09-16T15:37:57.902 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.898+0000 7f2441989640 1 -- start start 2024-09-16T15:37:57.902 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.898+0000 7f2441989640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2424004800 0x7f243c15b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:57.902 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.898+0000 7f2441989640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f243c0cd4c0 0x7f243c0cd940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:57.902 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.898+0000 7f2441989640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f243c1f8170 0x7f243c1f85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:57.902 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.898+0000 7f2441989640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f243c0b4ae0 con 0x7f243c1f8170 2024-09-16T15:37:57.902 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.898+0000 7f2441989640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f243c0d0cd0 con 0x7f243c0cd4c0 2024-09-16T15:37:57.902 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.898+0000 7f2441989640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f243c0b4c60 con 0x7f2424004800 2024-09-16T15:37:57.902 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.898+0000 7f243b7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f243c1f8170 0x7f243c1f85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:57.902 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.898+0000 7f243b7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f243c1f8170 0x7f243c1f85f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:32968/0 (socket says 172.21.15.98:32968) 2024-09-16T15:37:57.902 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.898+0000 7f243b7fe640 1 -- 172.21.15.98:0/2707386479 learned_addr learned my addr 172.21.15.98:0/2707386479 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:37:57.902 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.898+0000 7f243affd640 1 --2- 172.21.15.98:0/2707386479 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2424004800 0x7f243c15b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:57.903 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.899+0000 7f243b7fe640 1 -- 172.21.15.98:0/2707386479 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2424004800 msgr2=0x7f243c15b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:57.903 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.899+0000 7f243a7fc640 1 --2- 172.21.15.98:0/2707386479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f243c0cd4c0 0x7f243c0cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:57.903 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.899+0000 7f243b7fe640 1 --2- 172.21.15.98:0/2707386479 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2424004800 0x7f243c15b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:57.903 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.899+0000 7f243b7fe640 1 -- 172.21.15.98:0/2707386479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f243c0cd4c0 msgr2=0x7f243c0cd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:57.903 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.899+0000 7f243b7fe640 1 --2- 172.21.15.98:0/2707386479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f243c0cd4c0 0x7f243c0cd940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:57.903 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.899+0000 7f243b7fe640 1 -- 172.21.15.98:0/2707386479 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f243c1f8ea0 con 0x7f243c1f8170 2024-09-16T15:37:57.903 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.899+0000 7f243b7fe640 1 --2- 172.21.15.98:0/2707386479 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f243c1f8170 0x7f243c1f85f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f24240057e0 tx=0x7f24340039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:57.903 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.899+0000 7f2423fff640 1 -- 172.21.15.98:0/2707386479 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2434011840 con 0x7f243c1f8170 2024-09-16T15:37:57.903 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.899+0000 7f2423fff640 1 -- 172.21.15.98:0/2707386479 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2434018070 con 0x7f243c1f8170 2024-09-16T15:37:57.903 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.899+0000 7f2423fff640 1 -- 172.21.15.98:0/2707386479 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2434011c80 con 0x7f243c1f8170 2024-09-16T15:37:57.903 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.899+0000 7f2441989640 1 -- 172.21.15.98:0/2707386479 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f243c1f4db0 con 0x7f243c1f8170 2024-09-16T15:37:57.903 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.899+0000 7f2441989640 1 -- 172.21.15.98:0/2707386479 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f243c1f5370 con 0x7f243c1f8170 2024-09-16T15:37:57.903 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.900+0000 7f2441989640 1 -- 172.21.15.98:0/2707386479 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f243c0b9e30 con 0x7f243c1f8170 2024-09-16T15:37:57.904 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.900+0000 7f2423fff640 1 -- 172.21.15.98:0/2707386479 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7f243401d460 con 0x7f243c1f8170 2024-09-16T15:37:57.904 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.901+0000 7f2423fff640 1 --2- 172.21.15.98:0/2707386479 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f2428078880 0x7f242807ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:57.904 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.901+0000 7f2423fff640 1 -- 172.21.15.98:0/2707386479 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f243409b0b0 con 0x7f243c1f8170 2024-09-16T15:37:57.904 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.901+0000 7f243affd640 1 --2- 172.21.15.98:0/2707386479 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f2428078880 0x7f242807ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:57.904 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.902+0000 7f243affd640 1 --2- 172.21.15.98:0/2707386479 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f2428078880 0x7f242807ad40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f243c0cac70 tx=0x7f242c0094d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:57.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:57.905+0000 7f2423fff640 1 -- 172.21.15.98:0/2707386479 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7f243c0b9e30 con 0x7f243c1f8170 2024-09-16T15:37:58.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.117+0000 7f2441989640 1 -- 172.21.15.98:0/2707386479 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f243c1f5570 con 0x7f243c1f8170 2024-09-16T15:37:58.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.117+0000 7f2423fff640 1 -- 172.21.15.98:0/2707386479 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f243c1f5570 con 0x7f243c1f8170 2024-09-16T15:37:58.119 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:37:58.120 INFO:teuthology.orchestra.run.smithi098.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-16T15:37:58.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.120+0000 7f2441989640 1 -- 172.21.15.98:0/2707386479 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f2428078880 msgr2=0x7f242807ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:58.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.120+0000 7f2441989640 1 --2- 172.21.15.98:0/2707386479 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f2428078880 0x7f242807ad40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f243c0cac70 tx=0x7f242c0094d0 comp rx=0 tx=0).stop 2024-09-16T15:37:58.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.120+0000 7f2441989640 1 -- 172.21.15.98:0/2707386479 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f243c1f8170 msgr2=0x7f243c1f85f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:58.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.120+0000 7f2441989640 1 --2- 172.21.15.98:0/2707386479 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f243c1f8170 0x7f243c1f85f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f24240057e0 tx=0x7f24340039c0 comp rx=0 tx=0).stop 2024-09-16T15:37:58.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.120+0000 7f2441989640 1 -- 172.21.15.98:0/2707386479 shutdown_connections 2024-09-16T15:37:58.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.120+0000 7f2441989640 1 --2- 172.21.15.98:0/2707386479 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f243c1f8170 0x7f243c1f85f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:58.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.120+0000 7f2441989640 1 --2- 172.21.15.98:0/2707386479 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f2428078880 0x7f242807ad40 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:58.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.120+0000 7f2441989640 1 --2- 172.21.15.98:0/2707386479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f243c0cd4c0 0x7f243c0cd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:58.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.120+0000 7f2441989640 1 --2- 172.21.15.98:0/2707386479 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2424004800 0x7f243c15b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:58.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.120+0000 7f2441989640 1 -- 172.21.15.98:0/2707386479 >> 172.21.15.98:0/2707386479 conn(0x7f243c0d3fe0 msgr2=0x7f243c06ec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:58.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.120+0000 7f2441989640 1 -- 172.21.15.98:0/2707386479 shutdown_connections 2024-09-16T15:37:58.123 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.120+0000 7f2441989640 1 -- 172.21.15.98:0/2707386479 wait complete. 2024-09-16T15:37:58.133 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-16T15:37:58.133 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T15:37:58.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.233+0000 7fe45d5c6640 1 -- 172.21.15.98:0/3263214176 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe4440052e0 msgr2=0x7fe44400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:58.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.233+0000 7fe45d5c6640 1 --2- 172.21.15.98:0/3263214176 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe4440052e0 0x7fe44400b9c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe4580d1a40 tx=0x7fe444005830 comp rx=0 tx=0).stop 2024-09-16T15:37:58.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.233+0000 7fe45d5c6640 1 -- 172.21.15.98:0/3263214176 shutdown_connections 2024-09-16T15:37:58.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.233+0000 7fe45d5c6640 1 --2- 172.21.15.98:0/3263214176 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe4440052e0 0x7fe44400b9c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:58.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.233+0000 7fe45d5c6640 1 -- 172.21.15.98:0/3263214176 >> 172.21.15.98:0/3263214176 conn(0x7fe4580d3fe0 msgr2=0x7fe4580d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:58.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.233+0000 7fe45d5c6640 1 -- 172.21.15.98:0/3263214176 shutdown_connections 2024-09-16T15:37:58.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.233+0000 7fe45d5c6640 1 -- 172.21.15.98:0/3263214176 wait complete. 2024-09-16T15:37:58.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.234+0000 7fe45d5c6640 1 Processor -- start 2024-09-16T15:37:58.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.234+0000 7fe45d5c6640 1 -- start start 2024-09-16T15:37:58.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.235+0000 7fe45d5c6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe4440052e0 0x7fe4580c7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:58.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.235+0000 7fe45d5c6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4581537d0 0x7fe4581604f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:58.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.235+0000 7fe45d5c6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe458153090 0x7fe4580ca1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:58.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.235+0000 7fe45d5c6640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe4580d0e00 con 0x7fe4440052e0 2024-09-16T15:37:58.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.235+0000 7fe45d5c6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe4580d0c80 con 0x7fe4581537d0 2024-09-16T15:37:58.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.235+0000 7fe45d5c6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fe4580d0f80 con 0x7fe458153090 2024-09-16T15:37:58.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.235+0000 7fe456ffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe4440052e0 0x7fe4580c7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:58.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.235+0000 7fe456ffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe4440052e0 0x7fe4580c7af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:32986/0 (socket says 172.21.15.98:32986) 2024-09-16T15:37:58.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.235+0000 7fe456ffd640 1 -- 172.21.15.98:0/2219309351 learned_addr learned my addr 172.21.15.98:0/2219309351 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:37:58.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.235+0000 7fe4577fe640 1 --2- 172.21.15.98:0/2219309351 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe458153090 0x7fe4580ca1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:58.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.235+0000 7fe44ffff640 1 --2- 172.21.15.98:0/2219309351 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4581537d0 0x7fe4581604f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:58.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.235+0000 7fe456ffd640 1 -- 172.21.15.98:0/2219309351 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe458153090 msgr2=0x7fe4580ca1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:58.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.235+0000 7fe456ffd640 1 --2- 172.21.15.98:0/2219309351 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe458153090 0x7fe4580ca1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:58.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.235+0000 7fe456ffd640 1 -- 172.21.15.98:0/2219309351 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4581537d0 msgr2=0x7fe4581604f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:58.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.235+0000 7fe456ffd640 1 --2- 172.21.15.98:0/2219309351 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4581537d0 0x7fe4581604f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:58.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.235+0000 7fe456ffd640 1 -- 172.21.15.98:0/2219309351 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe458161820 con 0x7fe4440052e0 2024-09-16T15:37:58.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.236+0000 7fe456ffd640 1 --2- 172.21.15.98:0/2219309351 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe4440052e0 0x7fe4580c7af0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe448010aa0 tx=0x7fe448010f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:58.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.236+0000 7fe44f7fe640 1 -- 172.21.15.98:0/2219309351 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe44800edd0 con 0x7fe4440052e0 2024-09-16T15:37:58.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.236+0000 7fe44f7fe640 1 -- 172.21.15.98:0/2219309351 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe448015070 con 0x7fe4440052e0 2024-09-16T15:37:58.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.236+0000 7fe45d5c6640 1 -- 172.21.15.98:0/2219309351 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe458160b80 con 0x7fe4440052e0 2024-09-16T15:37:58.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.236+0000 7fe44f7fe640 1 -- 172.21.15.98:0/2219309351 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe44801a6b0 con 0x7fe4440052e0 2024-09-16T15:37:58.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.236+0000 7fe45d5c6640 1 -- 172.21.15.98:0/2219309351 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4580b15f0 con 0x7fe4440052e0 2024-09-16T15:37:58.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.237+0000 7fe45d5c6640 1 -- 172.21.15.98:0/2219309351 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe45815e4b0 con 0x7fe4440052e0 2024-09-16T15:37:58.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.237+0000 7fe44f7fe640 1 -- 172.21.15.98:0/2219309351 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7fe44801a850 con 0x7fe4440052e0 2024-09-16T15:37:58.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.238+0000 7fe44f7fe640 1 --2- 172.21.15.98:0/2219309351 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fe438078850 0x7fe43807ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:58.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.238+0000 7fe44f7fe640 1 -- 172.21.15.98:0/2219309351 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fe44809b570 con 0x7fe4440052e0 2024-09-16T15:37:58.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.238+0000 7fe44ffff640 1 --2- 172.21.15.98:0/2219309351 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fe438078850 0x7fe43807ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:58.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.238+0000 7fe44ffff640 1 --2- 172.21.15.98:0/2219309351 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fe438078850 0x7fe43807ad10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe440001010 tx=0x7fe4400067a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:58.244 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.242+0000 7fe44f7fe640 1 -- 172.21.15.98:0/2219309351 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7fe448063590 con 0x7fe4440052e0 2024-09-16T15:37:58.455 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.453+0000 7fe45d5c6640 1 -- 172.21.15.98:0/2219309351 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe4580b6680 con 0x7fe4440052e0 2024-09-16T15:37:58.455 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.454+0000 7fe44f7fe640 1 -- 172.21.15.98:0/2219309351 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5220 (secure 0 0 0) 0x7fe448067fc0 con 0x7fe4440052e0 2024-09-16T15:37:58.456 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:37:58.456 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":7,"btime":"2024-09-16T15:37:47:522910+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4348,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/808747266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":808747266},{"type":"v1","addr":"172.21.15.135:6836","nonce":808747266}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4351,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/1940037746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":1940037746},{"type":"v1","addr":"172.21.15.135:6837","nonce":1940037746}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4353,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6834/3679859923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":3679859923},{"type":"v1","addr":"172.21.15.98:6834","nonce":3679859923}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T15:37:43.891616+0000","modified":"2024-09-16T15:37:46.529306+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4356},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4356":{"gid":4356,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.98:6835/1824614871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6833","nonce":1824614871},{"type":"v1","addr":"172.21.15.98:6835","nonce":1824614871}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4356,"qdb_cluster":[4356]},"id":1}]} 2024-09-16T15:37:58.456 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 7 2024-09-16T15:37:58.458 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.456+0000 7fe45d5c6640 1 -- 172.21.15.98:0/2219309351 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fe438078850 msgr2=0x7fe43807ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:58.458 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.456+0000 7fe45d5c6640 1 --2- 172.21.15.98:0/2219309351 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fe438078850 0x7fe43807ad10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe440001010 tx=0x7fe4400067a0 comp rx=0 tx=0).stop 2024-09-16T15:37:58.458 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.456+0000 7fe45d5c6640 1 -- 172.21.15.98:0/2219309351 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe4440052e0 msgr2=0x7fe4580c7af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:58.458 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.456+0000 7fe45d5c6640 1 --2- 172.21.15.98:0/2219309351 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe4440052e0 0x7fe4580c7af0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe448010aa0 tx=0x7fe448010f60 comp rx=0 tx=0).stop 2024-09-16T15:37:58.458 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.456+0000 7fe45d5c6640 1 -- 172.21.15.98:0/2219309351 shutdown_connections 2024-09-16T15:37:58.458 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.456+0000 7fe45d5c6640 1 --2- 172.21.15.98:0/2219309351 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe458153090 0x7fe4580ca1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:58.458 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.456+0000 7fe45d5c6640 1 --2- 172.21.15.98:0/2219309351 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fe438078850 0x7fe43807ad10 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:58.458 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.456+0000 7fe45d5c6640 1 --2- 172.21.15.98:0/2219309351 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4581537d0 0x7fe4581604f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:58.458 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.456+0000 7fe45d5c6640 1 --2- 172.21.15.98:0/2219309351 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe4440052e0 0x7fe4580c7af0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:58.458 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.456+0000 7fe45d5c6640 1 -- 172.21.15.98:0/2219309351 >> 172.21.15.98:0/2219309351 conn(0x7fe4580d3fe0 msgr2=0x7fe4580b46f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:58.458 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.456+0000 7fe45d5c6640 1 -- 172.21.15.98:0/2219309351 shutdown_connections 2024-09-16T15:37:58.459 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.456+0000 7fe45d5c6640 1 -- 172.21.15.98:0/2219309351 wait complete. 2024-09-16T15:37:58.469 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T15:37:58.569 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.567+0000 7facf668c640 1 -- 172.21.15.98:0/1553575793 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7facf015f3d0 msgr2=0x7facf00d28a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:58.569 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.567+0000 7facf668c640 1 --2- 172.21.15.98:0/1553575793 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7facf015f3d0 0x7facf00d28a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7face0009830 tx=0x7face002a530 comp rx=0 tx=0).stop 2024-09-16T15:37:58.570 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.567+0000 7facf668c640 1 -- 172.21.15.98:0/1553575793 shutdown_connections 2024-09-16T15:37:58.570 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.567+0000 7facf668c640 1 --2- 172.21.15.98:0/1553575793 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7facf015f3d0 0x7facf00d28a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:58.570 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.567+0000 7facf668c640 1 -- 172.21.15.98:0/1553575793 >> 172.21.15.98:0/1553575793 conn(0x7facf00d1d80 msgr2=0x7facf00d2190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:58.570 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.567+0000 7facf668c640 1 -- 172.21.15.98:0/1553575793 shutdown_connections 2024-09-16T15:37:58.570 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.567+0000 7facf668c640 1 -- 172.21.15.98:0/1553575793 wait complete. 2024-09-16T15:37:58.570 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.568+0000 7facf668c640 1 Processor -- start 2024-09-16T15:37:58.570 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.569+0000 7facf668c640 1 -- start start 2024-09-16T15:37:58.572 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.569+0000 7facf668c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7facf00c6d10 0x7facf00b5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:58.573 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.569+0000 7facf668c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facf00cc870 0x7facf01f31d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:58.573 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.569+0000 7facf668c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7facf015f3d0 0x7facf009e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:58.573 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.569+0000 7facf668c640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7facf00c7850 con 0x7facf015f3d0 2024-09-16T15:37:58.573 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.569+0000 7facf668c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7facf00d0c30 con 0x7facf00cc870 2024-09-16T15:37:58.573 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.569+0000 7facf668c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7facf00c79d0 con 0x7facf00c6d10 2024-09-16T15:37:58.573 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.569+0000 7facf4c29640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7facf015f3d0 0x7facf009e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:58.573 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.570+0000 7facf4c29640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7facf015f3d0 0x7facf009e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:33006/0 (socket says 172.21.15.98:33006) 2024-09-16T15:37:58.573 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.570+0000 7facf4c29640 1 -- 172.21.15.98:0/604507190 learned_addr learned my addr 172.21.15.98:0/604507190 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:37:58.573 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.570+0000 7faceffff640 1 --2- 172.21.15.98:0/604507190 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7facf00c6d10 0x7facf00b5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:58.573 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.570+0000 7facef7fe640 1 --2- 172.21.15.98:0/604507190 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facf00cc870 0x7facf01f31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:58.573 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.570+0000 7facf4c29640 1 -- 172.21.15.98:0/604507190 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7facf00c6d10 msgr2=0x7facf00b5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:58.573 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.570+0000 7facf4c29640 1 --2- 172.21.15.98:0/604507190 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7facf00c6d10 0x7facf00b5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:58.573 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.570+0000 7facf4c29640 1 -- 172.21.15.98:0/604507190 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facf00cc870 msgr2=0x7facf01f31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:58.574 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.570+0000 7facf4c29640 1 --2- 172.21.15.98:0/604507190 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facf00cc870 0x7facf01f31d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:58.574 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.570+0000 7facf4c29640 1 -- 172.21.15.98:0/604507190 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facf00b63f0 con 0x7facf015f3d0 2024-09-16T15:37:58.574 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.570+0000 7faceffff640 1 --2- 172.21.15.98:0/604507190 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7facf00c6d10 0x7facf00b5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T15:37:58.574 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.570+0000 7facef7fe640 1 --2- 172.21.15.98:0/604507190 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facf00cc870 0x7facf01f31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T15:37:58.574 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.570+0000 7facf4c29640 1 --2- 172.21.15.98:0/604507190 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7facf015f3d0 0x7facf009e450 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7face800c7d0 tx=0x7face800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:58.574 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.570+0000 7facecff9640 1 -- 172.21.15.98:0/604507190 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face8003b70 con 0x7facf015f3d0 2024-09-16T15:37:58.574 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.570+0000 7facecff9640 1 -- 172.21.15.98:0/604507190 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7face8003d10 con 0x7facf015f3d0 2024-09-16T15:37:58.574 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.570+0000 7facf668c640 1 -- 172.21.15.98:0/604507190 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facf00b66d0 con 0x7facf015f3d0 2024-09-16T15:37:58.574 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.570+0000 7facecff9640 1 -- 172.21.15.98:0/604507190 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face800aab0 con 0x7facf015f3d0 2024-09-16T15:37:58.574 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.570+0000 7facf668c640 1 -- 172.21.15.98:0/604507190 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facf00b6c90 con 0x7facf015f3d0 2024-09-16T15:37:58.575 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.571+0000 7facf668c640 1 -- 172.21.15.98:0/604507190 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facf00cd050 con 0x7facf015f3d0 2024-09-16T15:37:58.575 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.572+0000 7facecff9640 1 -- 172.21.15.98:0/604507190 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7face800ac50 con 0x7facf015f3d0 2024-09-16T15:37:58.575 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.572+0000 7facecff9640 1 --2- 172.21.15.98:0/604507190 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7facdc078850 0x7facdc07ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:58.575 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.573+0000 7facecff9640 1 -- 172.21.15.98:0/604507190 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7face809a820 con 0x7facf015f3d0 2024-09-16T15:37:58.575 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.573+0000 7faceffff640 1 --2- 172.21.15.98:0/604507190 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7facdc078850 0x7facdc07ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:58.575 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.573+0000 7faceffff640 1 --2- 172.21.15.98:0/604507190 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7facdc078850 0x7facdc07ad10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7face0034000 tx=0x7face0004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:58.578 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.577+0000 7facecff9640 1 -- 172.21.15.98:0/604507190 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7facf00cd050 con 0x7facf015f3d0 2024-09-16T15:37:58.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.790+0000 7facf668c640 1 -- 172.21.15.98:0/604507190 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7facf0072780 con 0x7facf015f3d0 2024-09-16T15:37:58.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.790+0000 7facecff9640 1 -- 172.21.15.98:0/604507190 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5220 (secure 0 0 0) 0x7facf0072780 con 0x7facf015f3d0 2024-09-16T15:37:58.793 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:37:58.793 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":7,"btime":"2024-09-16T15:37:47:522910+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4348,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/808747266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":808747266},{"type":"v1","addr":"172.21.15.135:6836","nonce":808747266}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4351,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/1940037746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":1940037746},{"type":"v1","addr":"172.21.15.135:6837","nonce":1940037746}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4353,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6834/3679859923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":3679859923},{"type":"v1","addr":"172.21.15.98:6834","nonce":3679859923}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T15:37:43.891616+0000","modified":"2024-09-16T15:37:46.529306+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4356},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4356":{"gid":4356,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.98:6835/1824614871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6833","nonce":1824614871},{"type":"v1","addr":"172.21.15.98:6835","nonce":1824614871}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4356,"qdb_cluster":[4356]},"id":1}]} 2024-09-16T15:37:58.793 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 7 2024-09-16T15:37:58.795 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.793+0000 7facf668c640 1 -- 172.21.15.98:0/604507190 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7facdc078850 msgr2=0x7facdc07ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:58.795 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.793+0000 7facf668c640 1 --2- 172.21.15.98:0/604507190 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7facdc078850 0x7facdc07ad10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7face0034000 tx=0x7face0004730 comp rx=0 tx=0).stop 2024-09-16T15:37:58.795 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.793+0000 7facf668c640 1 -- 172.21.15.98:0/604507190 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7facf015f3d0 msgr2=0x7facf009e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:58.795 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.793+0000 7facf668c640 1 --2- 172.21.15.98:0/604507190 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7facf015f3d0 0x7facf009e450 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7face800c7d0 tx=0x7face800cc90 comp rx=0 tx=0).stop 2024-09-16T15:37:58.795 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.793+0000 7facf668c640 1 -- 172.21.15.98:0/604507190 shutdown_connections 2024-09-16T15:37:58.796 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.793+0000 7facf668c640 1 --2- 172.21.15.98:0/604507190 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7facf015f3d0 0x7facf009e450 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:58.796 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.793+0000 7facf668c640 1 --2- 172.21.15.98:0/604507190 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7facdc078850 0x7facdc07ad10 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:58.796 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.793+0000 7facf668c640 1 --2- 172.21.15.98:0/604507190 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facf00cc870 0x7facf01f31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:58.796 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.793+0000 7facf668c640 1 --2- 172.21.15.98:0/604507190 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7facf00c6d10 0x7facf00b5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:58.796 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.793+0000 7facf668c640 1 -- 172.21.15.98:0/604507190 >> 172.21.15.98:0/604507190 conn(0x7facf00d1d80 msgr2=0x7facf015cc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:58.796 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.793+0000 7facf668c640 1 -- 172.21.15.98:0/604507190 shutdown_connections 2024-09-16T15:37:58.796 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.793+0000 7facf668c640 1 -- 172.21.15.98:0/604507190 wait complete. 2024-09-16T15:37:58.805 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T15:37:58.906 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.904+0000 7fc79a8c6640 1 -- 172.21.15.98:0/2248617805 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7941445d0 msgr2=0x7fc7940cebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:58.906 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.904+0000 7fc79a8c6640 1 --2- 172.21.15.98:0/2248617805 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7941445d0 0x7fc7940cebf0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc784009830 tx=0x7fc78402a5f0 comp rx=0 tx=0).stop 2024-09-16T15:37:58.906 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.904+0000 7fc79a8c6640 1 -- 172.21.15.98:0/2248617805 shutdown_connections 2024-09-16T15:37:58.906 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.904+0000 7fc79a8c6640 1 --2- 172.21.15.98:0/2248617805 >> v2:172.21.15.135:3300/0 conn(0x7fc7940b4ca0 0x7fc7940cf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:58.906 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.904+0000 7fc79a8c6640 1 --2- 172.21.15.98:0/2248617805 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7941445d0 0x7fc7940cebf0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:58.906 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.904+0000 7fc79a8c6640 1 -- 172.21.15.98:0/2248617805 >> 172.21.15.98:0/2248617805 conn(0x7fc7940b1950 msgr2=0x7fc7940b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:58.906 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.904+0000 7fc79a8c6640 1 -- 172.21.15.98:0/2248617805 shutdown_connections 2024-09-16T15:37:58.906 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.904+0000 7fc79a8c6640 1 -- 172.21.15.98:0/2248617805 wait complete. 2024-09-16T15:37:58.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.905+0000 7fc79a8c6640 1 Processor -- start 2024-09-16T15:37:58.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.905+0000 7fc79a8c6640 1 -- start start 2024-09-16T15:37:58.909 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.906+0000 7fc79a8c6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7940b4ca0 0x7fc794139240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:58.910 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.906+0000 7fc79a8c6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7940ccfd0 0x7fc79415b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:58.910 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.906+0000 7fc79a8c6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc7941445d0 0x7fc79415bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:58.910 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.906+0000 7fc79a8c6640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc79415f080 con 0x7fc7940b4ca0 2024-09-16T15:37:58.910 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.906+0000 7fc79a8c6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc794073bc0 con 0x7fc7940ccfd0 2024-09-16T15:37:58.910 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.906+0000 7fc79a8c6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fc79415f200 con 0x7fc7941445d0 2024-09-16T15:37:58.910 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.906+0000 7fc793fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7940b4ca0 0x7fc794139240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:58.910 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.906+0000 7fc793fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7940b4ca0 0x7fc794139240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:33012/0 (socket says 172.21.15.98:33012) 2024-09-16T15:37:58.910 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.906+0000 7fc793fff640 1 -- 172.21.15.98:0/3799032605 learned_addr learned my addr 172.21.15.98:0/3799032605 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:37:58.910 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.906+0000 7fc7937fe640 1 --2- 172.21.15.98:0/3799032605 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7940ccfd0 0x7fc79415b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:58.910 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.906+0000 7fc798e63640 1 --2- 172.21.15.98:0/3799032605 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc7941445d0 0x7fc79415bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:58.911 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.906+0000 7fc793fff640 1 -- 172.21.15.98:0/3799032605 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc7941445d0 msgr2=0x7fc79415bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:58.911 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.906+0000 7fc793fff640 1 --2- 172.21.15.98:0/3799032605 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc7941445d0 0x7fc79415bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:58.911 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.906+0000 7fc793fff640 1 -- 172.21.15.98:0/3799032605 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7940ccfd0 msgr2=0x7fc79415b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:58.911 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.906+0000 7fc793fff640 1 --2- 172.21.15.98:0/3799032605 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7940ccfd0 0x7fc79415b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:58.911 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.906+0000 7fc793fff640 1 -- 172.21.15.98:0/3799032605 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc794139780 con 0x7fc7940b4ca0 2024-09-16T15:37:58.911 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.906+0000 7fc798e63640 1 --2- 172.21.15.98:0/3799032605 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc7941445d0 0x7fc79415bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T15:37:58.911 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.906+0000 7fc793fff640 1 --2- 172.21.15.98:0/3799032605 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7940b4ca0 0x7fc794139240 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc784000c00 tx=0x7fc784033c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:58.911 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.907+0000 7fc790ff9640 1 -- 172.21.15.98:0/3799032605 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc784005c90 con 0x7fc7940b4ca0 2024-09-16T15:37:58.911 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.907+0000 7fc790ff9640 1 -- 172.21.15.98:0/3799032605 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc784031e50 con 0x7fc7940b4ca0 2024-09-16T15:37:58.911 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.907+0000 7fc79a8c6640 1 -- 172.21.15.98:0/3799032605 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc79415da40 con 0x7fc7940b4ca0 2024-09-16T15:37:58.911 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.907+0000 7fc790ff9640 1 -- 172.21.15.98:0/3799032605 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7840332f0 con 0x7fc7940b4ca0 2024-09-16T15:37:58.911 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.907+0000 7fc79a8c6640 1 -- 172.21.15.98:0/3799032605 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc79415e000 con 0x7fc7940b4ca0 2024-09-16T15:37:58.911 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.908+0000 7fc79a8c6640 1 -- 172.21.15.98:0/3799032605 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc79415f720 con 0x7fc7940b4ca0 2024-09-16T15:37:58.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.908+0000 7fc790ff9640 1 -- 172.21.15.98:0/3799032605 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7fc784033490 con 0x7fc7940b4ca0 2024-09-16T15:37:58.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.909+0000 7fc790ff9640 1 --2- 172.21.15.98:0/3799032605 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fc780078850 0x7fc78007ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:58.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.909+0000 7fc790ff9640 1 -- 172.21.15.98:0/3799032605 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fc7840bbc80 con 0x7fc7940b4ca0 2024-09-16T15:37:58.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.909+0000 7fc7937fe640 1 --2- 172.21.15.98:0/3799032605 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fc780078850 0x7fc78007ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:58.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.909+0000 7fc7937fe640 1 --2- 172.21.15.98:0/3799032605 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fc780078850 0x7fc78007ad10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc79413ceb0 tx=0x7fc788007e90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:58.915 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:58.913+0000 7fc790ff9640 1 -- 172.21.15.98:0/3799032605 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7fc794139780 con 0x7fc7940b4ca0 2024-09-16T15:37:59.097 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.095+0000 7fc79a8c6640 1 -- 172.21.15.98:0/3799032605 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc794070a20 con 0x7fc7940b4ca0 2024-09-16T15:37:59.097 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.096+0000 7fc790ff9640 1 -- 172.21.15.98:0/3799032605 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16681 (secure 0 0 0) 0x7fc78403f030 con 0x7fc7940b4ca0 2024-09-16T15:37:59.098 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:37:59.098 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":23,"fsid":"52a38a45-21d2-4cb0-bb3a-4fb8be3a08df","created":"2024-09-16T15:37:20.387654+0000","modified":"2024-09-16T15:37:45.512714+0000","last_up_change":"2024-09-16T15:37:33.417470+0000","last_in_change":"2024-09-16T15:37:23.430578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T15:37:34.725090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-16T15:37:42.223874+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-16T15:37:42.808291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a2d61df4-2577-47e6-a4ac-c36bbb85ab8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1967099790},{"type":"v1","addr":"172.21.15.98:6825","nonce":1967099790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1967099790},{"type":"v1","addr":"172.21.15.98:6827","nonce":1967099790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":1967099790},{"type":"v1","addr":"172.21.15.98:6831","nonce":1967099790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1967099790},{"type":"v1","addr":"172.21.15.98:6829","nonce":1967099790}]},"public_addr":"172.21.15.98:6825/1967099790","cluster_addr":"172.21.15.98:6827/1967099790","heartbeat_back_addr":"172.21.15.98:6831/1967099790","heartbeat_front_addr":"172.21.15.98:6829/1967099790","state":["exists","up"]},{"osd":1,"uuid":"bb3a68a5-c22f-442b-b292-7c272fe01ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":3571460482},{"type":"v1","addr":"172.21.15.98:6809","nonce":3571460482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":3571460482},{"type":"v1","addr":"172.21.15.98:6811","nonce":3571460482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":3571460482},{"type":"v1","addr":"172.21.15.98:6815","nonce":3571460482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":3571460482},{"type":"v1","addr":"172.21.15.98:6813","nonce":3571460482}]},"public_addr":"172.21.15.98:6809/3571460482","cluster_addr":"172.21.15.98:6811/3571460482","heartbeat_back_addr":"172.21.15.98:6815/3571460482","heartbeat_front_addr":"172.21.15.98:6813/3571460482","state":["exists","up"]},{"osd":2,"uuid":"c8429195-a480-409b-8e5f-8dc4c6abc0a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":2573210695},{"type":"v1","addr":"172.21.15.98:6801","nonce":2573210695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":2573210695},{"type":"v1","addr":"172.21.15.98:6803","nonce":2573210695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":2573210695},{"type":"v1","addr":"172.21.15.98:6807","nonce":2573210695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":2573210695},{"type":"v1","addr":"172.21.15.98:6805","nonce":2573210695}]},"public_addr":"172.21.15.98:6801/2573210695","cluster_addr":"172.21.15.98:6803/2573210695","heartbeat_back_addr":"172.21.15.98:6807/2573210695","heartbeat_front_addr":"172.21.15.98:6805/2573210695","state":["exists","up"]},{"osd":3,"uuid":"0e800d7b-096f-4f65-b3cc-c7cda3870de4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":3951374837},{"type":"v1","addr":"172.21.15.98:6817","nonce":3951374837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":3951374837},{"type":"v1","addr":"172.21.15.98:6819","nonce":3951374837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":3951374837},{"type":"v1","addr":"172.21.15.98:6823","nonce":3951374837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":3951374837},{"type":"v1","addr":"172.21.15.98:6821","nonce":3951374837}]},"public_addr":"172.21.15.98:6817/3951374837","cluster_addr":"172.21.15.98:6819/3951374837","heartbeat_back_addr":"172.21.15.98:6823/3951374837","heartbeat_front_addr":"172.21.15.98:6821/3951374837","state":["exists","up"]},{"osd":4,"uuid":"c7822e9b-8e29-48d9-b92a-e8f9c7bc5247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":724302036},{"type":"v1","addr":"172.21.15.135:6811","nonce":724302036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":724302036},{"type":"v1","addr":"172.21.15.135:6813","nonce":724302036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":724302036},{"type":"v1","addr":"172.21.15.135:6817","nonce":724302036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":724302036},{"type":"v1","addr":"172.21.15.135:6815","nonce":724302036}]},"public_addr":"172.21.15.135:6811/724302036","cluster_addr":"172.21.15.135:6813/724302036","heartbeat_back_addr":"172.21.15.135:6817/724302036","heartbeat_front_addr":"172.21.15.135:6815/724302036","state":["exists","up"]},{"osd":5,"uuid":"35805e02-484a-4404-a78f-aa44f4daa41f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3083482635},{"type":"v1","addr":"172.21.15.135:6803","nonce":3083482635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3083482635},{"type":"v1","addr":"172.21.15.135:6805","nonce":3083482635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3083482635},{"type":"v1","addr":"172.21.15.135:6809","nonce":3083482635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3083482635},{"type":"v1","addr":"172.21.15.135:6807","nonce":3083482635}]},"public_addr":"172.21.15.135:6803/3083482635","cluster_addr":"172.21.15.135:6805/3083482635","heartbeat_back_addr":"172.21.15.135:6809/3083482635","heartbeat_front_addr":"172.21.15.135:6807/3083482635","state":["exists","up"]},{"osd":6,"uuid":"6327ba84-aaeb-41fa-9717-188988ff2c4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3376376340},{"type":"v1","addr":"172.21.15.135:6819","nonce":3376376340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3376376340},{"type":"v1","addr":"172.21.15.135:6821","nonce":3376376340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":3376376340},{"type":"v1","addr":"172.21.15.135:6825","nonce":3376376340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3376376340},{"type":"v1","addr":"172.21.15.135:6823","nonce":3376376340}]},"public_addr":"172.21.15.135:6819/3376376340","cluster_addr":"172.21.15.135:6821/3376376340","heartbeat_back_addr":"172.21.15.135:6825/3376376340","heartbeat_front_addr":"172.21.15.135:6823/3376376340","state":["exists","up"]},{"osd":7,"uuid":"392d0958-dff9-4248-b3d8-a1201c10f354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2559837727},{"type":"v1","addr":"172.21.15.135:6827","nonce":2559837727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2559837727},{"type":"v1","addr":"172.21.15.135:6829","nonce":2559837727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":2559837727},{"type":"v1","addr":"172.21.15.135:6833","nonce":2559837727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2559837727},{"type":"v1","addr":"172.21.15.135:6831","nonce":2559837727}]},"public_addr":"172.21.15.135:6827/2559837727","cluster_addr":"172.21.15.135:6829/2559837727","heartbeat_back_addr":"172.21.15.135:6833/2559837727","heartbeat_front_addr":"172.21.15.135:6831/2559837727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.939904+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.717296+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.785817+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:30.211718+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.973359+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:30.250109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.699327+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:30.173063+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T15:37:59.100 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.098+0000 7fc79a8c6640 1 -- 172.21.15.98:0/3799032605 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fc780078850 msgr2=0x7fc78007ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:59.101 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.098+0000 7fc79a8c6640 1 --2- 172.21.15.98:0/3799032605 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fc780078850 0x7fc78007ad10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc79413ceb0 tx=0x7fc788007e90 comp rx=0 tx=0).stop 2024-09-16T15:37:59.101 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.098+0000 7fc79a8c6640 1 -- 172.21.15.98:0/3799032605 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7940b4ca0 msgr2=0x7fc794139240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:59.101 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.098+0000 7fc79a8c6640 1 --2- 172.21.15.98:0/3799032605 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7940b4ca0 0x7fc794139240 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc784000c00 tx=0x7fc784033c90 comp rx=0 tx=0).stop 2024-09-16T15:37:59.101 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.098+0000 7fc79a8c6640 1 -- 172.21.15.98:0/3799032605 shutdown_connections 2024-09-16T15:37:59.101 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.098+0000 7fc79a8c6640 1 --2- 172.21.15.98:0/3799032605 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc7941445d0 0x7fc79415bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:59.101 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.098+0000 7fc79a8c6640 1 --2- 172.21.15.98:0/3799032605 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fc780078850 0x7fc78007ad10 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:59.101 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.098+0000 7fc79a8c6640 1 --2- 172.21.15.98:0/3799032605 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7940ccfd0 0x7fc79415b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:59.101 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.098+0000 7fc79a8c6640 1 --2- 172.21.15.98:0/3799032605 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7940b4ca0 0x7fc794139240 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:59.101 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.098+0000 7fc79a8c6640 1 -- 172.21.15.98:0/3799032605 >> 172.21.15.98:0/3799032605 conn(0x7fc7940b1950 msgr2=0x7fc7940acd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:59.101 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.098+0000 7fc79a8c6640 1 -- 172.21.15.98:0/3799032605 shutdown_connections 2024-09-16T15:37:59.101 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.098+0000 7fc79a8c6640 1 -- 172.21.15.98:0/3799032605 wait complete. 2024-09-16T15:37:59.111 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T15:37:59.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.209+0000 7fd98812b640 1 -- 172.21.15.98:0/2185385591 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd980154ea0 msgr2=0x7fd9800cfc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:59.212 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.209+0000 7fd98812b640 1 --2- 172.21.15.98:0/2185385591 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd980154ea0 0x7fd9800cfc20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd97c005fd0 tx=0x7fd97c02a5c0 comp rx=0 tx=0).stop 2024-09-16T15:37:59.212 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.209+0000 7fd98812b640 1 -- 172.21.15.98:0/2185385591 shutdown_connections 2024-09-16T15:37:59.212 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.209+0000 7fd98812b640 1 --2- 172.21.15.98:0/2185385591 >> v2:172.21.15.135:3300/0 conn(0x7fd980155280 0x7fd9800cd6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:59.212 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.209+0000 7fd98812b640 1 --2- 172.21.15.98:0/2185385591 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd980154ea0 0x7fd9800cfc20 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:59.212 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.209+0000 7fd98812b640 1 -- 172.21.15.98:0/2185385591 >> 172.21.15.98:0/2185385591 conn(0x7fd98006d230 msgr2=0x7fd9800688b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:59.212 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.209+0000 7fd98812b640 1 -- 172.21.15.98:0/2185385591 shutdown_connections 2024-09-16T15:37:59.212 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.209+0000 7fd98812b640 1 -- 172.21.15.98:0/2185385591 wait complete. 2024-09-16T15:37:59.213 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.211+0000 7fd98812b640 1 Processor -- start 2024-09-16T15:37:59.213 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.211+0000 7fd98812b640 1 -- start start 2024-09-16T15:37:59.215 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.211+0000 7fd98812b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9800cdbf0 0x7fd9800c7d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:59.215 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.211+0000 7fd98812b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd980154ea0 0x7fd9800b4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:59.215 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.211+0000 7fd98812b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd980155280 0x7fd9801f8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:59.215 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.211+0000 7fd98812b640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd98006de00 con 0x7fd980154ea0 2024-09-16T15:37:59.215 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.211+0000 7fd98812b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd98006dc80 con 0x7fd980155280 2024-09-16T15:37:59.215 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.211+0000 7fd98812b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fd9800cf0c0 con 0x7fd9800cdbf0 2024-09-16T15:37:59.215 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.211+0000 7fd9856c6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd980154ea0 0x7fd9800b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:59.215 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.212+0000 7fd9856c6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd980154ea0 0x7fd9800b4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:33022/0 (socket says 172.21.15.98:33022) 2024-09-16T15:37:59.215 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.212+0000 7fd9856c6640 1 -- 172.21.15.98:0/636255522 learned_addr learned my addr 172.21.15.98:0/636255522 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:37:59.215 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.212+0000 7fd985ec7640 1 --2- 172.21.15.98:0/636255522 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9800cdbf0 0x7fd9800c7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:59.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.212+0000 7fd9866c8640 1 --2- 172.21.15.98:0/636255522 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd980155280 0x7fd9801f8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:59.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.212+0000 7fd9856c6640 1 -- 172.21.15.98:0/636255522 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9800cdbf0 msgr2=0x7fd9800c7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:59.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.212+0000 7fd9856c6640 1 --2- 172.21.15.98:0/636255522 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9800cdbf0 0x7fd9800c7d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:59.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.212+0000 7fd9856c6640 1 -- 172.21.15.98:0/636255522 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd980155280 msgr2=0x7fd9801f8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:59.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.212+0000 7fd9856c6640 1 --2- 172.21.15.98:0/636255522 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd980155280 0x7fd9801f8350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:59.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.212+0000 7fd9856c6640 1 -- 172.21.15.98:0/636255522 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9800c6ca0 con 0x7fd980154ea0 2024-09-16T15:37:59.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.212+0000 7fd9866c8640 1 --2- 172.21.15.98:0/636255522 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd980155280 0x7fd9801f8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T15:37:59.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.212+0000 7fd9856c6640 1 --2- 172.21.15.98:0/636255522 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd980154ea0 0x7fd9800b4450 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd97000e9f0 tx=0x7fd97000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:59.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.212+0000 7fd9767fc640 1 -- 172.21.15.98:0/636255522 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd97000cd80 con 0x7fd980154ea0 2024-09-16T15:37:59.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.212+0000 7fd9767fc640 1 -- 172.21.15.98:0/636255522 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd970004020 con 0x7fd980154ea0 2024-09-16T15:37:59.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.212+0000 7fd98812b640 1 -- 172.21.15.98:0/636255522 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9800c6f80 con 0x7fd980154ea0 2024-09-16T15:37:59.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.212+0000 7fd9767fc640 1 -- 172.21.15.98:0/636255522 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd970004470 con 0x7fd980154ea0 2024-09-16T15:37:59.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.212+0000 7fd98812b640 1 -- 172.21.15.98:0/636255522 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9800c7540 con 0x7fd980154ea0 2024-09-16T15:37:59.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.213+0000 7fd98812b640 1 -- 172.21.15.98:0/636255522 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9800ce2c0 con 0x7fd980154ea0 2024-09-16T15:37:59.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.214+0000 7fd9767fc640 1 -- 172.21.15.98:0/636255522 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7fd9700035f0 con 0x7fd980154ea0 2024-09-16T15:37:59.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.214+0000 7fd9767fc640 1 --2- 172.21.15.98:0/636255522 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fd964078850 0x7fd96407ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:59.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.214+0000 7fd9767fc640 1 -- 172.21.15.98:0/636255522 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fd97009b380 con 0x7fd980154ea0 2024-09-16T15:37:59.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.215+0000 7fd985ec7640 1 --2- 172.21.15.98:0/636255522 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fd964078850 0x7fd96407ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:59.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.215+0000 7fd985ec7640 1 --2- 172.21.15.98:0/636255522 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fd964078850 0x7fd96407ad10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd97c005fd0 tx=0x7fd97c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:59.220 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.218+0000 7fd9767fc640 1 -- 172.21.15.98:0/636255522 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7fd9800ce2c0 con 0x7fd980154ea0 2024-09-16T15:37:59.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.430+0000 7fd98812b640 1 -- 172.21.15.98:0/636255522 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd9800cf5b0 con 0x7fd980154ea0 2024-09-16T15:37:59.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.431+0000 7fd9767fc640 1 -- 172.21.15.98:0/636255522 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5220 (secure 0 0 0) 0x7fd9700639f0 con 0x7fd980154ea0 2024-09-16T15:37:59.433 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:37:59.433 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":7,"btime":"2024-09-16T15:37:47:522910+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4348,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/808747266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":808747266},{"type":"v1","addr":"172.21.15.135:6836","nonce":808747266}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4351,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/1940037746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":1940037746},{"type":"v1","addr":"172.21.15.135:6837","nonce":1940037746}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4353,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6834/3679859923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":3679859923},{"type":"v1","addr":"172.21.15.98:6834","nonce":3679859923}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T15:37:43.891616+0000","modified":"2024-09-16T15:37:46.529306+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4356},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4356":{"gid":4356,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.98:6835/1824614871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6833","nonce":1824614871},{"type":"v1","addr":"172.21.15.98:6835","nonce":1824614871}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4356,"qdb_cluster":[4356]},"id":1}]} 2024-09-16T15:37:59.433 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 7 2024-09-16T15:37:59.435 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.433+0000 7fd98812b640 1 -- 172.21.15.98:0/636255522 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fd964078850 msgr2=0x7fd96407ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:59.435 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.433+0000 7fd98812b640 1 --2- 172.21.15.98:0/636255522 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fd964078850 0x7fd96407ad10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd97c005fd0 tx=0x7fd97c004730 comp rx=0 tx=0).stop 2024-09-16T15:37:59.435 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.433+0000 7fd98812b640 1 -- 172.21.15.98:0/636255522 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd980154ea0 msgr2=0x7fd9800b4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:59.435 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.433+0000 7fd98812b640 1 --2- 172.21.15.98:0/636255522 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd980154ea0 0x7fd9800b4450 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd97000e9f0 tx=0x7fd97000eeb0 comp rx=0 tx=0).stop 2024-09-16T15:37:59.436 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.433+0000 7fd98812b640 1 -- 172.21.15.98:0/636255522 shutdown_connections 2024-09-16T15:37:59.436 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.433+0000 7fd98812b640 1 --2- 172.21.15.98:0/636255522 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fd964078850 0x7fd96407ad10 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:59.436 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.433+0000 7fd98812b640 1 --2- 172.21.15.98:0/636255522 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd980155280 0x7fd9801f8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:59.436 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.433+0000 7fd98812b640 1 --2- 172.21.15.98:0/636255522 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd980154ea0 0x7fd9800b4450 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:59.436 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.433+0000 7fd98812b640 1 --2- 172.21.15.98:0/636255522 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9800cdbf0 0x7fd9800c7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:59.436 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.433+0000 7fd98812b640 1 -- 172.21.15.98:0/636255522 >> 172.21.15.98:0/636255522 conn(0x7fd98006d230 msgr2=0x7fd9800688b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:59.436 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.433+0000 7fd98812b640 1 -- 172.21.15.98:0/636255522 shutdown_connections 2024-09-16T15:37:59.436 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.433+0000 7fd98812b640 1 -- 172.21.15.98:0/636255522 wait complete. 2024-09-16T15:37:59.848 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-16T15:37:43.891616+0000', 'modified': '2024-09-16T15:37:46.529306+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4356}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4356': {'gid': 4356, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.98:6835/1824614871', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6833', 'nonce': 1824614871}, {'type': 'v1', 'addr': '172.21.15.98:6835', 'nonce': 1824614871}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4356, 'qdb_cluster': [4356]} 2024-09-16T15:37:59.848 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-16T15:37:59.848 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-16T15:37:59.952 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.949+0000 7f41a87e8640 1 -- 172.21.15.98:0/3765424063 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41a00d2050 msgr2=0x7f41a00d0f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:59.952 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.949+0000 7f41a87e8640 1 --2- 172.21.15.98:0/3765424063 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41a00d2050 0x7f41a00d0f00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4190005fd0 tx=0x7f419002a5d0 comp rx=0 tx=0).stop 2024-09-16T15:37:59.952 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.950+0000 7f41a87e8640 1 -- 172.21.15.98:0/3765424063 shutdown_connections 2024-09-16T15:37:59.952 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.950+0000 7f41a87e8640 1 --2- 172.21.15.98:0/3765424063 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41a00d2050 0x7f41a00d0f00 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:59.952 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.950+0000 7f41a87e8640 1 --2- 172.21.15.98:0/3765424063 >> v2:172.21.15.135:3300/0 conn(0x7f41a015e0d0 0x7f41a00d09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:59.953 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.950+0000 7f41a87e8640 1 -- 172.21.15.98:0/3765424063 >> 172.21.15.98:0/3765424063 conn(0x7f41a00d3fe0 msgr2=0x7f41a00d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:59.953 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.950+0000 7f41a87e8640 1 -- 172.21.15.98:0/3765424063 shutdown_connections 2024-09-16T15:37:59.953 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.950+0000 7f41a87e8640 1 -- 172.21.15.98:0/3765424063 wait complete. 2024-09-16T15:37:59.955 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.951+0000 7f41a87e8640 1 Processor -- start 2024-09-16T15:37:59.955 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.951+0000 7f41a87e8640 1 -- start start 2024-09-16T15:37:59.955 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.952+0000 7f41a87e8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41a00d1440 0x7f41a009f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:59.955 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.952+0000 7f41a87e8640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41a00d2050 0x7f41a00c9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:59.955 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.952+0000 7f41a87e8640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f41a015e0d0 0x7f41a00ca200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:59.955 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.952+0000 7f41a87e8640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f41a015ebc0 con 0x7f41a015e0d0 2024-09-16T15:37:59.956 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.952+0000 7f41a87e8640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f41a00cfee0 con 0x7f41a00d1440 2024-09-16T15:37:59.956 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.952+0000 7f41a87e8640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f41a015ed40 con 0x7f41a00d2050 2024-09-16T15:37:59.956 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.952+0000 7f41a6d85640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f41a015e0d0 0x7f41a00ca200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:59.956 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.952+0000 7f41a6d85640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f41a015e0d0 0x7f41a00ca200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:33026/0 (socket says 172.21.15.98:33026) 2024-09-16T15:37:59.956 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.952+0000 7f41a6d85640 1 -- 172.21.15.98:0/1585502806 learned_addr learned my addr 172.21.15.98:0/1585502806 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:37:59.956 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.952+0000 7f41a5d83640 1 --2- 172.21.15.98:0/1585502806 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41a00d2050 0x7f41a00c9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:59.956 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.952+0000 7f41a6584640 1 --2- 172.21.15.98:0/1585502806 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41a00d1440 0x7f41a009f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:59.956 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.952+0000 7f41a6d85640 1 -- 172.21.15.98:0/1585502806 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41a00d2050 msgr2=0x7f41a00c9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:59.956 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.952+0000 7f41a6d85640 1 --2- 172.21.15.98:0/1585502806 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41a00d2050 0x7f41a00c9cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:59.956 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.952+0000 7f41a6d85640 1 -- 172.21.15.98:0/1585502806 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41a00d1440 msgr2=0x7f41a009f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:59.956 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.952+0000 7f41a6d85640 1 --2- 172.21.15.98:0/1585502806 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41a00d1440 0x7f41a009f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:59.956 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.952+0000 7f41a6d85640 1 -- 172.21.15.98:0/1585502806 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41a01f8d90 con 0x7f41a015e0d0 2024-09-16T15:37:59.956 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.952+0000 7f41a6584640 1 --2- 172.21.15.98:0/1585502806 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41a00d1440 0x7f41a009f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T15:37:59.956 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.952+0000 7f41a6d85640 1 --2- 172.21.15.98:0/1585502806 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f41a015e0d0 0x7f41a00ca200 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f419800c7a0 tx=0x7f419800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:59.957 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.952+0000 7f4196ffd640 1 -- 172.21.15.98:0/1585502806 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4198003b70 con 0x7f41a015e0d0 2024-09-16T15:37:59.957 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.952+0000 7f4196ffd640 1 -- 172.21.15.98:0/1585502806 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4198003d10 con 0x7f41a015e0d0 2024-09-16T15:37:59.957 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.952+0000 7f41a87e8640 1 -- 172.21.15.98:0/1585502806 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41a01f4c60 con 0x7f41a015e0d0 2024-09-16T15:37:59.957 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.952+0000 7f4196ffd640 1 -- 172.21.15.98:0/1585502806 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f419800aab0 con 0x7f41a015e0d0 2024-09-16T15:37:59.957 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.952+0000 7f41a87e8640 1 -- 172.21.15.98:0/1585502806 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41a009f630 con 0x7f41a015e0d0 2024-09-16T15:37:59.959 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.954+0000 7f4196ffd640 1 -- 172.21.15.98:0/1585502806 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7f419800ac50 con 0x7f41a015e0d0 2024-09-16T15:37:59.959 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.954+0000 7f4196ffd640 1 --2- 172.21.15.98:0/1585502806 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f4184078850 0x7f418407ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:59.959 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.954+0000 7f4196ffd640 1 -- 172.21.15.98:0/1585502806 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f419809a6e0 con 0x7f41a015e0d0 2024-09-16T15:37:59.959 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.955+0000 7f41a6584640 1 --2- 172.21.15.98:0/1585502806 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f4184078850 0x7f418407ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:59.960 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.955+0000 7f41a6584640 1 --2- 172.21.15.98:0/1585502806 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f4184078850 0x7f418407ad10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f419c009ab0 tx=0x7f419c005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:59.960 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.955+0000 7f41ab691740 1 Processor -- start 2024-09-16T15:37:59.960 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.955+0000 7f41ab691740 1 -- start start 2024-09-16T15:37:59.960 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.956+0000 7f41ab691740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55da705251b0 0x55da704fcb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:59.960 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.956+0000 7f41ab691740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55da70544df0 0x55da705451f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:59.960 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.956+0000 7f41ab691740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da704fa5f0 0x55da704faa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:59.960 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.956+0000 7f41ab691740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55da70471820 con 0x55da705251b0 2024-09-16T15:37:59.960 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.956+0000 7f41ab691740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55da70460c50 con 0x55da704fa5f0 2024-09-16T15:37:59.960 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.956+0000 7f41ab691740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55da70464a60 con 0x55da70544df0 2024-09-16T15:37:59.960 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.956+0000 7f41a6584640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55da705251b0 0x55da704fcb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:59.960 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.956+0000 7f41a6584640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55da705251b0 0x55da704fcb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:33034/0 (socket says 172.21.15.98:33034) 2024-09-16T15:37:59.960 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.956+0000 7f41a6584640 1 -- 172.21.15.98:0/616295628 learned_addr learned my addr 172.21.15.98:0/616295628 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:37:59.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.956+0000 7f41a6d85640 1 --2- 172.21.15.98:0/616295628 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da704fa5f0 0x55da704faa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:59.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.956+0000 7f41a5d83640 1 --2- 172.21.15.98:0/616295628 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55da70544df0 0x55da705451f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:59.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.956+0000 7f41a6584640 1 -- 172.21.15.98:0/616295628 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55da70544df0 msgr2=0x55da705451f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T15:37:59.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.956+0000 7f41a6584640 1 --2- 172.21.15.98:0/616295628 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55da70544df0 0x55da705451f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:59.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.956+0000 7f41a6584640 1 -- 172.21.15.98:0/616295628 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da704fa5f0 msgr2=0x55da704faa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T15:37:59.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.956+0000 7f41a6584640 1 --2- 172.21.15.98:0/616295628 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da704fa5f0 0x55da704faa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:59.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.956+0000 7f41a6584640 1 -- 172.21.15.98:0/616295628 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da701c2850 con 0x55da705251b0 2024-09-16T15:37:59.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.956+0000 7f41a6584640 1 --2- 172.21.15.98:0/616295628 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55da705251b0 0x55da704fcb20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f419c010dd0 tx=0x7f419c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5104904fc12c00d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:59.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.957+0000 7f4183fff640 1 -- 172.21.15.98:0/616295628 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f419c023070 con 0x55da705251b0 2024-09-16T15:37:59.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.957+0000 7f4183fff640 1 -- 172.21.15.98:0/616295628 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f419c01f450 con 0x55da705251b0 2024-09-16T15:37:59.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.957+0000 7f4183fff640 1 -- 172.21.15.98:0/616295628 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f419c01f860 con 0x55da705251b0 2024-09-16T15:37:59.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.957+0000 7f41ab691740 1 -- 172.21.15.98:0/616295628 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55da705251b0 msgr2=0x55da704fcb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:59.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.957+0000 7f41ab691740 1 --2- 172.21.15.98:0/616295628 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55da705251b0 0x55da704fcb20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f419c010dd0 tx=0x7f419c013000 comp rx=0 tx=0).stop 2024-09-16T15:37:59.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.957+0000 7f41ab691740 1 -- 172.21.15.98:0/616295628 shutdown_connections 2024-09-16T15:37:59.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.957+0000 7f41ab691740 1 --2- 172.21.15.98:0/616295628 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da704fa5f0 0x55da704faa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:59.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.957+0000 7f41ab691740 1 --2- 172.21.15.98:0/616295628 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55da70544df0 0x55da705451f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:59.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.957+0000 7f41ab691740 1 --2- 172.21.15.98:0/616295628 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55da705251b0 0x55da704fcb20 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:59.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.957+0000 7f41ab691740 1 -- 172.21.15.98:0/616295628 >> 172.21.15.98:0/616295628 conn(0x55da704fb6a0 msgr2=0x55da704ff0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:59.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.957+0000 7f41ab691740 1 -- 172.21.15.98:0/616295628 shutdown_connections 2024-09-16T15:37:59.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.957+0000 7f41ab691740 1 -- 172.21.15.98:0/616295628 wait complete. 2024-09-16T15:37:59.966 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.958+0000 7f41ab691740 1 -- start start 2024-09-16T15:37:59.966 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.958+0000 7f41ab691740 1 Processor -- start 2024-09-16T15:37:59.966 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.959+0000 7f41ab691740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55da705251b0 0x55da704fd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:59.966 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.959+0000 7f41ab691740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55da70544df0 0x55da7051cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:59.966 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.959+0000 7f41ab691740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da704fd630 0x55da7051d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:59.966 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.959+0000 7f41ab691740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55da701d1620 con 0x55da705251b0 2024-09-16T15:37:59.966 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.959+0000 7f41ab691740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55da704065f0 con 0x55da704fd630 2024-09-16T15:37:59.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.959+0000 7f41ab691740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55da704f9b30 con 0x55da70544df0 2024-09-16T15:37:59.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.959+0000 7f41ab691740 10 client.0 _ll_register_callbacks cb 0x55da7040a0a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T15:37:59.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.959+0000 7f41a6584640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55da705251b0 0x55da704fd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:59.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.959+0000 7f41a6584640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55da705251b0 0x55da704fd0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:33044/0 (socket says 172.21.15.98:33044) 2024-09-16T15:37:59.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.959+0000 7f41a6584640 1 -- 172.21.15.98:0/61629363 learned_addr learned my addr 172.21.15.98:0/61629363 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:37:59.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.959+0000 7f41a5d83640 1 --2- 172.21.15.98:0/61629363 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55da70544df0 0x55da7051cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:59.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.959+0000 7f41a6d85640 1 --2- 172.21.15.98:0/61629363 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da704fd630 0x55da7051d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:59.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.959+0000 7f41a6584640 1 -- 172.21.15.98:0/61629363 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55da70544df0 msgr2=0x55da7051cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T15:37:59.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.959+0000 7f41a6584640 1 --2- 172.21.15.98:0/61629363 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55da70544df0 0x55da7051cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:59.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.959+0000 7f41a6584640 1 -- 172.21.15.98:0/61629363 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da704fd630 msgr2=0x55da7051d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T15:37:59.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.959+0000 7f41a6584640 1 --2- 172.21.15.98:0/61629363 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da704fd630 0x55da7051d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:59.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.959+0000 7f41a6584640 1 -- 172.21.15.98:0/61629363 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da702396b0 con 0x55da705251b0 2024-09-16T15:37:59.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.959+0000 7f41a6584640 1 --2- 172.21.15.98:0/61629363 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55da705251b0 0x55da704fd0f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f419c009fd0 tx=0x7f419c009890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7f41ccb774f2ecb server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:59.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.959+0000 7f41817fa640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-16T15:37:59.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.959+0000 7f41817fa640 1 -- 172.21.15.98:0/61629363 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f419c023040 con 0x55da705251b0 2024-09-16T15:37:59.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.959+0000 7f41817fa640 1 -- 172.21.15.98:0/61629363 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f419c020b20 con 0x55da705251b0 2024-09-16T15:37:59.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.959+0000 7f41ab691740 1 -- 172.21.15.98:0/61629363 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f419c01f450 con 0x55da705251b0 2024-09-16T15:37:59.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.960+0000 7f41817fa640 1 -- 172.21.15.98:0/61629363 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f419c03a050 con 0x55da705251b0 2024-09-16T15:37:59.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.960+0000 7f41ab691740 10 client.4647 fetch_fsmap learned FSMap version 7 2024-09-16T15:37:59.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.960+0000 7f41ab691740 1 -- 172.21.15.98:0/61629363 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x55da70524a50 con 0x55da705251b0 2024-09-16T15:37:59.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.960+0000 7f41817fa640 1 -- 172.21.15.98:0/61629363 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f419c01f450 con 0x55da705251b0 2024-09-16T15:37:59.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.960+0000 7f41817fa640 1 -- 172.21.15.98:0/61629363 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 7) ==== 3502+0+0 (secure 0 0 0) 0x7f419c03d020 con 0x55da705251b0 2024-09-16T15:37:59.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.960+0000 7f41ab691740 10 client.4647 fetch_fsmap finished waiting for FSMap version 7 2024-09-16T15:37:59.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.960+0000 7f41ab691740 10 client.4647 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-16T15:37:59.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.960+0000 7f41ab691740 20 client.4647 populate_metadata read hostname 'smithi098' 2024-09-16T15:37:59.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.960+0000 7f41ab691740 1 --2- 172.21.15.98:0/61629363 >> [v2:172.21.15.98:6833/1824614871,v1:172.21.15.98:6835/1824614871] conn(0x55da70527ce0 0x55da705280c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:59.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.960+0000 7f41ab691740 4 client.4647 mds_command: new command op to 4356 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T15:37:59.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.960+0000 7f41ab691740 1 -- 172.21.15.98:0/61629363 --> [v2:172.21.15.98:6833/1824614871,v1:172.21.15.98:6835/1824614871] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55da70473770 con 0x55da70527ce0 2024-09-16T15:37:59.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.960+0000 7f41a5d83640 1 --2- 172.21.15.98:0/61629363 >> [v2:172.21.15.98:6833/1824614871,v1:172.21.15.98:6835/1824614871] conn(0x55da70527ce0 0x55da705280c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:59.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.960+0000 7f41817fa640 10 client.4647 ms_handle_connect on v2:172.21.15.98:6833/1824614871 2024-09-16T15:37:59.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.960+0000 7f41a5d83640 1 --2- 172.21.15.98:0/61629363 >> [v2:172.21.15.98:6833/1824614871,v1:172.21.15.98:6835/1824614871] conn(0x55da70527ce0 0x55da705280c0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13356a3fe2cfcbdb server_cookie=f9566d0fccce8885 in_seq=0 out_seq=0 2024-09-16T15:37:59.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.961+0000 7f41817fa640 1 -- 172.21.15.98:0/61629363 <== mds.0 v2:172.21.15.98:6833/1824614871 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55da70473770 con 0x55da70527ce0 2024-09-16T15:37:59.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.961+0000 7f41817fa640 10 client.4647 handle_command_reply: tid=0 2024-09-16T15:37:59.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.961+0000 7f41ab691740 1 client.4647 shutdown 2024-09-16T15:37:59.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.961+0000 7f41ab691740 1 -- 172.21.15.98:0/61629363 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55da705251b0 msgr2=0x55da704fd0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:59.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.961+0000 7f41ab691740 1 --2- 172.21.15.98:0/61629363 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55da705251b0 0x55da704fd0f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f419c009fd0 tx=0x7f419c009890 comp rx=0 tx=0).stop 2024-09-16T15:37:59.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.961+0000 7f41ab691740 1 -- 172.21.15.98:0/61629363 shutdown_connections 2024-09-16T15:37:59.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.961+0000 7f41ab691740 1 --2- 172.21.15.98:0/61629363 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da704fd630 0x55da7051d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:59.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.961+0000 7f41ab691740 1 --2- 172.21.15.98:0/61629363 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55da70544df0 0x55da7051cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:59.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.961+0000 7f41ab691740 1 --2- 172.21.15.98:0/61629363 >> [v2:172.21.15.98:6833/1824614871,v1:172.21.15.98:6835/1824614871] conn(0x55da70527ce0 0x55da705280c0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:59.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.961+0000 7f41ab691740 1 --2- 172.21.15.98:0/61629363 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55da705251b0 0x55da704fd0f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:59.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.961+0000 7f41817fa640 0 client.4647 ms_handle_reset on v2:172.21.15.98:6833/1824614871 2024-09-16T15:37:59.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.961+0000 7f41ab691740 1 -- 172.21.15.98:0/61629363 >> 172.21.15.98:0/61629363 conn(0x55da704fa5f0 msgr2=0x55da704f8b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:59.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.961+0000 7f41ab691740 1 -- 172.21.15.98:0/61629363 shutdown_connections 2024-09-16T15:37:59.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.961+0000 7f41ab691740 1 -- 172.21.15.98:0/61629363 wait complete. 2024-09-16T15:37:59.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.961+0000 7f41ab691740 20 client.4647 trim_cache size 0 max 16384 2024-09-16T15:37:59.981 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.979+0000 7f41ab691740 1 Processor -- start 2024-09-16T15:37:59.981 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.979+0000 7f41ab691740 1 -- start start 2024-09-16T15:37:59.983 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.980+0000 7f41ab691740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55da704fd630 0x55da705282b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:59.983 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.980+0000 7f41ab691740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55da705251b0 0x55da7051cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:59.983 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.980+0000 7f41ab691740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da70544df0 0x55da7051d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:59.983 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.980+0000 7f41ab691740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f41a02003f0 con 0x55da705251b0 2024-09-16T15:37:59.983 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.980+0000 7f41ab691740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f41a00a1950 con 0x55da70544df0 2024-09-16T15:37:59.983 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.980+0000 7f41ab691740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f41a00cb9e0 con 0x55da704fd630 2024-09-16T15:37:59.983 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.980+0000 7f41a5d83640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55da705251b0 0x55da7051cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:59.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.980+0000 7f41a5d83640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55da705251b0 0x55da7051cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:33048/0 (socket says 172.21.15.98:33048) 2024-09-16T15:37:59.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.980+0000 7f41a5d83640 1 -- 172.21.15.98:0/1998629410 learned_addr learned my addr 172.21.15.98:0/1998629410 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:37:59.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.980+0000 7f41a6584640 1 --2- 172.21.15.98:0/1998629410 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55da704fd630 0x55da705282b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:59.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.980+0000 7f41a6d85640 1 --2- 172.21.15.98:0/1998629410 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da70544df0 0x55da7051d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:59.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.980+0000 7f41a5d83640 1 -- 172.21.15.98:0/1998629410 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55da704fd630 msgr2=0x55da705282b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T15:37:59.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.980+0000 7f41a5d83640 1 --2- 172.21.15.98:0/1998629410 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55da704fd630 0x55da705282b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:59.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.980+0000 7f41a5d83640 1 -- 172.21.15.98:0/1998629410 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da70544df0 msgr2=0x55da7051d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T15:37:59.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.980+0000 7f41a5d83640 1 --2- 172.21.15.98:0/1998629410 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da70544df0 0x55da7051d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:59.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.980+0000 7f41a5d83640 1 -- 172.21.15.98:0/1998629410 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da704fb300 con 0x55da705251b0 2024-09-16T15:37:59.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.980+0000 7f41a6d85640 1 --2- 172.21.15.98:0/1998629410 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da70544df0 0x55da7051d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T15:37:59.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.980+0000 7f41a5d83640 1 --2- 172.21.15.98:0/1998629410 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55da705251b0 0x55da7051cbc0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4190009230 tx=0x7f4190004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdeda5f1a29ff007 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:59.985 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.980+0000 7f41837fe640 1 -- 172.21.15.98:0/1998629410 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4190049070 con 0x55da705251b0 2024-09-16T15:37:59.985 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.981+0000 7f41837fe640 1 -- 172.21.15.98:0/1998629410 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4190005220 con 0x55da705251b0 2024-09-16T15:37:59.985 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.981+0000 7f41837fe640 1 -- 172.21.15.98:0/1998629410 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4190035040 con 0x55da705251b0 2024-09-16T15:37:59.985 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.981+0000 7f41ab691740 1 -- 172.21.15.98:0/1998629410 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55da705251b0 msgr2=0x55da7051cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:59.985 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.981+0000 7f41ab691740 1 --2- 172.21.15.98:0/1998629410 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55da705251b0 0x55da7051cbc0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4190009230 tx=0x7f4190004730 comp rx=0 tx=0).stop 2024-09-16T15:37:59.985 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.981+0000 7f41ab691740 1 -- 172.21.15.98:0/1998629410 shutdown_connections 2024-09-16T15:37:59.985 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.981+0000 7f41ab691740 1 --2- 172.21.15.98:0/1998629410 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da70544df0 0x55da7051d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:59.985 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.981+0000 7f41ab691740 1 --2- 172.21.15.98:0/1998629410 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55da705251b0 0x55da7051cbc0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:59.985 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.981+0000 7f41ab691740 1 --2- 172.21.15.98:0/1998629410 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55da704fd630 0x55da705282b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:59.985 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.981+0000 7f41ab691740 1 -- 172.21.15.98:0/1998629410 >> 172.21.15.98:0/1998629410 conn(0x55da704fa5f0 msgr2=0x55da704f4c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:59.985 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.981+0000 7f41ab691740 1 -- 172.21.15.98:0/1998629410 shutdown_connections 2024-09-16T15:37:59.985 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.981+0000 7f41ab691740 1 -- 172.21.15.98:0/1998629410 wait complete. 2024-09-16T15:37:59.989 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.982+0000 7f41ab691740 1 -- start start 2024-09-16T15:37:59.989 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.982+0000 7f41ab691740 1 Processor -- start 2024-09-16T15:37:59.989 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.983+0000 7f41ab691740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55da704fd630 0x55da70566550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:59.989 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.983+0000 7f41ab691740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55da705251b0 0x55da705bb100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:59.989 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.983+0000 7f41ab691740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da70544df0 0x55da705bb640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:59.989 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.983+0000 7f41ab691740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55da705244e0 con 0x55da705251b0 2024-09-16T15:37:59.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.983+0000 7f41ab691740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55da7051df80 con 0x55da70544df0 2024-09-16T15:37:59.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.983+0000 7f41ab691740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x55da70557200 con 0x55da704fd630 2024-09-16T15:37:59.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.983+0000 7f41ab691740 10 client.0 _ll_register_callbacks cb 0x7f419800ceb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T15:37:59.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.983+0000 7f41a5d83640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55da705251b0 0x55da705bb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:59.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.983+0000 7f41a5d83640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55da705251b0 0x55da705bb100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:33060/0 (socket says 172.21.15.98:33060) 2024-09-16T15:37:59.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.983+0000 7f41a5d83640 1 -- 172.21.15.98:0/4203568956 learned_addr learned my addr 172.21.15.98:0/4203568956 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:37:59.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.983+0000 7f41a6584640 1 --2- 172.21.15.98:0/4203568956 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55da704fd630 0x55da70566550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:59.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.983+0000 7f41a6d85640 1 --2- 172.21.15.98:0/4203568956 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da70544df0 0x55da705bb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:59.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.983+0000 7f41a5d83640 1 -- 172.21.15.98:0/4203568956 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55da704fd630 msgr2=0x55da70566550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T15:37:59.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.983+0000 7f41a5d83640 1 --2- 172.21.15.98:0/4203568956 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55da704fd630 0x55da70566550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:59.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.983+0000 7f41a5d83640 1 -- 172.21.15.98:0/4203568956 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da70544df0 msgr2=0x55da705bb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T15:37:59.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.983+0000 7f41a5d83640 1 --2- 172.21.15.98:0/4203568956 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da70544df0 0x55da705bb640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:59.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.983+0000 7f41a5d83640 1 -- 172.21.15.98:0/4203568956 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da704fce30 con 0x55da705251b0 2024-09-16T15:37:59.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.983+0000 7f41a5d83640 1 --2- 172.21.15.98:0/4203568956 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55da705251b0 0x55da705bb100 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4190009850 tx=0x7f4190005180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cef794d284bc2122 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:37:59.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.983+0000 7f41817fa640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-16T15:37:59.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.983+0000 7f41817fa640 1 -- 172.21.15.98:0/4203568956 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4190035070 con 0x55da705251b0 2024-09-16T15:37:59.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.983+0000 7f41817fa640 1 -- 172.21.15.98:0/4203568956 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f41900055d0 con 0x55da705251b0 2024-09-16T15:37:59.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.983+0000 7f41ab691740 1 -- 172.21.15.98:0/4203568956 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4190005220 con 0x55da705251b0 2024-09-16T15:37:59.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.983+0000 7f41817fa640 1 -- 172.21.15.98:0/4203568956 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f4190049040 con 0x55da705251b0 2024-09-16T15:37:59.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.983+0000 7f41ab691740 10 client.4653 fetch_fsmap learned FSMap version 7 2024-09-16T15:37:59.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.983+0000 7f41ab691740 1 -- 172.21.15.98:0/4203568956 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x55da705228d0 con 0x55da705251b0 2024-09-16T15:37:59.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.984+0000 7f41817fa640 1 -- 172.21.15.98:0/4203568956 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4190005220 con 0x55da705251b0 2024-09-16T15:37:59.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.984+0000 7f41817fa640 1 -- 172.21.15.98:0/4203568956 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 7) ==== 3502+0+0 (secure 0 0 0) 0x7f4190004890 con 0x55da705251b0 2024-09-16T15:37:59.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.984+0000 7f41ab691740 10 client.4653 fetch_fsmap finished waiting for FSMap version 7 2024-09-16T15:37:59.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.984+0000 7f41ab691740 10 client.4653 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-16T15:37:59.992 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.984+0000 7f41ab691740 20 client.4653 populate_metadata read hostname 'smithi098' 2024-09-16T15:37:59.992 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.984+0000 7f41ab691740 1 --2- 172.21.15.98:0/4203568956 >> [v2:172.21.15.98:6833/1824614871,v1:172.21.15.98:6835/1824614871] conn(0x55da705c56c0 0x55da70526640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:37:59.992 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.984+0000 7f41ab691740 4 client.4653 mds_command: new command op to 4356 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-16T15:37:59.992 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.984+0000 7f41ab691740 1 -- 172.21.15.98:0/4203568956 --> [v2:172.21.15.98:6833/1824614871,v1:172.21.15.98:6835/1824614871] -- command(tid 0: {"prefix": "status"}) -- 0x55da7046f220 con 0x55da705c56c0 2024-09-16T15:37:59.992 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.984+0000 7f41a6584640 1 --2- 172.21.15.98:0/4203568956 >> [v2:172.21.15.98:6833/1824614871,v1:172.21.15.98:6835/1824614871] conn(0x55da705c56c0 0x55da70526640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:37:59.992 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.984+0000 7f41a6584640 1 --2- 172.21.15.98:0/4203568956 >> [v2:172.21.15.98:6833/1824614871,v1:172.21.15.98:6835/1824614871] conn(0x55da705c56c0 0x55da70526640 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=863b3d989da72cd0 server_cookie=c1d205e57fbd7c24 in_seq=0 out_seq=0 2024-09-16T15:37:59.992 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.984+0000 7f41817fa640 10 client.4653 ms_handle_connect on v2:172.21.15.98:6833/1824614871 2024-09-16T15:37:59.992 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.984+0000 7f41817fa640 1 -- 172.21.15.98:0/4203568956 <== mds.0 v2:172.21.15.98:6833/1824614871 1 ==== command_reply(tid 0: 0 ) ==== 8+0+323 (crc 0 0 0) 0x55da7046f220 con 0x55da705c56c0 2024-09-16T15:37:59.992 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.984+0000 7f41817fa640 10 client.4653 handle_command_reply: tid=0 2024-09-16T15:37:59.992 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.984+0000 7f41ab691740 1 client.4653 shutdown 2024-09-16T15:37:59.992 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.984+0000 7f41ab691740 1 -- 172.21.15.98:0/4203568956 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55da705251b0 msgr2=0x55da705bb100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:59.992 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.984+0000 7f41ab691740 1 --2- 172.21.15.98:0/4203568956 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55da705251b0 0x55da705bb100 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4190009850 tx=0x7f4190005180 comp rx=0 tx=0).stop 2024-09-16T15:37:59.992 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.984+0000 7f41ab691740 1 -- 172.21.15.98:0/4203568956 shutdown_connections 2024-09-16T15:37:59.992 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.984+0000 7f41ab691740 1 --2- 172.21.15.98:0/4203568956 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da70544df0 0x55da705bb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:59.993 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.984+0000 7f41ab691740 1 --2- 172.21.15.98:0/4203568956 >> [v2:172.21.15.98:6833/1824614871,v1:172.21.15.98:6835/1824614871] conn(0x55da705c56c0 0x55da70526640 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:59.993 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.984+0000 7f41ab691740 1 --2- 172.21.15.98:0/4203568956 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55da705251b0 0x55da705bb100 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:59.993 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.984+0000 7f41ab691740 1 --2- 172.21.15.98:0/4203568956 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55da704fd630 0x55da70566550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:59.993 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.984+0000 7f41817fa640 0 client.4653 ms_handle_reset on v2:172.21.15.98:6833/1824614871 2024-09-16T15:37:59.993 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.984+0000 7f41ab691740 1 -- 172.21.15.98:0/4203568956 >> 172.21.15.98:0/4203568956 conn(0x55da704fa5f0 msgr2=0x55da7051c990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:59.993 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.985+0000 7f41ab691740 1 -- 172.21.15.98:0/4203568956 shutdown_connections 2024-09-16T15:37:59.993 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.985+0000 7f41ab691740 1 -- 172.21.15.98:0/4203568956 wait complete. 2024-09-16T15:37:59.993 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.985+0000 7f41ab691740 20 client.4653 trim_cache size 0 max 16384 2024-09-16T15:37:59.993 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-16T15:37:59.993 INFO:teuthology.orchestra.run.smithi098.stdout: "cluster_fsid": "52a38a45-21d2-4cb0-bb3a-4fb8be3a08df", 2024-09-16T15:37:59.994 INFO:teuthology.orchestra.run.smithi098.stdout: "whoami": 0, 2024-09-16T15:37:59.994 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 4356, 2024-09-16T15:37:59.994 INFO:teuthology.orchestra.run.smithi098.stdout: "want_state": "up:active", 2024-09-16T15:37:59.994 INFO:teuthology.orchestra.run.smithi098.stdout: "state": "up:active", 2024-09-16T15:37:59.994 INFO:teuthology.orchestra.run.smithi098.stdout: "fs_name": "cephfs", 2024-09-16T15:37:59.994 INFO:teuthology.orchestra.run.smithi098.stdout: "rank_uptime": 15.48740218, 2024-09-16T15:37:59.994 INFO:teuthology.orchestra.run.smithi098.stdout: "mdsmap_epoch": 7, 2024-09-16T15:37:59.994 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_epoch": 23, 2024-09-16T15:37:59.994 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_epoch_barrier": 23, 2024-09-16T15:37:59.994 INFO:teuthology.orchestra.run.smithi098.stdout: "uptime": 20.977584720999999 2024-09-16T15:37:59.994 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-16T15:37:59.995 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.985+0000 7f41a87e8640 1 -- 172.21.15.98:0/1585502806 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f4184078850 msgr2=0x7f418407ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:59.995 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.985+0000 7f41a87e8640 1 --2- 172.21.15.98:0/1585502806 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f4184078850 0x7f418407ad10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f419c009ab0 tx=0x7f419c005f90 comp rx=0 tx=0).stop 2024-09-16T15:37:59.995 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.985+0000 7f41a87e8640 1 -- 172.21.15.98:0/1585502806 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f41a015e0d0 msgr2=0x7f41a00ca200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:37:59.995 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.985+0000 7f41a87e8640 1 --2- 172.21.15.98:0/1585502806 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f41a015e0d0 0x7f41a00ca200 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f419800c7a0 tx=0x7f419800cc60 comp rx=0 tx=0).stop 2024-09-16T15:37:59.995 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.985+0000 7f41a87e8640 1 -- 172.21.15.98:0/1585502806 shutdown_connections 2024-09-16T15:37:59.995 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.985+0000 7f41a87e8640 1 --2- 172.21.15.98:0/1585502806 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f41a015e0d0 0x7f41a00ca200 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:59.995 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.985+0000 7f41a87e8640 1 --2- 172.21.15.98:0/1585502806 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f41a00d2050 0x7f41a00c9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:59.995 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.985+0000 7f41a87e8640 1 --2- 172.21.15.98:0/1585502806 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f4184078850 0x7f418407ad10 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:59.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.985+0000 7f41a87e8640 1 --2- 172.21.15.98:0/1585502806 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41a00d1440 0x7f41a009f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:37:59.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.985+0000 7f41a87e8640 1 -- 172.21.15.98:0/1585502806 >> 172.21.15.98:0/1585502806 conn(0x7f41a00d3fe0 msgr2=0x7f41a0160e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:37:59.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.985+0000 7f41a87e8640 1 -- 172.21.15.98:0/1585502806 shutdown_connections 2024-09-16T15:37:59.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:37:59.985+0000 7f41a87e8640 1 -- 172.21.15.98:0/1585502806 wait complete. 2024-09-16T15:37:59.997 INFO:teuthology.run_tasks:Running task kclient... 2024-09-16T15:38:00.023 INFO:tasks.kclient:Mounting kernel clients... 2024-09-16T15:38:00.023 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-09-16T15:38:00.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T15:38:00.023 DEBUG:teuthology.orchestra.run.smithi098:> ip netns list 2024-09-16T15:38:00.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T15:38:00.040 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link delete ceph-brx 2024-09-16T15:38:00.107 INFO:teuthology.orchestra.run.smithi098.stderr:Cannot find device "ceph-brx" 2024-09-16T15:38:00.108 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T15:38:00.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T15:38:00.109 DEBUG:teuthology.orchestra.run.smithi098:> ip netns list 2024-09-16T15:38:00.164 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T15:38:00.164 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link delete ceph-brx 2024-09-16T15:38:00.230 INFO:teuthology.orchestra.run.smithi098.stderr:Cannot find device "ceph-brx" 2024-09-16T15:38:00.231 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T15:38:00.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T15:38:00.232 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list 2024-09-16T15:38:00.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T15:38:00.252 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link delete ceph-brx 2024-09-16T15:38:00.324 INFO:teuthology.orchestra.run.smithi135.stderr:Cannot find device "ceph-brx" 2024-09-16T15:38:00.325 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T15:38:00.326 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T15:38:00.326 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list 2024-09-16T15:38:00.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T15:38:00.385 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link delete ceph-brx 2024-09-16T15:38:00.455 INFO:teuthology.orchestra.run.smithi135.stderr:Cannot find device "ceph-brx" 2024-09-16T15:38:00.456 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T15:38:00.457 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-09-16T15:38:00.457 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-16T15:38:00.457 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-16T15:38:00.457 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-16T15:38:00.561 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:00.559+0000 7f504e8b6640 1 -- 172.21.15.98:0/984771799 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f50480d2050 msgr2=0x7f50480d0f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:00.561 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:00.559+0000 7f504e8b6640 1 --2- 172.21.15.98:0/984771799 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f50480d2050 0x7f50480d0f00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f503c005fd0 tx=0x7f503c02a5d0 comp rx=0 tx=0).stop 2024-09-16T15:38:00.561 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:00.559+0000 7f504e8b6640 1 -- 172.21.15.98:0/984771799 shutdown_connections 2024-09-16T15:38:00.561 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:00.559+0000 7f504e8b6640 1 --2- 172.21.15.98:0/984771799 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f50480d2050 0x7f50480d0f00 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:00.561 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:00.559+0000 7f504e8b6640 1 --2- 172.21.15.98:0/984771799 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f504815e0d0 0x7f50480d09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:00.561 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:00.559+0000 7f504e8b6640 1 -- 172.21.15.98:0/984771799 >> 172.21.15.98:0/984771799 conn(0x7f50480d3fe0 msgr2=0x7f50480d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:00.562 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:00.559+0000 7f504e8b6640 1 -- 172.21.15.98:0/984771799 shutdown_connections 2024-09-16T15:38:00.562 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:00.559+0000 7f504e8b6640 1 -- 172.21.15.98:0/984771799 wait complete. 2024-09-16T15:38:00.562 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:00.560+0000 7f504e8b6640 1 Processor -- start 2024-09-16T15:38:00.562 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:00.560+0000 7f504e8b6640 1 -- start start 2024-09-16T15:38:00.564 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:00.561+0000 7f504e8b6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f50480d1440 0x7f50481f8690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:00.564 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:00.561+0000 7f504e8b6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f50480d2050 0x7f504815f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:00.564 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:00.561+0000 7f504e8b6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f504815e0d0 0x7f504815f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:00.565 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:00.561+0000 7f504e8b6640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f504815ebc0 con 0x7f504815e0d0 2024-09-16T15:38:00.565 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:00.561+0000 7f504e8b6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f50480cfee0 con 0x7f50480d2050 2024-09-16T15:38:00.565 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:00.561+0000 7f504e8b6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f504815ed40 con 0x7f50480d1440 2024-09-16T15:38:00.565 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:00.561+0000 7f504ce53640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f504815e0d0 0x7f504815f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:00.565 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:00.561+0000 7f504ce53640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f504815e0d0 0x7f504815f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:33082/0 (socket says 172.21.15.98:33082) 2024-09-16T15:38:00.565 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:00.561+0000 7f504ce53640 1 -- 172.21.15.98:0/807240530 learned_addr learned my addr 172.21.15.98:0/807240530 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:00.565 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:00.561+0000 7f5047fff640 1 --2- 172.21.15.98:0/807240530 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f50480d1440 0x7f50481f8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:00.565 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:00.561+0000 7f50477fe640 1 --2- 172.21.15.98:0/807240530 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f50480d2050 0x7f504815f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:00.565 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:00.561+0000 7f504ce53640 1 -- 172.21.15.98:0/807240530 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f50480d1440 msgr2=0x7f50481f8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:00.565 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:00.561+0000 7f504ce53640 1 --2- 172.21.15.98:0/807240530 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f50480d1440 0x7f50481f8690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:00.565 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:00.561+0000 7f504ce53640 1 -- 172.21.15.98:0/807240530 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f50480d2050 msgr2=0x7f504815f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:00.565 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:00.561+0000 7f504ce53640 1 --2- 172.21.15.98:0/807240530 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f50480d2050 0x7f504815f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:00.565 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:00.561+0000 7f504ce53640 1 -- 172.21.15.98:0/807240530 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50481f8bd0 con 0x7f504815e0d0 2024-09-16T15:38:00.566 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:00.561+0000 7f50477fe640 1 --2- 172.21.15.98:0/807240530 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f50480d2050 0x7f504815f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T15:38:00.566 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:00.561+0000 7f504ce53640 1 --2- 172.21.15.98:0/807240530 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f504815e0d0 0x7f504815f9b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f504000c770 tx=0x7f504000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:00.566 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:00.561+0000 7f5044ff9640 1 -- 172.21.15.98:0/807240530 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5040003da0 con 0x7f504815e0d0 2024-09-16T15:38:00.566 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:00.561+0000 7f5044ff9640 1 -- 172.21.15.98:0/807240530 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5040005070 con 0x7f504815e0d0 2024-09-16T15:38:00.566 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:00.561+0000 7f5044ff9640 1 -- 172.21.15.98:0/807240530 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5040005500 con 0x7f504815e0d0 2024-09-16T15:38:00.566 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:00.561+0000 7f504e8b6640 1 -- 172.21.15.98:0/807240530 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50481f5600 con 0x7f504815e0d0 2024-09-16T15:38:00.566 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:00.561+0000 7f504e8b6640 1 -- 172.21.15.98:0/807240530 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50481f4d60 con 0x7f504815e0d0 2024-09-16T15:38:00.566 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:00.562+0000 7f504e8b6640 1 -- 172.21.15.98:0/807240530 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f504815f260 con 0x7f504815e0d0 2024-09-16T15:38:00.567 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:00.563+0000 7f5044ff9640 1 -- 172.21.15.98:0/807240530 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7f50400056a0 con 0x7f504815e0d0 2024-09-16T15:38:00.567 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:00.563+0000 7f5044ff9640 1 --2- 172.21.15.98:0/807240530 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f5034078850 0x7f503407ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:00.567 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:00.563+0000 7f5044ff9640 1 -- 172.21.15.98:0/807240530 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f504009a690 con 0x7f504815e0d0 2024-09-16T15:38:00.567 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:00.564+0000 7f5047fff640 1 --2- 172.21.15.98:0/807240530 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f5034078850 0x7f503407ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:00.567 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:00.564+0000 7f5047fff640 1 --2- 172.21.15.98:0/807240530 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f5034078850 0x7f503407ad10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5038004630 tx=0x7f503800b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:00.569 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:00.568+0000 7f5044ff9640 1 -- 172.21.15.98:0/807240530 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7f5040062d90 con 0x7f504815e0d0 2024-09-16T15:38:00.780 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:00.778+0000 7f504e8b6640 1 -- 172.21.15.98:0/807240530 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f504806f0b0 con 0x7f504815e0d0 2024-09-16T15:38:00.781 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:00.779+0000 7f5044ff9640 1 -- 172.21.15.98:0/807240530 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+73 (secure 0 0 0) 0x7f5040062690 con 0x7f504815e0d0 2024-09-16T15:38:00.781 INFO:teuthology.orchestra.run.smithi098.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-16T15:38:00.783 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:00.781+0000 7f504e8b6640 1 -- 172.21.15.98:0/807240530 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f5034078850 msgr2=0x7f503407ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:00.783 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:00.781+0000 7f504e8b6640 1 --2- 172.21.15.98:0/807240530 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f5034078850 0x7f503407ad10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5038004630 tx=0x7f503800b2e0 comp rx=0 tx=0).stop 2024-09-16T15:38:00.783 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:00.781+0000 7f504e8b6640 1 -- 172.21.15.98:0/807240530 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f504815e0d0 msgr2=0x7f504815f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:00.783 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:00.781+0000 7f504e8b6640 1 --2- 172.21.15.98:0/807240530 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f504815e0d0 0x7f504815f9b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f504000c770 tx=0x7f504000cc30 comp rx=0 tx=0).stop 2024-09-16T15:38:00.783 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:00.781+0000 7f504e8b6640 1 -- 172.21.15.98:0/807240530 shutdown_connections 2024-09-16T15:38:00.784 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:00.781+0000 7f504e8b6640 1 --2- 172.21.15.98:0/807240530 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f504815e0d0 0x7f504815f9b0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:00.784 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:00.781+0000 7f504e8b6640 1 --2- 172.21.15.98:0/807240530 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f5034078850 0x7f503407ad10 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:00.784 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:00.781+0000 7f504e8b6640 1 --2- 172.21.15.98:0/807240530 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f50480d2050 0x7f504815f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:00.784 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:00.781+0000 7f504e8b6640 1 --2- 172.21.15.98:0/807240530 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f50480d1440 0x7f50481f8690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:00.784 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:00.781+0000 7f504e8b6640 1 -- 172.21.15.98:0/807240530 >> 172.21.15.98:0/807240530 conn(0x7f50480d3fe0 msgr2=0x7f50480d43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:00.784 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:00.781+0000 7f504e8b6640 1 -- 172.21.15.98:0/807240530 shutdown_connections 2024-09-16T15:38:00.784 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:00.781+0000 7f504e8b6640 1 -- 172.21.15.98:0/807240530 wait complete. 2024-09-16T15:38:00.794 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-16T15:38:00.794 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-16T15:38:00.794 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi098.front.sepia.ceph.com 2024-09-16T15:38:00.794 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-16T15:38:00.794 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-16T15:38:00.794 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-16T15:38:00.794 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-16T15:38:00.794 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-16T15:38:00.794 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-16T15:38:00.794 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T15:38:00.795 DEBUG:teuthology.orchestra.run.smithi098:> ip addr 2024-09-16T15:38:00.809 INFO:teuthology.orchestra.run.smithi098.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T15:38:00.809 INFO:teuthology.orchestra.run.smithi098.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T15:38:00.810 INFO:teuthology.orchestra.run.smithi098.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T15:38:00.810 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2024-09-16T15:38:00.810 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 ::1/128 scope host 2024-09-16T15:38:00.810 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2024-09-16T15:38:00.810 INFO:teuthology.orchestra.run.smithi098.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T15:38:00.810 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:d8:d9:b8 brd ff:ff:ff:ff:ff:ff 2024-09-16T15:38:00.810 INFO:teuthology.orchestra.run.smithi098.stdout: altname enp7s0f0 2024-09-16T15:38:00.810 INFO:teuthology.orchestra.run.smithi098.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T15:38:00.810 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:d8:d9:b9 brd ff:ff:ff:ff:ff:ff 2024-09-16T15:38:00.810 INFO:teuthology.orchestra.run.smithi098.stdout: altname enp7s0f1 2024-09-16T15:38:00.810 INFO:teuthology.orchestra.run.smithi098.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T15:38:00.810 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:8f:d2:6a brd ff:ff:ff:ff:ff:ff 2024-09-16T15:38:00.810 INFO:teuthology.orchestra.run.smithi098.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-16T15:38:00.810 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:8f:d2:6b brd ff:ff:ff:ff:ff:ff 2024-09-16T15:38:00.810 INFO:teuthology.orchestra.run.smithi098.stdout: inet 172.21.15.98/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-16T15:38:00.811 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft 42761sec preferred_lft 42761sec 2024-09-16T15:38:00.811 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::ec4:7aff:fe8f:d26b/64 scope link noprefixroute 2024-09-16T15:38:00.811 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2024-09-16T15:38:00.811 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-16T15:38:00.811 DEBUG:teuthology.orchestra.run.smithi098:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T15:38:00.811 DEBUG:teuthology.orchestra.run.smithi098:> set -e 2024-09-16T15:38:00.811 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link add name ceph-brx type bridge 2024-09-16T15:38:00.811 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip addr flush dev ceph-brx 2024-09-16T15:38:00.811 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link set ceph-brx up 2024-09-16T15:38:00.811 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-16T15:38:00.812 DEBUG:teuthology.orchestra.run.smithi098:> ') 2024-09-16T15:38:00.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T15:38:01.007 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T15:38:01.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T15:38:01.013 DEBUG:teuthology.orchestra.run.smithi098:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-16T15:38:01.037 INFO:teuthology.orchestra.run.smithi098.stdout:1 2024-09-16T15:38:01.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T15:38:01.039 DEBUG:teuthology.orchestra.run.smithi098:> route 2024-09-16T15:38:01.108 INFO:teuthology.orchestra.run.smithi098.stdout:Kernel IP routing table 2024-09-16T15:38:01.108 INFO:teuthology.orchestra.run.smithi098.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-16T15:38:01.108 INFO:teuthology.orchestra.run.smithi098.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-16T15:38:01.108 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-16T15:38:01.108 INFO:teuthology.orchestra.run.smithi098.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-16T15:38:01.108 DEBUG:teuthology.orchestra.run.smithi098:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T15:38:01.108 DEBUG:teuthology.orchestra.run.smithi098:> set -e 2024-09-16T15:38:01.108 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-16T15:38:01.109 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-16T15:38:01.109 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-16T15:38:01.109 DEBUG:teuthology.orchestra.run.smithi098:> ') 2024-09-16T15:38:01.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T15:38:01.413 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T15:38:01.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T15:38:01.419 DEBUG:teuthology.orchestra.run.smithi098:> ip netns list 2024-09-16T15:38:01.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T15:38:01.435 DEBUG:teuthology.orchestra.run.smithi098:> ip netns list-id 2024-09-16T15:38:01.491 DEBUG:teuthology.orchestra.run.smithi098:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T15:38:01.491 DEBUG:teuthology.orchestra.run.smithi098:> set -e 2024-09-16T15:38:01.491 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-16T15:38:01.491 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-16T15:38:01.491 DEBUG:teuthology.orchestra.run.smithi098:> ') 2024-09-16T15:38:01.580 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T15:38:01.603 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T15:38:01.609 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-16T15:38:01.610 DEBUG:teuthology.orchestra.run.smithi098:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T15:38:01.610 DEBUG:teuthology.orchestra.run.smithi098:> set -e 2024-09-16T15:38:01.610 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-16T15:38:01.610 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-16T15:38:01.610 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-16T15:38:01.610 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-16T15:38:01.610 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-16T15:38:01.610 DEBUG:teuthology.orchestra.run.smithi098:> ') 2024-09-16T15:38:01.658 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T15:38:01.724 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T15:38:01.730 DEBUG:teuthology.orchestra.run.smithi098:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T15:38:01.730 DEBUG:teuthology.orchestra.run.smithi098:> set -e 2024-09-16T15:38:01.731 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link set brx.0 up 2024-09-16T15:38:01.731 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link set dev brx.0 master ceph-brx 2024-09-16T15:38:01.731 DEBUG:teuthology.orchestra.run.smithi098:> ') 2024-09-16T15:38:01.779 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T15:38:01.803 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T15:38:01.810 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T15:38:01.811 DEBUG:teuthology.orchestra.run.smithi098:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-16T15:38:01.825 INFO:teuthology.orchestra.run.smithi098.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-16T15:38:01.825 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T15:38:01.825 DEBUG:teuthology.orchestra.run.smithi098:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-16T15:38:01.881 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-16T15:38:01.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T15:38:01.881 DEBUG:teuthology.orchestra.run.smithi098:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T15:38:01.974 INFO:teuthology.orchestra.run.smithi098.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T15:38:01.974 INFO:teuthology.orchestra.run.smithi098.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T15:38:01.974 INFO:teuthology.orchestra.run.smithi098.stdout:invalid new device string format 2024-09-16T15:38:02.097 INFO:teuthology.orchestra.run.smithi098.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T15:38:02.097 INFO:teuthology.orchestra.run.smithi098.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T15:38:02.097 INFO:teuthology.orchestra.run.smithi098.stdout:invalid new device string format 2024-09-16T15:38:02.097 INFO:teuthology.orchestra.run.smithi098.stdout:mount.ceph: resolved to: "172.21.15.98:3300,172.21.15.135:3300,172.21.15.135:3301" 2024-09-16T15:38:02.097 INFO:teuthology.orchestra.run.smithi098.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T15:38:02.104 INFO:teuthology.orchestra.run.smithi098.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T15:38:02.105 INFO:teuthology.orchestra.run.smithi098.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T15:38:02.105 INFO:teuthology.orchestra.run.smithi098.stdout:invalid new device string format 2024-09-16T15:38:02.105 INFO:teuthology.orchestra.run.smithi098.stdout:mount.ceph: resolved to: "172.21.15.98:3300,172.21.15.135:3300,172.21.15.135:3301" 2024-09-16T15:38:02.105 INFO:teuthology.orchestra.run.smithi098.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T15:38:02.105 INFO:teuthology.orchestra.run.smithi098.stdout:mount.ceph: resolved to: "172.21.15.98:6789,172.21.15.135:6789,172.21.15.135:6790" 2024-09-16T15:38:02.105 INFO:teuthology.orchestra.run.smithi098.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.98:6789,172.21.15.135:6789,172.21.15.135:6790:/ 2024-09-16T15:38:02.105 INFO:teuthology.orchestra.run.smithi098.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=52a38a45-21d2-4cb0-bb3a-4fb8be3a08df" will pass to kernel 2024-09-16T15:38:02.106 INFO:teuthology.orchestra.run.smithi098.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-16T15:38:02.106 INFO:teuthology.orchestra.run.smithi098.stdout: You just mounted a file system that supports labels which does not 2024-09-16T15:38:02.106 INFO:teuthology.orchestra.run.smithi098.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-16T15:38:02.106 INFO:teuthology.orchestra.run.smithi098.stdout: applications will generate AVC messages and not be allowed access to 2024-09-16T15:38:02.106 INFO:teuthology.orchestra.run.smithi098.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-16T15:38:02.107 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-16T15:38:02.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T15:38:02.108 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-16T15:38:02.133 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T15:38:02.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:02 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T15:38:02.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T15:38:02.233 INFO:teuthology.orchestra.run.smithi098.stdout:client4665 2024-09-16T15:38:02.233 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-16T15:38:02.233 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T15:38:02.249 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T15:38:02.339 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:02 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T15:38:02.344 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T15:38:02.350 INFO:teuthology.orchestra.run.smithi098.stdout:client4665 2024-09-16T15:38:02.350 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T15:38:02.399 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:02 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T15:38:02.404 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T15:38:02.410 INFO:teuthology.orchestra.run.smithi098.stdout:client4665 2024-09-16T15:38:02.410 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/52a38a45-21d2-4cb0-bb3a-4fb8be3a08df.client4665/status') 2024-09-16T15:38:02.459 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T15:38:02.471 INFO:teuthology.orchestra.run.smithi098.stdout:instance: client.4665 (3)192.168.0.1:0/3744124406 2024-09-16T15:38:02.471 INFO:teuthology.orchestra.run.smithi098.stdout:blocklisted: false 2024-09-16T15:38:02.471 INFO:teuthology.orchestra.run.smithi098.stderr:0+1 records in 2024-09-16T15:38:02.471 INFO:teuthology.orchestra.run.smithi098.stderr:0+1 records out 2024-09-16T15:38:02.471 INFO:teuthology.orchestra.run.smithi098.stderr:69 bytes copied, 3.8018e-05 s, 1.8 MB/s 2024-09-16T15:38:02.472 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T15:38:02.479 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2024-09-16T15:38:02.479 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-16T15:38:02.479 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-16T15:38:02.479 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-16T15:38:02.581 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:02.579+0000 7f46316b0640 1 -- 172.21.15.98:0/4014088547 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f462c15c040 msgr2=0x7f462c0ce4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:02.581 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:02.579+0000 7f46316b0640 1 --2- 172.21.15.98:0/4014088547 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f462c15c040 0x7f462c0ce4a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f461c005fd0 tx=0x7f461c02a530 comp rx=0 tx=0).stop 2024-09-16T15:38:02.581 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:02.579+0000 7f46316b0640 1 -- 172.21.15.98:0/4014088547 shutdown_connections 2024-09-16T15:38:02.581 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:02.579+0000 7f46316b0640 1 --2- 172.21.15.98:0/4014088547 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f462c0b1a00 0x7f462c0b1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:02.581 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:02.579+0000 7f46316b0640 1 --2- 172.21.15.98:0/4014088547 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f462c15c040 0x7f462c0ce4a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:02.581 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:02.579+0000 7f46316b0640 1 -- 172.21.15.98:0/4014088547 >> 172.21.15.98:0/4014088547 conn(0x7f462c0d1da0 msgr2=0x7f462c0d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:02.581 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:02.580+0000 7f46316b0640 1 -- 172.21.15.98:0/4014088547 shutdown_connections 2024-09-16T15:38:02.581 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:02.580+0000 7f46316b0640 1 -- 172.21.15.98:0/4014088547 wait complete. 2024-09-16T15:38:02.582 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:02.581+0000 7f46316b0640 1 Processor -- start 2024-09-16T15:38:02.582 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:02.581+0000 7f46316b0640 1 -- start start 2024-09-16T15:38:02.584 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:02.581+0000 7f46316b0640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f462c0b1a00 0x7f462c0b3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:02.584 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:02.581+0000 7f46316b0640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f462c0d28c0 0x7f462c0b3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:02.584 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:02.582+0000 7f46316b0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f462c15c040 0x7f462c0b5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:02.584 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:02.582+0000 7f46316b0640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f462c0b23d0 con 0x7f462c0d28c0 2024-09-16T15:38:02.584 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:02.582+0000 7f46316b0640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f462c0cf300 con 0x7f462c15c040 2024-09-16T15:38:02.584 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:02.582+0000 7f46316b0640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f462c0b2550 con 0x7f462c0b1a00 2024-09-16T15:38:02.584 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:02.582+0000 7f4623fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f462c0d28c0 0x7f462c0b3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:02.584 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:02.582+0000 7f4623fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f462c0d28c0 0x7f462c0b3d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:33094/0 (socket says 172.21.15.98:33094) 2024-09-16T15:38:02.584 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:02.582+0000 7f4623fff640 1 -- 172.21.15.98:0/1831602740 learned_addr learned my addr 172.21.15.98:0/1831602740 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:02.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:02.582+0000 7f462b7fe640 1 --2- 172.21.15.98:0/1831602740 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f462c15c040 0x7f462c0b5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:02.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:02.582+0000 7f462affd640 1 --2- 172.21.15.98:0/1831602740 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f462c0b1a00 0x7f462c0b3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:02.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:02.582+0000 7f4623fff640 1 -- 172.21.15.98:0/1831602740 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f462c0b1a00 msgr2=0x7f462c0b3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:02.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:02.582+0000 7f4623fff640 1 --2- 172.21.15.98:0/1831602740 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f462c0b1a00 0x7f462c0b3810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:02.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:02.582+0000 7f4623fff640 1 -- 172.21.15.98:0/1831602740 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f462c15c040 msgr2=0x7f462c0b5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:02.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:02.582+0000 7f4623fff640 1 --2- 172.21.15.98:0/1831602740 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f462c15c040 0x7f462c0b5c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:02.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:02.582+0000 7f4623fff640 1 -- 172.21.15.98:0/1831602740 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f462c0ca1a0 con 0x7f462c0d28c0 2024-09-16T15:38:02.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:02.582+0000 7f4623fff640 1 --2- 172.21.15.98:0/1831602740 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f462c0d28c0 0x7f462c0b3d50 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f461400c460 tx=0x7f461400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:02.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:02.582+0000 7f46237fe640 1 -- 172.21.15.98:0/1831602740 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4614016020 con 0x7f462c0d28c0 2024-09-16T15:38:02.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:02.582+0000 7f46237fe640 1 -- 172.21.15.98:0/1831602740 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4614012960 con 0x7f462c0d28c0 2024-09-16T15:38:02.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:02.582+0000 7f46316b0640 1 -- 172.21.15.98:0/1831602740 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f462c0b7bc0 con 0x7f462c0d28c0 2024-09-16T15:38:02.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:02.582+0000 7f46237fe640 1 -- 172.21.15.98:0/1831602740 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4614012db0 con 0x7f462c0d28c0 2024-09-16T15:38:02.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:02.582+0000 7f46316b0640 1 -- 172.21.15.98:0/1831602740 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f462c0c9620 con 0x7f462c0d28c0 2024-09-16T15:38:02.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:02.583+0000 7f46316b0640 1 -- 172.21.15.98:0/1831602740 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f462c0b2ab0 con 0x7f462c0d28c0 2024-09-16T15:38:02.586 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:02.584+0000 7f46237fe640 1 -- 172.21.15.98:0/1831602740 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7f4614019020 con 0x7f462c0d28c0 2024-09-16T15:38:02.586 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:02.584+0000 7f46237fe640 1 --2- 172.21.15.98:0/1831602740 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f460c078850 0x7f460c07ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:02.586 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:02.585+0000 7f46237fe640 1 -- 172.21.15.98:0/1831602740 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f461409a230 con 0x7f462c0d28c0 2024-09-16T15:38:02.586 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:02.585+0000 7f462affd640 1 --2- 172.21.15.98:0/1831602740 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f460c078850 0x7f460c07ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:02.586 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:02.585+0000 7f462affd640 1 --2- 172.21.15.98:0/1831602740 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f460c078850 0x7f460c07ad10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f461c033000 tx=0x7f461c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:02.590 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:02.589+0000 7f46237fe640 1 -- 172.21.15.98:0/1831602740 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7f4614020070 con 0x7f462c0d28c0 2024-09-16T15:38:02.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:02.800+0000 7f46316b0640 1 -- 172.21.15.98:0/1831602740 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f462c158e00 con 0x7f462c0d28c0 2024-09-16T15:38:02.802 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:02.801+0000 7f46237fe640 1 -- 172.21.15.98:0/1831602740 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+73 (secure 0 0 0) 0x7f46140622e0 con 0x7f462c0d28c0 2024-09-16T15:38:02.802 INFO:teuthology.orchestra.run.smithi098.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-16T15:38:02.804 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:02.803+0000 7f46316b0640 1 -- 172.21.15.98:0/1831602740 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f460c078850 msgr2=0x7f460c07ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:02.804 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:02.803+0000 7f46316b0640 1 --2- 172.21.15.98:0/1831602740 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f460c078850 0x7f460c07ad10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f461c033000 tx=0x7f461c004730 comp rx=0 tx=0).stop 2024-09-16T15:38:02.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:02.803+0000 7f46316b0640 1 -- 172.21.15.98:0/1831602740 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f462c0d28c0 msgr2=0x7f462c0b3d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:02.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:02.803+0000 7f46316b0640 1 --2- 172.21.15.98:0/1831602740 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f462c0d28c0 0x7f462c0b3d50 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f461400c460 tx=0x7f461400c920 comp rx=0 tx=0).stop 2024-09-16T15:38:02.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:02.803+0000 7f46316b0640 1 -- 172.21.15.98:0/1831602740 shutdown_connections 2024-09-16T15:38:02.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:02.803+0000 7f46316b0640 1 --2- 172.21.15.98:0/1831602740 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f460c078850 0x7f460c07ad10 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:02.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:02.803+0000 7f46316b0640 1 --2- 172.21.15.98:0/1831602740 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f462c15c040 0x7f462c0b5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:02.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:02.803+0000 7f46316b0640 1 --2- 172.21.15.98:0/1831602740 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f462c0d28c0 0x7f462c0b3d50 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:02.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:02.803+0000 7f46316b0640 1 --2- 172.21.15.98:0/1831602740 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f462c0b1a00 0x7f462c0b3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:02.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:02.803+0000 7f46316b0640 1 -- 172.21.15.98:0/1831602740 >> 172.21.15.98:0/1831602740 conn(0x7f462c0d1da0 msgr2=0x7f462c0c78e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:02.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:02.803+0000 7f46316b0640 1 -- 172.21.15.98:0/1831602740 shutdown_connections 2024-09-16T15:38:02.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:02.803+0000 7f46316b0640 1 -- 172.21.15.98:0/1831602740 wait complete. 2024-09-16T15:38:02.815 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-16T15:38:02.815 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-16T15:38:02.815 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi098.front.sepia.ceph.com 2024-09-16T15:38:02.815 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-09-16T15:38:02.815 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-16T15:38:02.815 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-16T15:38:02.815 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-16T15:38:02.815 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-16T15:38:02.815 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-09-16T15:38:02.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T15:38:02.816 DEBUG:teuthology.orchestra.run.smithi098:> ip addr 2024-09-16T15:38:02.831 INFO:teuthology.orchestra.run.smithi098.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T15:38:02.831 INFO:teuthology.orchestra.run.smithi098.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T15:38:02.831 INFO:teuthology.orchestra.run.smithi098.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T15:38:02.831 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2024-09-16T15:38:02.831 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 ::1/128 scope host 2024-09-16T15:38:02.831 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2024-09-16T15:38:02.831 INFO:teuthology.orchestra.run.smithi098.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T15:38:02.831 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:d8:d9:b8 brd ff:ff:ff:ff:ff:ff 2024-09-16T15:38:02.832 INFO:teuthology.orchestra.run.smithi098.stdout: altname enp7s0f0 2024-09-16T15:38:02.832 INFO:teuthology.orchestra.run.smithi098.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T15:38:02.832 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:d8:d9:b9 brd ff:ff:ff:ff:ff:ff 2024-09-16T15:38:02.832 INFO:teuthology.orchestra.run.smithi098.stdout: altname enp7s0f1 2024-09-16T15:38:02.832 INFO:teuthology.orchestra.run.smithi098.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T15:38:02.832 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:8f:d2:6a brd ff:ff:ff:ff:ff:ff 2024-09-16T15:38:02.832 INFO:teuthology.orchestra.run.smithi098.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-16T15:38:02.832 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:8f:d2:6b brd ff:ff:ff:ff:ff:ff 2024-09-16T15:38:02.832 INFO:teuthology.orchestra.run.smithi098.stdout: inet 172.21.15.98/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-16T15:38:02.832 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft 42759sec preferred_lft 42759sec 2024-09-16T15:38:02.832 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::ec4:7aff:fe8f:d26b/64 scope link noprefixroute 2024-09-16T15:38:02.832 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2024-09-16T15:38:02.833 INFO:teuthology.orchestra.run.smithi098.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-16T15:38:02.833 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 66:90:2f:f2:79:64 brd ff:ff:ff:ff:ff:ff 2024-09-16T15:38:02.833 INFO:teuthology.orchestra.run.smithi098.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-16T15:38:02.833 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2024-09-16T15:38:02.833 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::c409:2eff:febe:bb92/64 scope link 2024-09-16T15:38:02.833 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2024-09-16T15:38:02.833 INFO:teuthology.orchestra.run.smithi098.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T15:38:02.833 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 66:90:2f:f2:79:64 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-16T15:38:02.833 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::6490:2fff:fef2:7964/64 scope link tentative 2024-09-16T15:38:02.833 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2024-09-16T15:38:02.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T15:38:02.833 DEBUG:teuthology.orchestra.run.smithi098:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-16T15:38:02.895 INFO:teuthology.orchestra.run.smithi098.stdout:1 2024-09-16T15:38:02.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T15:38:02.896 DEBUG:teuthology.orchestra.run.smithi098:> route 2024-09-16T15:38:02.952 INFO:teuthology.orchestra.run.smithi098.stdout:Kernel IP routing table 2024-09-16T15:38:02.953 INFO:teuthology.orchestra.run.smithi098.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-16T15:38:02.953 INFO:teuthology.orchestra.run.smithi098.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-16T15:38:02.953 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-16T15:38:02.953 INFO:teuthology.orchestra.run.smithi098.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-16T15:38:02.953 DEBUG:teuthology.orchestra.run.smithi098:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T15:38:02.953 DEBUG:teuthology.orchestra.run.smithi098:> set -e 2024-09-16T15:38:02.953 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-16T15:38:02.953 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-16T15:38:02.953 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-16T15:38:02.953 DEBUG:teuthology.orchestra.run.smithi098:> ') 2024-09-16T15:38:03.040 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T15:38:03.073 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T15:38:03.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T15:38:03.079 DEBUG:teuthology.orchestra.run.smithi098:> ip netns list 2024-09-16T15:38:03.094 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-16T15:38:03.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T15:38:03.095 DEBUG:teuthology.orchestra.run.smithi098:> ip netns list-id 2024-09-16T15:38:03.154 INFO:teuthology.orchestra.run.smithi098.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-09-16T15:38:03.154 DEBUG:teuthology.orchestra.run.smithi098:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T15:38:03.154 DEBUG:teuthology.orchestra.run.smithi098:> set -e 2024-09-16T15:38:03.154 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-16T15:38:03.154 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-09-16T15:38:03.154 DEBUG:teuthology.orchestra.run.smithi098:> ') 2024-09-16T15:38:03.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T15:38:03.264 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T15:38:03.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T15:38:03.271 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-16T15:38:03.294 INFO:teuthology.orchestra.run.smithi098.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T15:38:03.295 INFO:teuthology.orchestra.run.smithi098.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T15:38:03.295 INFO:teuthology.orchestra.run.smithi098.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T15:38:03.295 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2024-09-16T15:38:03.295 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 ::1/128 scope host 2024-09-16T15:38:03.295 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2024-09-16T15:38:03.295 INFO:teuthology.orchestra.run.smithi098.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-16T15:38:03.295 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 5a:84:82:aa:60:38 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-16T15:38:03.295 INFO:teuthology.orchestra.run.smithi098.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-16T15:38:03.295 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2024-09-16T15:38:03.295 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::5884:82ff:feaa:6038/64 scope link tentative 2024-09-16T15:38:03.295 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2024-09-16T15:38:03.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T15:38:03.296 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-16T15:38:03.361 INFO:teuthology.orchestra.run.smithi098.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T15:38:03.361 INFO:teuthology.orchestra.run.smithi098.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T15:38:03.361 INFO:teuthology.orchestra.run.smithi098.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T15:38:03.361 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2024-09-16T15:38:03.361 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 ::1/128 scope host 2024-09-16T15:38:03.361 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2024-09-16T15:38:03.361 INFO:teuthology.orchestra.run.smithi098.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-16T15:38:03.362 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 5a:84:82:aa:60:38 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-16T15:38:03.362 INFO:teuthology.orchestra.run.smithi098.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-16T15:38:03.362 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2024-09-16T15:38:03.362 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::5884:82ff:feaa:6038/64 scope link tentative 2024-09-16T15:38:03.362 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2024-09-16T15:38:03.363 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-09-16T15:38:03.363 DEBUG:teuthology.orchestra.run.smithi098:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T15:38:03.363 DEBUG:teuthology.orchestra.run.smithi098:> set -e 2024-09-16T15:38:03.363 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-09-16T15:38:03.363 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-16T15:38:03.364 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-09-16T15:38:03.364 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-09-16T15:38:03.364 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-09-16T15:38:03.364 DEBUG:teuthology.orchestra.run.smithi098:> ') 2024-09-16T15:38:03.450 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T15:38:03.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T15:38:03.514 DEBUG:teuthology.orchestra.run.smithi098:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T15:38:03.514 DEBUG:teuthology.orchestra.run.smithi098:> set -e 2024-09-16T15:38:03.514 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link set brx.1 up 2024-09-16T15:38:03.514 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link set dev brx.1 master ceph-brx 2024-09-16T15:38:03.514 DEBUG:teuthology.orchestra.run.smithi098:> ') 2024-09-16T15:38:03.562 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T15:38:03.584 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T15:38:03.590 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T15:38:03.590 DEBUG:teuthology.orchestra.run.smithi098:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-09-16T15:38:03.605 INFO:teuthology.orchestra.run.smithi098.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-09-16T15:38:03.605 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T15:38:03.605 DEBUG:teuthology.orchestra.run.smithi098:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-09-16T15:38:03.660 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-16T15:38:03.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T15:38:03.661 DEBUG:teuthology.orchestra.run.smithi098:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-16T15:38:03.744 INFO:teuthology.orchestra.run.smithi098.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-16T15:38:03.744 INFO:teuthology.orchestra.run.smithi098.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-09-16T15:38:03.744 INFO:teuthology.orchestra.run.smithi098.stdout:invalid new device string format 2024-09-16T15:38:03.753 INFO:teuthology.orchestra.run.smithi098.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-16T15:38:03.753 INFO:teuthology.orchestra.run.smithi098.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-09-16T15:38:03.753 INFO:teuthology.orchestra.run.smithi098.stdout:invalid new device string format 2024-09-16T15:38:03.753 INFO:teuthology.orchestra.run.smithi098.stdout:mount.ceph: resolved to: "172.21.15.98:3300,172.21.15.135:3300,172.21.15.135:3301" 2024-09-16T15:38:03.753 INFO:teuthology.orchestra.run.smithi098.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T15:38:03.758 INFO:teuthology.orchestra.run.smithi098.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-16T15:38:03.758 INFO:teuthology.orchestra.run.smithi098.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-09-16T15:38:03.758 INFO:teuthology.orchestra.run.smithi098.stdout:invalid new device string format 2024-09-16T15:38:03.758 INFO:teuthology.orchestra.run.smithi098.stdout:mount.ceph: resolved to: "172.21.15.98:3300,172.21.15.135:3300,172.21.15.135:3301" 2024-09-16T15:38:03.758 INFO:teuthology.orchestra.run.smithi098.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T15:38:03.758 INFO:teuthology.orchestra.run.smithi098.stdout:mount.ceph: resolved to: "172.21.15.98:6789,172.21.15.135:6789,172.21.15.135:6790" 2024-09-16T15:38:03.758 INFO:teuthology.orchestra.run.smithi098.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.98:6789,172.21.15.135:6789,172.21.15.135:6790:/ 2024-09-16T15:38:03.758 INFO:teuthology.orchestra.run.smithi098.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=52a38a45-21d2-4cb0-bb3a-4fb8be3a08df" will pass to kernel 2024-09-16T15:38:03.759 INFO:teuthology.orchestra.run.smithi098.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-09-16T15:38:03.759 INFO:teuthology.orchestra.run.smithi098.stdout: You just mounted a file system that supports labels which does not 2024-09-16T15:38:03.759 INFO:teuthology.orchestra.run.smithi098.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-16T15:38:03.759 INFO:teuthology.orchestra.run.smithi098.stdout: applications will generate AVC messages and not be allowed access to 2024-09-16T15:38:03.759 INFO:teuthology.orchestra.run.smithi098.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-16T15:38:03.760 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-16T15:38:03.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T15:38:03.761 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-09-16T15:38:03.825 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T15:38:03.913 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:03 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T15:38:03.915 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T15:38:03.921 INFO:teuthology.orchestra.run.smithi098.stdout:client4663 2024-09-16T15:38:03.921 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-16T15:38:03.921 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T15:38:03.937 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T15:38:04.024 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:04 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T15:38:04.026 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T15:38:04.032 INFO:teuthology.orchestra.run.smithi098.stdout:client4663 2024-09-16T15:38:04.032 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T15:38:04.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:04 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T15:38:04.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T15:38:04.086 INFO:teuthology.orchestra.run.smithi098.stdout:client4663 2024-09-16T15:38:04.087 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/52a38a45-21d2-4cb0-bb3a-4fb8be3a08df.client4663/status') 2024-09-16T15:38:04.134 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T15:38:04.144 INFO:teuthology.orchestra.run.smithi098.stdout:instance: client.4663 (3)172.21.15.98:0/3193940575 2024-09-16T15:38:04.144 INFO:teuthology.orchestra.run.smithi098.stdout:blocklisted: false 2024-09-16T15:38:04.144 INFO:teuthology.orchestra.run.smithi098.stderr:0+1 records in 2024-09-16T15:38:04.144 INFO:teuthology.orchestra.run.smithi098.stderr:0+1 records out 2024-09-16T15:38:04.144 INFO:teuthology.orchestra.run.smithi098.stderr:70 bytes copied, 2.2416e-05 s, 3.1 MB/s 2024-09-16T15:38:04.145 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T15:38:04.152 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-09-16T15:38:04.152 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-16T15:38:04.152 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-16T15:38:04.152 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-16T15:38:04.254 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:04.253+0000 7f24d4a47640 1 -- 172.21.15.98:0/1965195746 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f24d00d2050 msgr2=0x7f24d00d0f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:04.254 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:04.253+0000 7f24d4a47640 1 --2- 172.21.15.98:0/1965195746 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f24d00d2050 0x7f24d00d0f00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f24b8005fd0 tx=0x7f24b802a5d0 comp rx=0 tx=0).stop 2024-09-16T15:38:04.254 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:04.253+0000 7f24d4a47640 1 -- 172.21.15.98:0/1965195746 shutdown_connections 2024-09-16T15:38:04.254 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:04.253+0000 7f24d4a47640 1 --2- 172.21.15.98:0/1965195746 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f24d00d2050 0x7f24d00d0f00 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:04.254 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:04.253+0000 7f24d4a47640 1 --2- 172.21.15.98:0/1965195746 >> v2:172.21.15.135:3300/0 conn(0x7f24d015e0d0 0x7f24d00d09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:04.254 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:04.253+0000 7f24d4a47640 1 -- 172.21.15.98:0/1965195746 >> 172.21.15.98:0/1965195746 conn(0x7f24d00d3fe0 msgr2=0x7f24d00d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:04.254 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:04.253+0000 7f24d4a47640 1 -- 172.21.15.98:0/1965195746 shutdown_connections 2024-09-16T15:38:04.254 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:04.253+0000 7f24d4a47640 1 -- 172.21.15.98:0/1965195746 wait complete. 2024-09-16T15:38:04.255 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:04.254+0000 7f24d4a47640 1 Processor -- start 2024-09-16T15:38:04.255 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:04.254+0000 7f24d4a47640 1 -- start start 2024-09-16T15:38:04.257 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:04.255+0000 7f24d4a47640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24d00d1440 0x7f24d014beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:04.257 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:04.255+0000 7f24d4a47640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f24d00d2050 0x7f24d00cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:04.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:04.255+0000 7f24d4a47640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f24d015e0d0 0x7f24d00ce180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:04.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:04.255+0000 7f24d4a47640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f24d015ebc0 con 0x7f24d00d2050 2024-09-16T15:38:04.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:04.255+0000 7f24d4a47640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f24d00cfee0 con 0x7f24d00d1440 2024-09-16T15:38:04.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:04.255+0000 7f24d4a47640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f24d015ed40 con 0x7f24d015e0d0 2024-09-16T15:38:04.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:04.255+0000 7f24cdd9b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f24d00d2050 0x7f24d00cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:04.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:04.255+0000 7f24cdd9b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f24d00d2050 0x7f24d00cdc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:33102/0 (socket says 172.21.15.98:33102) 2024-09-16T15:38:04.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:04.255+0000 7f24cdd9b640 1 -- 172.21.15.98:0/2693297051 learned_addr learned my addr 172.21.15.98:0/2693297051 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:04.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:04.255+0000 7f24ce59c640 1 --2- 172.21.15.98:0/2693297051 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24d00d1440 0x7f24d014beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:04.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:04.255+0000 7f24ced9d640 1 --2- 172.21.15.98:0/2693297051 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f24d015e0d0 0x7f24d00ce180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:04.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:04.255+0000 7f24cdd9b640 1 -- 172.21.15.98:0/2693297051 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f24d015e0d0 msgr2=0x7f24d00ce180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:04.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:04.255+0000 7f24cdd9b640 1 --2- 172.21.15.98:0/2693297051 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f24d015e0d0 0x7f24d00ce180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:04.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:04.255+0000 7f24cdd9b640 1 -- 172.21.15.98:0/2693297051 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24d00d1440 msgr2=0x7f24d014beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:04.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:04.255+0000 7f24cdd9b640 1 --2- 172.21.15.98:0/2693297051 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24d00d1440 0x7f24d014beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:04.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:04.255+0000 7f24cdd9b640 1 -- 172.21.15.98:0/2693297051 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24d01f58a0 con 0x7f24d00d2050 2024-09-16T15:38:04.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:04.255+0000 7f24cdd9b640 1 --2- 172.21.15.98:0/2693297051 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f24d00d2050 0x7f24d00cdc40 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f24b8000c00 tx=0x7f24b8003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:04.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:04.256+0000 7f24c6ffd640 1 -- 172.21.15.98:0/2693297051 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24b803f070 con 0x7f24d00d2050 2024-09-16T15:38:04.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:04.256+0000 7f24c6ffd640 1 -- 172.21.15.98:0/2693297051 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f24b8005600 con 0x7f24d00d2050 2024-09-16T15:38:04.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:04.256+0000 7f24d4a47640 1 -- 172.21.15.98:0/2693297051 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24d01f55c0 con 0x7f24d00d2050 2024-09-16T15:38:04.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:04.256+0000 7f24c6ffd640 1 -- 172.21.15.98:0/2693297051 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24b8035030 con 0x7f24d00d2050 2024-09-16T15:38:04.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:04.256+0000 7f24d4a47640 1 -- 172.21.15.98:0/2693297051 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24d00c94d0 con 0x7f24d00d2050 2024-09-16T15:38:04.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:04.257+0000 7f24d4a47640 1 -- 172.21.15.98:0/2693297051 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24d015f260 con 0x7f24d00d2050 2024-09-16T15:38:04.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:04.257+0000 7f24c6ffd640 1 -- 172.21.15.98:0/2693297051 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7f24b8042070 con 0x7f24d00d2050 2024-09-16T15:38:04.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:04.258+0000 7f24c6ffd640 1 --2- 172.21.15.98:0/2693297051 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f24b0078850 0x7f24b007ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:04.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:04.258+0000 7f24c6ffd640 1 -- 172.21.15.98:0/2693297051 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f24b80bb310 con 0x7f24d00d2050 2024-09-16T15:38:04.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:04.258+0000 7f24ce59c640 1 --2- 172.21.15.98:0/2693297051 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f24b0078850 0x7f24b007ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:04.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:04.258+0000 7f24ce59c640 1 --2- 172.21.15.98:0/2693297051 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f24b0078850 0x7f24b007ad10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f24c8005fd0 tx=0x7f24c8009500 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:04.263 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:04.262+0000 7f24c6ffd640 1 -- 172.21.15.98:0/2693297051 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7f24b80833c0 con 0x7f24d00d2050 2024-09-16T15:38:04.472 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:04.471+0000 7f24d4a47640 1 -- 172.21.15.98:0/2693297051 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f24d00b6630 con 0x7f24d00d2050 2024-09-16T15:38:04.472 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:04.471+0000 7f24c6ffd640 1 -- 172.21.15.98:0/2693297051 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+73 (secure 0 0 0) 0x7f24b8087df0 con 0x7f24d00d2050 2024-09-16T15:38:04.472 INFO:teuthology.orchestra.run.smithi098.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-16T15:38:04.474 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:04.473+0000 7f24d4a47640 1 -- 172.21.15.98:0/2693297051 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f24b0078850 msgr2=0x7f24b007ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:04.474 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:04.473+0000 7f24d4a47640 1 --2- 172.21.15.98:0/2693297051 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f24b0078850 0x7f24b007ad10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f24c8005fd0 tx=0x7f24c8009500 comp rx=0 tx=0).stop 2024-09-16T15:38:04.474 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:04.473+0000 7f24d4a47640 1 -- 172.21.15.98:0/2693297051 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f24d00d2050 msgr2=0x7f24d00cdc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:04.475 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:04.473+0000 7f24d4a47640 1 --2- 172.21.15.98:0/2693297051 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f24d00d2050 0x7f24d00cdc40 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f24b8000c00 tx=0x7f24b8003820 comp rx=0 tx=0).stop 2024-09-16T15:38:04.475 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:04.473+0000 7f24d4a47640 1 -- 172.21.15.98:0/2693297051 shutdown_connections 2024-09-16T15:38:04.475 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:04.473+0000 7f24d4a47640 1 --2- 172.21.15.98:0/2693297051 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f24d015e0d0 0x7f24d00ce180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:04.475 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:04.473+0000 7f24d4a47640 1 --2- 172.21.15.98:0/2693297051 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f24d00d2050 0x7f24d00cdc40 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:04.475 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:04.473+0000 7f24d4a47640 1 --2- 172.21.15.98:0/2693297051 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f24b0078850 0x7f24b007ad10 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:04.475 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:04.473+0000 7f24d4a47640 1 --2- 172.21.15.98:0/2693297051 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24d00d1440 0x7f24d014beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:04.475 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:04.473+0000 7f24d4a47640 1 -- 172.21.15.98:0/2693297051 >> 172.21.15.98:0/2693297051 conn(0x7f24d00d3fe0 msgr2=0x7f24d015f470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:04.475 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:04.473+0000 7f24d4a47640 1 -- 172.21.15.98:0/2693297051 shutdown_connections 2024-09-16T15:38:04.475 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:04.473+0000 7f24d4a47640 1 -- 172.21.15.98:0/2693297051 wait complete. 2024-09-16T15:38:04.485 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-16T15:38:04.485 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-16T15:38:04.485 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi135.front.sepia.ceph.com 2024-09-16T15:38:04.485 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-16T15:38:04.485 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-16T15:38:04.485 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-16T15:38:04.485 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-16T15:38:04.485 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-16T15:38:04.485 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-16T15:38:04.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T15:38:04.485 DEBUG:teuthology.orchestra.run.smithi135:> ip addr 2024-09-16T15:38:04.505 INFO:teuthology.orchestra.run.smithi135.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T15:38:04.505 INFO:teuthology.orchestra.run.smithi135.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T15:38:04.505 INFO:teuthology.orchestra.run.smithi135.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T15:38:04.505 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2024-09-16T15:38:04.505 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 ::1/128 scope host 2024-09-16T15:38:04.505 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2024-09-16T15:38:04.505 INFO:teuthology.orchestra.run.smithi135.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T15:38:04.505 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:d9:36:76 brd ff:ff:ff:ff:ff:ff 2024-09-16T15:38:04.506 INFO:teuthology.orchestra.run.smithi135.stdout: altname enp7s0f0 2024-09-16T15:38:04.506 INFO:teuthology.orchestra.run.smithi135.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T15:38:04.506 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:d9:36:77 brd ff:ff:ff:ff:ff:ff 2024-09-16T15:38:04.506 INFO:teuthology.orchestra.run.smithi135.stdout: altname enp7s0f1 2024-09-16T15:38:04.506 INFO:teuthology.orchestra.run.smithi135.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T15:38:04.506 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:88:80:82 brd ff:ff:ff:ff:ff:ff 2024-09-16T15:38:04.506 INFO:teuthology.orchestra.run.smithi135.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-16T15:38:04.506 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:88:80:83 brd ff:ff:ff:ff:ff:ff 2024-09-16T15:38:04.506 INFO:teuthology.orchestra.run.smithi135.stdout: inet 172.21.15.135/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-16T15:38:04.506 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft 42762sec preferred_lft 42762sec 2024-09-16T15:38:04.506 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 fe80::ec4:7aff:fe88:8083/64 scope link noprefixroute 2024-09-16T15:38:04.506 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2024-09-16T15:38:04.507 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-16T15:38:04.507 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T15:38:04.507 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2024-09-16T15:38:04.507 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link add name ceph-brx type bridge 2024-09-16T15:38:04.507 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip addr flush dev ceph-brx 2024-09-16T15:38:04.507 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link set ceph-brx up 2024-09-16T15:38:04.507 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-16T15:38:04.507 DEBUG:teuthology.orchestra.run.smithi135:> ') 2024-09-16T15:38:04.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:38:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T15:38:04.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:38:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T15:38:04.794 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T15:38:04.795 DEBUG:teuthology.orchestra.run.smithi135:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-16T15:38:04.819 INFO:teuthology.orchestra.run.smithi135.stdout:1 2024-09-16T15:38:04.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T15:38:04.821 DEBUG:teuthology.orchestra.run.smithi135:> route 2024-09-16T15:38:04.904 INFO:teuthology.orchestra.run.smithi135.stdout:Kernel IP routing table 2024-09-16T15:38:04.904 INFO:teuthology.orchestra.run.smithi135.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-16T15:38:04.904 INFO:teuthology.orchestra.run.smithi135.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-16T15:38:04.904 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-16T15:38:04.905 INFO:teuthology.orchestra.run.smithi135.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-16T15:38:04.905 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T15:38:04.905 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2024-09-16T15:38:04.905 DEBUG:teuthology.orchestra.run.smithi135:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-16T15:38:04.905 DEBUG:teuthology.orchestra.run.smithi135:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-16T15:38:04.905 DEBUG:teuthology.orchestra.run.smithi135:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-16T15:38:04.905 DEBUG:teuthology.orchestra.run.smithi135:> ') 2024-09-16T15:38:04.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:38:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T15:38:05.208 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:38:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T15:38:05.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T15:38:05.214 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list 2024-09-16T15:38:05.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T15:38:05.231 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list-id 2024-09-16T15:38:05.287 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T15:38:05.287 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2024-09-16T15:38:05.287 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-16T15:38:05.287 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-16T15:38:05.287 DEBUG:teuthology.orchestra.run.smithi135:> ') 2024-09-16T15:38:05.375 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:38:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T15:38:05.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:38:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T15:38:05.405 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-16T15:38:05.406 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T15:38:05.406 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2024-09-16T15:38:05.406 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-16T15:38:05.406 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-16T15:38:05.406 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-16T15:38:05.406 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-16T15:38:05.406 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-16T15:38:05.406 DEBUG:teuthology.orchestra.run.smithi135:> ') 2024-09-16T15:38:05.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:38:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T15:38:05.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:38:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T15:38:05.531 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T15:38:05.531 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2024-09-16T15:38:05.531 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link set brx.0 up 2024-09-16T15:38:05.531 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link set dev brx.0 master ceph-brx 2024-09-16T15:38:05.531 DEBUG:teuthology.orchestra.run.smithi135:> ') 2024-09-16T15:38:05.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:38:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T15:38:05.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:38:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T15:38:05.609 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T15:38:05.609 DEBUG:teuthology.orchestra.run.smithi135:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-16T15:38:05.624 INFO:teuthology.orchestra.run.smithi135.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-16T15:38:05.624 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T15:38:05.624 DEBUG:teuthology.orchestra.run.smithi135:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-16T15:38:05.679 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-16T15:38:05.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T15:38:05.679 DEBUG:teuthology.orchestra.run.smithi135:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T15:38:05.769 INFO:teuthology.orchestra.run.smithi135.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T15:38:05.770 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-16T15:38:05.770 INFO:teuthology.orchestra.run.smithi135.stdout:invalid new device string format 2024-09-16T15:38:05.904 INFO:teuthology.orchestra.run.smithi135.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T15:38:05.904 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-16T15:38:05.904 INFO:teuthology.orchestra.run.smithi135.stdout:invalid new device string format 2024-09-16T15:38:05.904 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: resolved to: "172.21.15.98:3300,172.21.15.135:3300,172.21.15.135:3301" 2024-09-16T15:38:05.904 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T15:38:05.909 INFO:teuthology.orchestra.run.smithi135.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T15:38:05.909 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-16T15:38:05.909 INFO:teuthology.orchestra.run.smithi135.stdout:invalid new device string format 2024-09-16T15:38:05.909 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: resolved to: "172.21.15.98:3300,172.21.15.135:3300,172.21.15.135:3301" 2024-09-16T15:38:05.909 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T15:38:05.909 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: resolved to: "172.21.15.98:6789,172.21.15.135:6789,172.21.15.135:6790" 2024-09-16T15:38:05.910 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.98:6789,172.21.15.135:6789,172.21.15.135:6790:/ 2024-09-16T15:38:05.910 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=52a38a45-21d2-4cb0-bb3a-4fb8be3a08df" will pass to kernel 2024-09-16T15:38:05.910 INFO:teuthology.orchestra.run.smithi135.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-16T15:38:05.910 INFO:teuthology.orchestra.run.smithi135.stdout: You just mounted a file system that supports labels which does not 2024-09-16T15:38:05.910 INFO:teuthology.orchestra.run.smithi135.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-16T15:38:05.910 INFO:teuthology.orchestra.run.smithi135.stdout: applications will generate AVC messages and not be allowed access to 2024-09-16T15:38:05.910 INFO:teuthology.orchestra.run.smithi135.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-16T15:38:05.912 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-16T15:38:05.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T15:38:05.912 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-16T15:38:05.936 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T15:38:06.025 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:38:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T15:38:06.027 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:38:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T15:38:06.033 INFO:teuthology.orchestra.run.smithi135.stdout:client4677 2024-09-16T15:38:06.033 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-16T15:38:06.033 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T15:38:06.049 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T15:38:06.136 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:38:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T15:38:06.138 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:38:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T15:38:06.144 INFO:teuthology.orchestra.run.smithi135.stdout:client4677 2024-09-16T15:38:06.144 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T15:38:06.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:38:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T15:38:06.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:38:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T15:38:06.200 INFO:teuthology.orchestra.run.smithi135.stdout:client4677 2024-09-16T15:38:06.200 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/52a38a45-21d2-4cb0-bb3a-4fb8be3a08df.client4677/status') 2024-09-16T15:38:06.248 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:38:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T15:38:06.258 INFO:teuthology.orchestra.run.smithi135.stdout:instance: client.4677 (3)172.21.15.135:0/544187878 2024-09-16T15:38:06.258 INFO:teuthology.orchestra.run.smithi135.stdout:blocklisted: false 2024-09-16T15:38:06.258 INFO:teuthology.orchestra.run.smithi135.stderr:0+1 records in 2024-09-16T15:38:06.258 INFO:teuthology.orchestra.run.smithi135.stderr:0+1 records out 2024-09-16T15:38:06.258 INFO:teuthology.orchestra.run.smithi135.stderr:70 bytes copied, 2.3361e-05 s, 3.0 MB/s 2024-09-16T15:38:06.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:38:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T15:38:06.268 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2024-09-16T15:38:06.268 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-16T15:38:06.268 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-16T15:38:06.268 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-16T15:38:06.382 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:06.381+0000 7fa024b10640 1 -- 172.21.15.98:0/2957091936 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa0200ccfd0 msgr2=0x7fa0200730b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:06.382 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:06.381+0000 7fa024b10640 1 --2- 172.21.15.98:0/2957091936 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa0200ccfd0 0x7fa0200730b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa018009be0 tx=0x7fa01802a8d0 comp rx=0 tx=0).stop 2024-09-16T15:38:06.382 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:06.381+0000 7fa024b10640 1 -- 172.21.15.98:0/2957091936 shutdown_connections 2024-09-16T15:38:06.383 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:06.381+0000 7fa024b10640 1 --2- 172.21.15.98:0/2957091936 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa0200ccfd0 0x7fa0200730b0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:06.383 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:06.381+0000 7fa024b10640 1 -- 172.21.15.98:0/2957091936 >> 172.21.15.98:0/2957091936 conn(0x7fa0200b1950 msgr2=0x7fa0200b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:06.383 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:06.381+0000 7fa024b10640 1 -- 172.21.15.98:0/2957091936 shutdown_connections 2024-09-16T15:38:06.383 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:06.381+0000 7fa024b10640 1 -- 172.21.15.98:0/2957091936 wait complete. 2024-09-16T15:38:06.383 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:06.383+0000 7fa024b10640 1 Processor -- start 2024-09-16T15:38:06.383 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:06.383+0000 7fa024b10640 1 -- start start 2024-09-16T15:38:06.385 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:06.383+0000 7fa024b10640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0200ccfd0 0x7fa0200c8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:06.386 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:06.383+0000 7fa024b10640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa0200cf300 0x7fa0200cbd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:06.386 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:06.383+0000 7fa024b10640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa0201445d0 0x7fa0201408b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:06.386 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:06.383+0000 7fa024b10640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa0200735f0 con 0x7fa0200cf300 2024-09-16T15:38:06.386 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:06.383+0000 7fa024b10640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa0200b4f60 con 0x7fa0200ccfd0 2024-09-16T15:38:06.386 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:06.383+0000 7fa024b10640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fa020073770 con 0x7fa0201445d0 2024-09-16T15:38:06.386 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:06.383+0000 7fa01dd9b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa0200cf300 0x7fa0200cbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:06.386 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:06.384+0000 7fa01dd9b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa0200cf300 0x7fa0200cbd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54532/0 (socket says 172.21.15.98:54532) 2024-09-16T15:38:06.386 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:06.384+0000 7fa01dd9b640 1 -- 172.21.15.98:0/1706817022 learned_addr learned my addr 172.21.15.98:0/1706817022 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:06.386 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:06.384+0000 7fa01e59c640 1 --2- 172.21.15.98:0/1706817022 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0200ccfd0 0x7fa0200c8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:06.386 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:06.384+0000 7fa01ed9d640 1 --2- 172.21.15.98:0/1706817022 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa0201445d0 0x7fa0201408b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:06.386 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:06.384+0000 7fa01dd9b640 1 -- 172.21.15.98:0/1706817022 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa0201445d0 msgr2=0x7fa0201408b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:06.386 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:06.384+0000 7fa01dd9b640 1 --2- 172.21.15.98:0/1706817022 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa0201445d0 0x7fa0201408b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:06.386 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:06.384+0000 7fa01dd9b640 1 -- 172.21.15.98:0/1706817022 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0200ccfd0 msgr2=0x7fa0200c8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:06.387 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:06.384+0000 7fa01dd9b640 1 --2- 172.21.15.98:0/1706817022 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0200ccfd0 0x7fa0200c8fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:06.387 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:06.384+0000 7fa01dd9b640 1 -- 172.21.15.98:0/1706817022 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0201f8560 con 0x7fa0200cf300 2024-09-16T15:38:06.387 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:06.384+0000 7fa01ed9d640 1 --2- 172.21.15.98:0/1706817022 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa0201445d0 0x7fa0201408b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T15:38:06.387 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:06.384+0000 7fa01dd9b640 1 --2- 172.21.15.98:0/1706817022 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa0200cf300 0x7fa0200cbd70 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa01400c450 tx=0x7fa01400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:06.387 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:06.384+0000 7fa00effd640 1 -- 172.21.15.98:0/1706817022 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa014016020 con 0x7fa0200cf300 2024-09-16T15:38:06.387 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:06.384+0000 7fa00effd640 1 -- 172.21.15.98:0/1706817022 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa014012920 con 0x7fa0200cf300 2024-09-16T15:38:06.387 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:06.384+0000 7fa00effd640 1 -- 172.21.15.98:0/1706817022 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa014012d70 con 0x7fa0200cf300 2024-09-16T15:38:06.387 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:06.384+0000 7fa024b10640 1 -- 172.21.15.98:0/1706817022 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0201f8840 con 0x7fa0200cf300 2024-09-16T15:38:06.387 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:06.384+0000 7fa024b10640 1 -- 172.21.15.98:0/1706817022 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0201f8e00 con 0x7fa0200cf300 2024-09-16T15:38:06.388 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:06.385+0000 7fa024b10640 1 -- 172.21.15.98:0/1706817022 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa020073c20 con 0x7fa0200cf300 2024-09-16T15:38:06.388 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:06.386+0000 7fa00effd640 1 -- 172.21.15.98:0/1706817022 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7fa014019020 con 0x7fa0200cf300 2024-09-16T15:38:06.388 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:06.386+0000 7fa00effd640 1 --2- 172.21.15.98:0/1706817022 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fa000078850 0x7fa00007ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:06.388 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:06.386+0000 7fa00effd640 1 -- 172.21.15.98:0/1706817022 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fa01409a860 con 0x7fa0200cf300 2024-09-16T15:38:06.388 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:06.386+0000 7fa01e59c640 1 --2- 172.21.15.98:0/1706817022 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fa000078850 0x7fa00007ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:06.388 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:06.387+0000 7fa01e59c640 1 --2- 172.21.15.98:0/1706817022 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fa000078850 0x7fa00007ad10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa010006fd0 tx=0x7fa010008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:06.391 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:06.391+0000 7fa00effd640 1 -- 172.21.15.98:0/1706817022 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7fa014020020 con 0x7fa0200cf300 2024-09-16T15:38:06.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:06.603+0000 7fa024b10640 1 -- 172.21.15.98:0/1706817022 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fa0201f8fd0 con 0x7fa0200cf300 2024-09-16T15:38:06.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:06.603+0000 7fa00effd640 1 -- 172.21.15.98:0/1706817022 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+73 (secure 0 0 0) 0x7fa01409a070 con 0x7fa0200cf300 2024-09-16T15:38:06.604 INFO:teuthology.orchestra.run.smithi098.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-16T15:38:06.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:06.605+0000 7fa024b10640 1 -- 172.21.15.98:0/1706817022 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fa000078850 msgr2=0x7fa00007ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:06.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:06.605+0000 7fa024b10640 1 --2- 172.21.15.98:0/1706817022 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fa000078850 0x7fa00007ad10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa010006fd0 tx=0x7fa010008040 comp rx=0 tx=0).stop 2024-09-16T15:38:06.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:06.605+0000 7fa024b10640 1 -- 172.21.15.98:0/1706817022 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa0200cf300 msgr2=0x7fa0200cbd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:06.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:06.605+0000 7fa024b10640 1 --2- 172.21.15.98:0/1706817022 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa0200cf300 0x7fa0200cbd70 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa01400c450 tx=0x7fa01400c910 comp rx=0 tx=0).stop 2024-09-16T15:38:06.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:06.605+0000 7fa024b10640 1 -- 172.21.15.98:0/1706817022 shutdown_connections 2024-09-16T15:38:06.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:06.605+0000 7fa024b10640 1 --2- 172.21.15.98:0/1706817022 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa0201445d0 0x7fa0201408b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:06.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:06.605+0000 7fa024b10640 1 --2- 172.21.15.98:0/1706817022 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa0200cf300 0x7fa0200cbd70 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:06.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:06.605+0000 7fa024b10640 1 --2- 172.21.15.98:0/1706817022 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fa000078850 0x7fa00007ad10 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:06.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:06.605+0000 7fa024b10640 1 --2- 172.21.15.98:0/1706817022 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0200ccfd0 0x7fa0200c8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:06.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:06.605+0000 7fa024b10640 1 -- 172.21.15.98:0/1706817022 >> 172.21.15.98:0/1706817022 conn(0x7fa0200b1950 msgr2=0x7fa020072910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:06.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:06.605+0000 7fa024b10640 1 -- 172.21.15.98:0/1706817022 shutdown_connections 2024-09-16T15:38:06.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:06.605+0000 7fa024b10640 1 -- 172.21.15.98:0/1706817022 wait complete. 2024-09-16T15:38:06.617 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-16T15:38:06.617 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-16T15:38:06.617 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi135.front.sepia.ceph.com 2024-09-16T15:38:06.617 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-09-16T15:38:06.617 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-16T15:38:06.617 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-16T15:38:06.618 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-16T15:38:06.618 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-16T15:38:06.618 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-09-16T15:38:06.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T15:38:06.618 DEBUG:teuthology.orchestra.run.smithi135:> ip addr 2024-09-16T15:38:06.634 INFO:teuthology.orchestra.run.smithi135.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T15:38:06.634 INFO:teuthology.orchestra.run.smithi135.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T15:38:06.634 INFO:teuthology.orchestra.run.smithi135.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T15:38:06.634 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2024-09-16T15:38:06.634 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 ::1/128 scope host 2024-09-16T15:38:06.635 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2024-09-16T15:38:06.635 INFO:teuthology.orchestra.run.smithi135.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T15:38:06.635 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:d9:36:76 brd ff:ff:ff:ff:ff:ff 2024-09-16T15:38:06.635 INFO:teuthology.orchestra.run.smithi135.stdout: altname enp7s0f0 2024-09-16T15:38:06.635 INFO:teuthology.orchestra.run.smithi135.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T15:38:06.635 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:d9:36:77 brd ff:ff:ff:ff:ff:ff 2024-09-16T15:38:06.635 INFO:teuthology.orchestra.run.smithi135.stdout: altname enp7s0f1 2024-09-16T15:38:06.635 INFO:teuthology.orchestra.run.smithi135.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T15:38:06.635 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:88:80:82 brd ff:ff:ff:ff:ff:ff 2024-09-16T15:38:06.635 INFO:teuthology.orchestra.run.smithi135.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-16T15:38:06.635 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:88:80:83 brd ff:ff:ff:ff:ff:ff 2024-09-16T15:38:06.635 INFO:teuthology.orchestra.run.smithi135.stdout: inet 172.21.15.135/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-16T15:38:06.635 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft 42759sec preferred_lft 42759sec 2024-09-16T15:38:06.635 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 fe80::ec4:7aff:fe88:8083/64 scope link noprefixroute 2024-09-16T15:38:06.635 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2024-09-16T15:38:06.636 INFO:teuthology.orchestra.run.smithi135.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-16T15:38:06.636 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0e:3a:ee:d6:bf:3d brd ff:ff:ff:ff:ff:ff 2024-09-16T15:38:06.636 INFO:teuthology.orchestra.run.smithi135.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-16T15:38:06.636 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2024-09-16T15:38:06.636 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 fe80::7c19:bbff:fe16:bf9b/64 scope link 2024-09-16T15:38:06.636 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2024-09-16T15:38:06.636 INFO:teuthology.orchestra.run.smithi135.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T15:38:06.636 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0e:3a:ee:d6:bf:3d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-16T15:38:06.636 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 fe80::c3a:eeff:fed6:bf3d/64 scope link tentative 2024-09-16T15:38:06.636 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2024-09-16T15:38:06.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T15:38:06.636 DEBUG:teuthology.orchestra.run.smithi135:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-16T15:38:06.700 INFO:teuthology.orchestra.run.smithi135.stdout:1 2024-09-16T15:38:06.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T15:38:06.702 DEBUG:teuthology.orchestra.run.smithi135:> route 2024-09-16T15:38:06.758 INFO:teuthology.orchestra.run.smithi135.stdout:Kernel IP routing table 2024-09-16T15:38:06.759 INFO:teuthology.orchestra.run.smithi135.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-16T15:38:06.759 INFO:teuthology.orchestra.run.smithi135.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-16T15:38:06.759 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-16T15:38:06.759 INFO:teuthology.orchestra.run.smithi135.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-16T15:38:06.759 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T15:38:06.759 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2024-09-16T15:38:06.759 DEBUG:teuthology.orchestra.run.smithi135:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-16T15:38:06.759 DEBUG:teuthology.orchestra.run.smithi135:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-16T15:38:06.759 DEBUG:teuthology.orchestra.run.smithi135:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-16T15:38:06.759 DEBUG:teuthology.orchestra.run.smithi135:> ') 2024-09-16T15:38:06.847 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:38:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T15:38:06.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:38:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T15:38:06.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T15:38:06.886 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list 2024-09-16T15:38:06.901 INFO:teuthology.orchestra.run.smithi135.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-16T15:38:06.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T15:38:06.902 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list-id 2024-09-16T15:38:06.956 INFO:teuthology.orchestra.run.smithi135.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-09-16T15:38:06.956 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T15:38:06.956 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2024-09-16T15:38:06.956 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-16T15:38:06.956 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-09-16T15:38:06.956 DEBUG:teuthology.orchestra.run.smithi135:> ') 2024-09-16T15:38:07.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:38:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T15:38:07.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:38:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T15:38:07.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T15:38:07.073 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-16T15:38:07.097 INFO:teuthology.orchestra.run.smithi135.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T15:38:07.097 INFO:teuthology.orchestra.run.smithi135.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T15:38:07.097 INFO:teuthology.orchestra.run.smithi135.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T15:38:07.097 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2024-09-16T15:38:07.097 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 ::1/128 scope host 2024-09-16T15:38:07.097 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2024-09-16T15:38:07.097 INFO:teuthology.orchestra.run.smithi135.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-16T15:38:07.098 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether fa:ba:37:6e:0c:00 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-16T15:38:07.098 INFO:teuthology.orchestra.run.smithi135.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-16T15:38:07.098 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2024-09-16T15:38:07.098 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 fe80::f8ba:37ff:fe6e:c00/64 scope link 2024-09-16T15:38:07.098 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2024-09-16T15:38:07.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T15:38:07.099 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-16T15:38:07.163 INFO:teuthology.orchestra.run.smithi135.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T15:38:07.163 INFO:teuthology.orchestra.run.smithi135.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T15:38:07.163 INFO:teuthology.orchestra.run.smithi135.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T15:38:07.163 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2024-09-16T15:38:07.163 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 ::1/128 scope host 2024-09-16T15:38:07.163 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2024-09-16T15:38:07.164 INFO:teuthology.orchestra.run.smithi135.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-16T15:38:07.164 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether fa:ba:37:6e:0c:00 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-16T15:38:07.164 INFO:teuthology.orchestra.run.smithi135.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-16T15:38:07.164 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2024-09-16T15:38:07.164 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 fe80::f8ba:37ff:fe6e:c00/64 scope link 2024-09-16T15:38:07.164 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2024-09-16T15:38:07.165 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-09-16T15:38:07.165 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T15:38:07.165 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2024-09-16T15:38:07.165 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-09-16T15:38:07.165 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-16T15:38:07.165 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-09-16T15:38:07.165 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-09-16T15:38:07.165 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-09-16T15:38:07.165 DEBUG:teuthology.orchestra.run.smithi135:> ') 2024-09-16T15:38:07.253 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:38:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T15:38:07.311 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:38:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T15:38:07.317 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T15:38:07.317 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2024-09-16T15:38:07.317 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link set brx.1 up 2024-09-16T15:38:07.317 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link set dev brx.1 master ceph-brx 2024-09-16T15:38:07.317 DEBUG:teuthology.orchestra.run.smithi135:> ') 2024-09-16T15:38:07.365 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:38:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T15:38:07.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:38:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T15:38:07.394 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T15:38:07.395 DEBUG:teuthology.orchestra.run.smithi135:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-09-16T15:38:07.409 INFO:teuthology.orchestra.run.smithi135.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-09-16T15:38:07.409 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T15:38:07.409 DEBUG:teuthology.orchestra.run.smithi135:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-09-16T15:38:07.465 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-16T15:38:07.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T15:38:07.465 DEBUG:teuthology.orchestra.run.smithi135:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-16T15:38:07.548 INFO:teuthology.orchestra.run.smithi135.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-16T15:38:07.548 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-09-16T15:38:07.548 INFO:teuthology.orchestra.run.smithi135.stdout:invalid new device string format 2024-09-16T15:38:07.557 INFO:teuthology.orchestra.run.smithi135.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-16T15:38:07.557 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-09-16T15:38:07.557 INFO:teuthology.orchestra.run.smithi135.stdout:invalid new device string format 2024-09-16T15:38:07.557 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: resolved to: "172.21.15.98:3300,172.21.15.135:3300,172.21.15.135:3301" 2024-09-16T15:38:07.557 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T15:38:07.575 INFO:teuthology.orchestra.run.smithi135.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-16T15:38:07.575 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-09-16T15:38:07.575 INFO:teuthology.orchestra.run.smithi135.stdout:invalid new device string format 2024-09-16T15:38:07.575 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: resolved to: "172.21.15.98:3300,172.21.15.135:3300,172.21.15.135:3301" 2024-09-16T15:38:07.575 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T15:38:07.575 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: resolved to: "172.21.15.98:6789,172.21.15.135:6789,172.21.15.135:6790" 2024-09-16T15:38:07.576 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.98:6789,172.21.15.135:6789,172.21.15.135:6790:/ 2024-09-16T15:38:07.576 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=52a38a45-21d2-4cb0-bb3a-4fb8be3a08df" will pass to kernel 2024-09-16T15:38:07.576 INFO:teuthology.orchestra.run.smithi135.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-09-16T15:38:07.576 INFO:teuthology.orchestra.run.smithi135.stdout: You just mounted a file system that supports labels which does not 2024-09-16T15:38:07.576 INFO:teuthology.orchestra.run.smithi135.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-16T15:38:07.576 INFO:teuthology.orchestra.run.smithi135.stdout: applications will generate AVC messages and not be allowed access to 2024-09-16T15:38:07.576 INFO:teuthology.orchestra.run.smithi135.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-16T15:38:07.577 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-16T15:38:07.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T15:38:07.577 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-09-16T15:38:07.643 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T15:38:07.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:38:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T15:38:07.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:38:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T15:38:07.739 INFO:teuthology.orchestra.run.smithi135.stdout:client4678 2024-09-16T15:38:07.739 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-16T15:38:07.740 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T15:38:07.755 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T15:38:07.843 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:38:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T15:38:07.845 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:38:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T15:38:07.850 INFO:teuthology.orchestra.run.smithi135.stdout:client4678 2024-09-16T15:38:07.851 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T15:38:07.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:38:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T15:38:07.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:38:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T15:38:07.906 INFO:teuthology.orchestra.run.smithi135.stdout:client4678 2024-09-16T15:38:07.906 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/52a38a45-21d2-4cb0-bb3a-4fb8be3a08df.client4678/status') 2024-09-16T15:38:07.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:38:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T15:38:07.963 INFO:teuthology.orchestra.run.smithi135.stdout:instance: client.4678 (3)192.168.0.2:0/2903065885 2024-09-16T15:38:07.964 INFO:teuthology.orchestra.run.smithi135.stdout:blocklisted: false 2024-09-16T15:38:07.964 INFO:teuthology.orchestra.run.smithi135.stderr:0+1 records in 2024-09-16T15:38:07.964 INFO:teuthology.orchestra.run.smithi135.stderr:0+1 records out 2024-09-16T15:38:07.964 INFO:teuthology.orchestra.run.smithi135.stderr:69 bytes copied, 2.1345e-05 s, 3.2 MB/s 2024-09-16T15:38:07.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:38:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T15:38:07.971 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-16T15:38:07.982 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-09-16T15:38:08.075 INFO:tasks.cephfs_test_runner:Starting test: test_volumes_module_finisher_thread (tasks.cephfs.test_volumes.TestPerModuleFinsherThread) 2024-09-16T15:38:08.075 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T15:38:08.189 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.188+0000 7f59e3191640 1 -- 172.21.15.98:0/1929739881 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f59dc0d2050 msgr2=0x7f59dc0d10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:08.189 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.188+0000 7f59e3191640 1 --2- 172.21.15.98:0/1929739881 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f59dc0d2050 0x7f59dc0d10d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f59dc0d1df0 tx=0x7f59c802a5f0 comp rx=0 tx=0).stop 2024-09-16T15:38:08.189 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.188+0000 7f59e3191640 1 -- 172.21.15.98:0/1929739881 shutdown_connections 2024-09-16T15:38:08.189 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.188+0000 7f59e3191640 1 --2- 172.21.15.98:0/1929739881 >> v2:172.21.15.135:3300/0 conn(0x7f59dc0d1610 0x7f59dc0cecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:08.189 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.188+0000 7f59e3191640 1 --2- 172.21.15.98:0/1929739881 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f59dc0d2050 0x7f59dc0d10d0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:08.189 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.188+0000 7f59e3191640 1 -- 172.21.15.98:0/1929739881 >> 172.21.15.98:0/1929739881 conn(0x7f59dc0d3fe0 msgr2=0x7f59dc0d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:08.189 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.188+0000 7f59e3191640 1 -- 172.21.15.98:0/1929739881 shutdown_connections 2024-09-16T15:38:08.189 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.188+0000 7f59e3191640 1 -- 172.21.15.98:0/1929739881 wait complete. 2024-09-16T15:38:08.190 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.189+0000 7f59e3191640 1 Processor -- start 2024-09-16T15:38:08.190 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.189+0000 7f59e3191640 1 -- start start 2024-09-16T15:38:08.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.190+0000 7f59e3191640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f59dc0d1610 0x7f59dc1f5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:08.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.190+0000 7f59e3191640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f59dc0d2050 0x7f59dc09de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:08.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.190+0000 7f59e3191640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59dc15e0d0 0x7f59dc09e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:08.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.190+0000 7f59e3191640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f59dc0cf610 con 0x7f59dc0d2050 2024-09-16T15:38:08.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.190+0000 7f59e3191640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f59dc0cf490 con 0x7f59dc15e0d0 2024-09-16T15:38:08.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.190+0000 7f59e3191640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f59dc0cf790 con 0x7f59dc0d1610 2024-09-16T15:38:08.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.190+0000 7f59dbfff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f59dc0d2050 0x7f59dc09de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:08.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.190+0000 7f59dbfff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f59dc0d2050 0x7f59dc09de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54546/0 (socket says 172.21.15.98:54546) 2024-09-16T15:38:08.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.190+0000 7f59dbfff640 1 -- 172.21.15.98:0/2580266560 learned_addr learned my addr 172.21.15.98:0/2580266560 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:08.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.190+0000 7f59e0f2d640 1 --2- 172.21.15.98:0/2580266560 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f59dc0d1610 0x7f59dc1f5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:08.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.190+0000 7f59e172e640 1 --2- 172.21.15.98:0/2580266560 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59dc15e0d0 0x7f59dc09e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:08.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.190+0000 7f59dbfff640 1 -- 172.21.15.98:0/2580266560 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f59dc0d1610 msgr2=0x7f59dc1f5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:08.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.190+0000 7f59dbfff640 1 --2- 172.21.15.98:0/2580266560 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f59dc0d1610 0x7f59dc1f5670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:08.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.190+0000 7f59dbfff640 1 -- 172.21.15.98:0/2580266560 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59dc15e0d0 msgr2=0x7f59dc09e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:08.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.190+0000 7f59dbfff640 1 --2- 172.21.15.98:0/2580266560 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59dc15e0d0 0x7f59dc09e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:08.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.190+0000 7f59dbfff640 1 -- 172.21.15.98:0/2580266560 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59dc1f5000 con 0x7f59dc0d2050 2024-09-16T15:38:08.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.190+0000 7f59e172e640 1 --2- 172.21.15.98:0/2580266560 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59dc15e0d0 0x7f59dc09e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T15:38:08.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.190+0000 7f59dbfff640 1 --2- 172.21.15.98:0/2580266560 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f59dc0d2050 0x7f59dc09de40 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f59c80099c0 tx=0x7f59c80039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:08.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.191+0000 7f59d97fa640 1 -- 172.21.15.98:0/2580266560 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59c803f070 con 0x7f59dc0d2050 2024-09-16T15:38:08.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.191+0000 7f59d97fa640 1 -- 172.21.15.98:0/2580266560 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f59c8004890 con 0x7f59dc0d2050 2024-09-16T15:38:08.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.191+0000 7f59e3191640 1 -- 172.21.15.98:0/2580266560 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59dc0a0a30 con 0x7f59dc0d2050 2024-09-16T15:38:08.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.191+0000 7f59d97fa640 1 -- 172.21.15.98:0/2580266560 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59c8035030 con 0x7f59dc0d2050 2024-09-16T15:38:08.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.191+0000 7f59e3191640 1 -- 172.21.15.98:0/2580266560 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59dc0a0ff0 con 0x7f59dc0d2050 2024-09-16T15:38:08.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.192+0000 7f59e3191640 1 -- 172.21.15.98:0/2580266560 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59dc0cfcb0 con 0x7f59dc0d2050 2024-09-16T15:38:08.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.192+0000 7f59d97fa640 1 -- 172.21.15.98:0/2580266560 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7f59c8042070 con 0x7f59dc0d2050 2024-09-16T15:38:08.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.193+0000 7f59d97fa640 1 --2- 172.21.15.98:0/2580266560 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f59c0078850 0x7f59c007ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:08.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.193+0000 7f59d97fa640 1 -- 172.21.15.98:0/2580266560 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f59c80bb780 con 0x7f59dc0d2050 2024-09-16T15:38:08.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.193+0000 7f59e0f2d640 1 --2- 172.21.15.98:0/2580266560 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f59c0078850 0x7f59c007ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:08.195 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.194+0000 7f59e0f2d640 1 --2- 172.21.15.98:0/2580266560 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f59c0078850 0x7f59c007ad10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f59d0007fd0 tx=0x7f59d0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:08.198 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.197+0000 7f59d97fa640 1 -- 172.21.15.98:0/2580266560 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7f59c8083df0 con 0x7f59dc0d2050 2024-09-16T15:38:08.375 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.374+0000 7f59e3191640 1 -- 172.21.15.98:0/2580266560 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f59dc0cefe0 con 0x7f59dc0d2050 2024-09-16T15:38:08.376 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.375+0000 7f59d97fa640 1 -- 172.21.15.98:0/2580266560 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16681 (secure 0 0 0) 0x7f59c80836f0 con 0x7f59dc0d2050 2024-09-16T15:38:08.377 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:38:08.377 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":23,"fsid":"52a38a45-21d2-4cb0-bb3a-4fb8be3a08df","created":"2024-09-16T15:37:20.387654+0000","modified":"2024-09-16T15:37:45.512714+0000","last_up_change":"2024-09-16T15:37:33.417470+0000","last_in_change":"2024-09-16T15:37:23.430578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T15:37:34.725090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-16T15:37:42.223874+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-16T15:37:42.808291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a2d61df4-2577-47e6-a4ac-c36bbb85ab8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1967099790},{"type":"v1","addr":"172.21.15.98:6825","nonce":1967099790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1967099790},{"type":"v1","addr":"172.21.15.98:6827","nonce":1967099790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":1967099790},{"type":"v1","addr":"172.21.15.98:6831","nonce":1967099790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1967099790},{"type":"v1","addr":"172.21.15.98:6829","nonce":1967099790}]},"public_addr":"172.21.15.98:6825/1967099790","cluster_addr":"172.21.15.98:6827/1967099790","heartbeat_back_addr":"172.21.15.98:6831/1967099790","heartbeat_front_addr":"172.21.15.98:6829/1967099790","state":["exists","up"]},{"osd":1,"uuid":"bb3a68a5-c22f-442b-b292-7c272fe01ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":3571460482},{"type":"v1","addr":"172.21.15.98:6809","nonce":3571460482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":3571460482},{"type":"v1","addr":"172.21.15.98:6811","nonce":3571460482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":3571460482},{"type":"v1","addr":"172.21.15.98:6815","nonce":3571460482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":3571460482},{"type":"v1","addr":"172.21.15.98:6813","nonce":3571460482}]},"public_addr":"172.21.15.98:6809/3571460482","cluster_addr":"172.21.15.98:6811/3571460482","heartbeat_back_addr":"172.21.15.98:6815/3571460482","heartbeat_front_addr":"172.21.15.98:6813/3571460482","state":["exists","up"]},{"osd":2,"uuid":"c8429195-a480-409b-8e5f-8dc4c6abc0a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":2573210695},{"type":"v1","addr":"172.21.15.98:6801","nonce":2573210695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":2573210695},{"type":"v1","addr":"172.21.15.98:6803","nonce":2573210695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":2573210695},{"type":"v1","addr":"172.21.15.98:6807","nonce":2573210695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":2573210695},{"type":"v1","addr":"172.21.15.98:6805","nonce":2573210695}]},"public_addr":"172.21.15.98:6801/2573210695","cluster_addr":"172.21.15.98:6803/2573210695","heartbeat_back_addr":"172.21.15.98:6807/2573210695","heartbeat_front_addr":"172.21.15.98:6805/2573210695","state":["exists","up"]},{"osd":3,"uuid":"0e800d7b-096f-4f65-b3cc-c7cda3870de4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":3951374837},{"type":"v1","addr":"172.21.15.98:6817","nonce":3951374837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":3951374837},{"type":"v1","addr":"172.21.15.98:6819","nonce":3951374837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":3951374837},{"type":"v1","addr":"172.21.15.98:6823","nonce":3951374837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":3951374837},{"type":"v1","addr":"172.21.15.98:6821","nonce":3951374837}]},"public_addr":"172.21.15.98:6817/3951374837","cluster_addr":"172.21.15.98:6819/3951374837","heartbeat_back_addr":"172.21.15.98:6823/3951374837","heartbeat_front_addr":"172.21.15.98:6821/3951374837","state":["exists","up"]},{"osd":4,"uuid":"c7822e9b-8e29-48d9-b92a-e8f9c7bc5247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":724302036},{"type":"v1","addr":"172.21.15.135:6811","nonce":724302036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":724302036},{"type":"v1","addr":"172.21.15.135:6813","nonce":724302036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":724302036},{"type":"v1","addr":"172.21.15.135:6817","nonce":724302036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":724302036},{"type":"v1","addr":"172.21.15.135:6815","nonce":724302036}]},"public_addr":"172.21.15.135:6811/724302036","cluster_addr":"172.21.15.135:6813/724302036","heartbeat_back_addr":"172.21.15.135:6817/724302036","heartbeat_front_addr":"172.21.15.135:6815/724302036","state":["exists","up"]},{"osd":5,"uuid":"35805e02-484a-4404-a78f-aa44f4daa41f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3083482635},{"type":"v1","addr":"172.21.15.135:6803","nonce":3083482635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3083482635},{"type":"v1","addr":"172.21.15.135:6805","nonce":3083482635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3083482635},{"type":"v1","addr":"172.21.15.135:6809","nonce":3083482635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3083482635},{"type":"v1","addr":"172.21.15.135:6807","nonce":3083482635}]},"public_addr":"172.21.15.135:6803/3083482635","cluster_addr":"172.21.15.135:6805/3083482635","heartbeat_back_addr":"172.21.15.135:6809/3083482635","heartbeat_front_addr":"172.21.15.135:6807/3083482635","state":["exists","up"]},{"osd":6,"uuid":"6327ba84-aaeb-41fa-9717-188988ff2c4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3376376340},{"type":"v1","addr":"172.21.15.135:6819","nonce":3376376340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3376376340},{"type":"v1","addr":"172.21.15.135:6821","nonce":3376376340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":3376376340},{"type":"v1","addr":"172.21.15.135:6825","nonce":3376376340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3376376340},{"type":"v1","addr":"172.21.15.135:6823","nonce":3376376340}]},"public_addr":"172.21.15.135:6819/3376376340","cluster_addr":"172.21.15.135:6821/3376376340","heartbeat_back_addr":"172.21.15.135:6825/3376376340","heartbeat_front_addr":"172.21.15.135:6823/3376376340","state":["exists","up"]},{"osd":7,"uuid":"392d0958-dff9-4248-b3d8-a1201c10f354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2559837727},{"type":"v1","addr":"172.21.15.135:6827","nonce":2559837727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2559837727},{"type":"v1","addr":"172.21.15.135:6829","nonce":2559837727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":2559837727},{"type":"v1","addr":"172.21.15.135:6833","nonce":2559837727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2559837727},{"type":"v1","addr":"172.21.15.135:6831","nonce":2559837727}]},"public_addr":"172.21.15.135:6827/2559837727","cluster_addr":"172.21.15.135:6829/2559837727","heartbeat_back_addr":"172.21.15.135:6833/2559837727","heartbeat_front_addr":"172.21.15.135:6831/2559837727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.939904+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.717296+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.785817+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:30.211718+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.973359+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:30.250109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.699327+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:30.173063+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T15:38:08.379 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.378+0000 7f59e3191640 1 -- 172.21.15.98:0/2580266560 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f59c0078850 msgr2=0x7f59c007ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:08.379 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.378+0000 7f59e3191640 1 --2- 172.21.15.98:0/2580266560 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f59c0078850 0x7f59c007ad10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f59d0007fd0 tx=0x7f59d0009040 comp rx=0 tx=0).stop 2024-09-16T15:38:08.379 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.378+0000 7f59e3191640 1 -- 172.21.15.98:0/2580266560 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f59dc0d2050 msgr2=0x7f59dc09de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:08.379 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.378+0000 7f59e3191640 1 --2- 172.21.15.98:0/2580266560 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f59dc0d2050 0x7f59dc09de40 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f59c80099c0 tx=0x7f59c80039e0 comp rx=0 tx=0).stop 2024-09-16T15:38:08.379 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.378+0000 7f59e3191640 1 -- 172.21.15.98:0/2580266560 shutdown_connections 2024-09-16T15:38:08.379 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.378+0000 7f59e3191640 1 --2- 172.21.15.98:0/2580266560 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f59c0078850 0x7f59c007ad10 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:08.379 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.378+0000 7f59e3191640 1 --2- 172.21.15.98:0/2580266560 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59dc15e0d0 0x7f59dc09e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:08.380 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.378+0000 7f59e3191640 1 --2- 172.21.15.98:0/2580266560 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f59dc0d2050 0x7f59dc09de40 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:08.380 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.378+0000 7f59e3191640 1 --2- 172.21.15.98:0/2580266560 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f59dc0d1610 0x7f59dc1f5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:08.380 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.378+0000 7f59e3191640 1 -- 172.21.15.98:0/2580266560 >> 172.21.15.98:0/2580266560 conn(0x7f59dc0d3fe0 msgr2=0x7f59dc0d09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:08.380 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.378+0000 7f59e3191640 1 -- 172.21.15.98:0/2580266560 shutdown_connections 2024-09-16T15:38:08.380 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.378+0000 7f59e3191640 1 -- 172.21.15.98:0/2580266560 wait complete. 2024-09-16T15:38:08.390 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-16T15:37:34.725090+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-16T15:37:42.223874+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-16T15:37:42.808291+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-16T15:38:08.390 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-16T15:38:08.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.493+0000 7fa8993c6640 1 -- 172.21.15.98:0/1147320020 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa8940d13e0 msgr2=0x7fa894161de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:08.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.493+0000 7fa8993c6640 1 --2- 172.21.15.98:0/1147320020 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa8940d13e0 0x7fa894161de0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa89408e660 tx=0x7fa87c02a530 comp rx=0 tx=0).stop 2024-09-16T15:38:08.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.493+0000 7fa8993c6640 1 -- 172.21.15.98:0/1147320020 shutdown_connections 2024-09-16T15:38:08.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.493+0000 7fa8993c6640 1 --2- 172.21.15.98:0/1147320020 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa8940d13e0 0x7fa894161de0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:08.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.493+0000 7fa8993c6640 1 --2- 172.21.15.98:0/1147320020 >> v2:172.21.15.135:3300/0 conn(0x7fa894161800 0x7fa8940d4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:08.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.493+0000 7fa8993c6640 1 -- 172.21.15.98:0/1147320020 >> 172.21.15.98:0/1147320020 conn(0x7fa8940d3fe0 msgr2=0x7fa8940d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:08.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.493+0000 7fa8993c6640 1 -- 172.21.15.98:0/1147320020 shutdown_connections 2024-09-16T15:38:08.495 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.493+0000 7fa8993c6640 1 -- 172.21.15.98:0/1147320020 wait complete. 2024-09-16T15:38:08.495 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.494+0000 7fa8993c6640 1 Processor -- start 2024-09-16T15:38:08.495 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.494+0000 7fa8993c6640 1 -- start start 2024-09-16T15:38:08.497 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.495+0000 7fa8993c6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa8940b4fa0 0x7fa8940b2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:08.497 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.495+0000 7fa8993c6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8940d13e0 0x7fa89414d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:08.497 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.495+0000 7fa8993c6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa894161800 0x7fa8940cdc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:08.497 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.495+0000 7fa8993c6640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa8941626b0 con 0x7fa894161800 2024-09-16T15:38:08.497 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.495+0000 7fa8993c6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa894162530 con 0x7fa8940d13e0 2024-09-16T15:38:08.497 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.495+0000 7fa8993c6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fa8940b3330 con 0x7fa8940b4fa0 2024-09-16T15:38:08.497 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.495+0000 7fa8937fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa894161800 0x7fa8940cdc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:08.497 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.495+0000 7fa8937fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa894161800 0x7fa8940cdc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54564/0 (socket says 172.21.15.98:54564) 2024-09-16T15:38:08.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.495+0000 7fa8937fe640 1 -- 172.21.15.98:0/1706041450 learned_addr learned my addr 172.21.15.98:0/1706041450 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:08.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.495+0000 7fa892ffd640 1 --2- 172.21.15.98:0/1706041450 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa8940b4fa0 0x7fa8940b2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:08.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.495+0000 7fa8927fc640 1 --2- 172.21.15.98:0/1706041450 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8940d13e0 0x7fa89414d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:08.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.495+0000 7fa8937fe640 1 -- 172.21.15.98:0/1706041450 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa8940b4fa0 msgr2=0x7fa8940b2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:08.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.495+0000 7fa8937fe640 1 --2- 172.21.15.98:0/1706041450 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa8940b4fa0 0x7fa8940b2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:08.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.495+0000 7fa8937fe640 1 -- 172.21.15.98:0/1706041450 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8940d13e0 msgr2=0x7fa89414d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:08.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.495+0000 7fa8937fe640 1 --2- 172.21.15.98:0/1706041450 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8940d13e0 0x7fa89414d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:08.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.495+0000 7fa8937fe640 1 -- 172.21.15.98:0/1706041450 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8940b0ff0 con 0x7fa894161800 2024-09-16T15:38:08.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.495+0000 7fa8927fc640 1 --2- 172.21.15.98:0/1706041450 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8940d13e0 0x7fa89414d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T15:38:08.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.496+0000 7fa8937fe640 1 --2- 172.21.15.98:0/1706041450 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa894161800 0x7fa8940cdc30 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa88c00c3f0 tx=0x7fa88c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:08.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.496+0000 7fa88b7fe640 1 -- 172.21.15.98:0/1706041450 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa88c011790 con 0x7fa894161800 2024-09-16T15:38:08.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.496+0000 7fa88b7fe640 1 -- 172.21.15.98:0/1706041450 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa88c017070 con 0x7fa894161800 2024-09-16T15:38:08.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.496+0000 7fa8993c6640 1 -- 172.21.15.98:0/1706041450 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8940b12d0 con 0x7fa894161800 2024-09-16T15:38:08.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.496+0000 7fa88b7fe640 1 -- 172.21.15.98:0/1706041450 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa88c011cc0 con 0x7fa894161800 2024-09-16T15:38:08.499 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.496+0000 7fa8993c6640 1 -- 172.21.15.98:0/1706041450 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8940b1890 con 0x7fa894161800 2024-09-16T15:38:08.499 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.497+0000 7fa8993c6640 1 -- 172.21.15.98:0/1706041450 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa894161de0 con 0x7fa894161800 2024-09-16T15:38:08.499 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.497+0000 7fa88b7fe640 1 -- 172.21.15.98:0/1706041450 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7fa88c01c460 con 0x7fa894161800 2024-09-16T15:38:08.500 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.498+0000 7fa88b7fe640 1 --2- 172.21.15.98:0/1706041450 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fa874078850 0x7fa87407ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:08.500 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.498+0000 7fa88b7fe640 1 -- 172.21.15.98:0/1706041450 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fa88c09a600 con 0x7fa894161800 2024-09-16T15:38:08.500 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.498+0000 7fa892ffd640 1 --2- 172.21.15.98:0/1706041450 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fa874078850 0x7fa87407ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:08.500 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.498+0000 7fa892ffd640 1 --2- 172.21.15.98:0/1706041450 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fa874078850 0x7fa87407ad10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa884005fd0 tx=0x7fa884009660 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:08.503 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.502+0000 7fa88b7fe640 1 -- 172.21.15.98:0/1706041450 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7fa88c062c80 con 0x7fa894161800 2024-09-16T15:38:08.680 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.679+0000 7fa8993c6640 1 -- 172.21.15.98:0/1706041450 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa8940d2260 con 0x7fa894161800 2024-09-16T15:38:08.681 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.680+0000 7fa88b7fe640 1 -- 172.21.15.98:0/1706041450 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) ==== 93+0+10 (secure 0 0 0) 0x7fa88c062580 con 0x7fa894161800 2024-09-16T15:38:08.681 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 1 2024-09-16T15:38:08.683 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.682+0000 7fa8993c6640 1 -- 172.21.15.98:0/1706041450 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fa874078850 msgr2=0x7fa87407ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:08.683 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.682+0000 7fa8993c6640 1 --2- 172.21.15.98:0/1706041450 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fa874078850 0x7fa87407ad10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa884005fd0 tx=0x7fa884009660 comp rx=0 tx=0).stop 2024-09-16T15:38:08.683 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.682+0000 7fa8993c6640 1 -- 172.21.15.98:0/1706041450 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa894161800 msgr2=0x7fa8940cdc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:08.683 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.682+0000 7fa8993c6640 1 --2- 172.21.15.98:0/1706041450 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa894161800 0x7fa8940cdc30 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa88c00c3f0 tx=0x7fa88c00c8b0 comp rx=0 tx=0).stop 2024-09-16T15:38:08.683 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.682+0000 7fa8993c6640 1 -- 172.21.15.98:0/1706041450 shutdown_connections 2024-09-16T15:38:08.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.682+0000 7fa8993c6640 1 --2- 172.21.15.98:0/1706041450 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa894161800 0x7fa8940cdc30 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:08.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.682+0000 7fa8993c6640 1 --2- 172.21.15.98:0/1706041450 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fa874078850 0x7fa87407ad10 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:08.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.682+0000 7fa8993c6640 1 --2- 172.21.15.98:0/1706041450 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8940d13e0 0x7fa89414d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:08.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.682+0000 7fa8993c6640 1 --2- 172.21.15.98:0/1706041450 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa8940b4fa0 0x7fa8940b2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:08.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.682+0000 7fa8993c6640 1 -- 172.21.15.98:0/1706041450 >> 172.21.15.98:0/1706041450 conn(0x7fa8940d3fe0 msgr2=0x7fa8940b4010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:08.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.682+0000 7fa8993c6640 1 -- 172.21.15.98:0/1706041450 shutdown_connections 2024-09-16T15:38:08.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.682+0000 7fa8993c6640 1 -- 172.21.15.98:0/1706041450 wait complete. 2024-09-16T15:38:08.694 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-16T15:38:08.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.797+0000 7fde4f06a640 1 -- 172.21.15.98:0/3287165026 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde480cf630 msgr2=0x7fde480cfae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:08.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.797+0000 7fde4f06a640 1 --2- 172.21.15.98:0/3287165026 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde480cf630 0x7fde480cfae0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fde4808e020 tx=0x7fde4002a560 comp rx=0 tx=0).stop 2024-09-16T15:38:08.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.797+0000 7fde4f06a640 1 -- 172.21.15.98:0/3287165026 shutdown_connections 2024-09-16T15:38:08.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.797+0000 7fde4f06a640 1 --2- 172.21.15.98:0/3287165026 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde480cf630 0x7fde480cfae0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:08.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.797+0000 7fde4f06a640 1 --2- 172.21.15.98:0/3287165026 >> v2:172.21.15.135:3300/0 conn(0x7fde481614e0 0x7fde480d4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:08.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.797+0000 7fde4f06a640 1 -- 172.21.15.98:0/3287165026 >> 172.21.15.98:0/3287165026 conn(0x7fde480d40a0 msgr2=0x7fde480d44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:08.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.797+0000 7fde4f06a640 1 -- 172.21.15.98:0/3287165026 shutdown_connections 2024-09-16T15:38:08.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.797+0000 7fde4f06a640 1 -- 172.21.15.98:0/3287165026 wait complete. 2024-09-16T15:38:08.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.798+0000 7fde4f06a640 1 Processor -- start 2024-09-16T15:38:08.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.798+0000 7fde4f06a640 1 -- start start 2024-09-16T15:38:08.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.799+0000 7fde4f06a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde480cf630 0x7fde4815c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:08.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.799+0000 7fde4f06a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde481614e0 0x7fde480cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:08.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.799+0000 7fde4f06a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde481618c0 0x7fde481564f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:08.802 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.799+0000 7fde4f06a640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fde480d24e0 con 0x7fde480cf630 2024-09-16T15:38:08.802 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.799+0000 7fde4f06a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fde480d2360 con 0x7fde481618c0 2024-09-16T15:38:08.802 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.799+0000 7fde4f06a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fde480d2660 con 0x7fde481614e0 2024-09-16T15:38:08.802 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.799+0000 7fde4ce06640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde480cf630 0x7fde4815c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:08.802 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.799+0000 7fde4ce06640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde480cf630 0x7fde4815c750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54580/0 (socket says 172.21.15.98:54580) 2024-09-16T15:38:08.802 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.799+0000 7fde4ce06640 1 -- 172.21.15.98:0/2196707311 learned_addr learned my addr 172.21.15.98:0/2196707311 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:08.802 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.799+0000 7fde4d607640 1 --2- 172.21.15.98:0/2196707311 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde481618c0 0x7fde481564f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:08.802 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.799+0000 7fde47fff640 1 --2- 172.21.15.98:0/2196707311 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde481614e0 0x7fde480cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:08.802 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.800+0000 7fde4ce06640 1 -- 172.21.15.98:0/2196707311 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde481614e0 msgr2=0x7fde480cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:08.802 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.800+0000 7fde4ce06640 1 --2- 172.21.15.98:0/2196707311 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde481614e0 0x7fde480cdba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:08.802 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.800+0000 7fde4ce06640 1 -- 172.21.15.98:0/2196707311 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde481618c0 msgr2=0x7fde481564f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:08.802 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.800+0000 7fde4ce06640 1 --2- 172.21.15.98:0/2196707311 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde481618c0 0x7fde481564f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:08.802 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.800+0000 7fde4ce06640 1 -- 172.21.15.98:0/2196707311 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde4815cdd0 con 0x7fde480cf630 2024-09-16T15:38:08.803 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.800+0000 7fde4ce06640 1 --2- 172.21.15.98:0/2196707311 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde480cf630 0x7fde4815c750 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fde3800c970 tx=0x7fde3800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:08.803 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.800+0000 7fde457fa640 1 -- 172.21.15.98:0/2196707311 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde38007bb0 con 0x7fde480cf630 2024-09-16T15:38:08.803 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.800+0000 7fde457fa640 1 -- 172.21.15.98:0/2196707311 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fde38007e40 con 0x7fde480cf630 2024-09-16T15:38:08.803 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.800+0000 7fde457fa640 1 -- 172.21.15.98:0/2196707311 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde38005290 con 0x7fde480cf630 2024-09-16T15:38:08.803 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.800+0000 7fde4f06a640 1 -- 172.21.15.98:0/2196707311 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde4815d0b0 con 0x7fde480cf630 2024-09-16T15:38:08.803 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.800+0000 7fde4f06a640 1 -- 172.21.15.98:0/2196707311 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde480cb630 con 0x7fde480cf630 2024-09-16T15:38:08.804 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.801+0000 7fde4f06a640 1 -- 172.21.15.98:0/2196707311 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde480cb150 con 0x7fde480cf630 2024-09-16T15:38:08.804 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.802+0000 7fde457fa640 1 -- 172.21.15.98:0/2196707311 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7fde380054f0 con 0x7fde480cf630 2024-09-16T15:38:08.804 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.802+0000 7fde457fa640 1 --2- 172.21.15.98:0/2196707311 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fde28078850 0x7fde2807ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:08.804 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.802+0000 7fde457fa640 1 -- 172.21.15.98:0/2196707311 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fde3809b100 con 0x7fde480cf630 2024-09-16T15:38:08.804 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.802+0000 7fde47fff640 1 --2- 172.21.15.98:0/2196707311 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fde28078850 0x7fde2807ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:08.804 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.803+0000 7fde47fff640 1 --2- 172.21.15.98:0/2196707311 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fde28078850 0x7fde2807ad10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fde480b9ff0 tx=0x7fde3000d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:08.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.808+0000 7fde457fa640 1 -- 172.21.15.98:0/2196707311 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7fde38014070 con 0x7fde480cf630 2024-09-16T15:38:08.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.985+0000 7fde4f06a640 1 -- 172.21.15.98:0/2196707311 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fde480cfae0 con 0x7fde480cf630 2024-09-16T15:38:08.987 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.986+0000 7fde457fa640 1 -- 172.21.15.98:0/2196707311 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) ==== 104+0+11 (secure 0 0 0) 0x7fde38063120 con 0x7fde480cf630 2024-09-16T15:38:08.987 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 32 2024-09-16T15:38:08.989 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.988+0000 7fde4f06a640 1 -- 172.21.15.98:0/2196707311 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fde28078850 msgr2=0x7fde2807ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:08.989 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.988+0000 7fde4f06a640 1 --2- 172.21.15.98:0/2196707311 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fde28078850 0x7fde2807ad10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fde480b9ff0 tx=0x7fde3000d040 comp rx=0 tx=0).stop 2024-09-16T15:38:08.989 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.988+0000 7fde4f06a640 1 -- 172.21.15.98:0/2196707311 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde480cf630 msgr2=0x7fde4815c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:08.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.988+0000 7fde4f06a640 1 --2- 172.21.15.98:0/2196707311 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde480cf630 0x7fde4815c750 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fde3800c970 tx=0x7fde3800ce30 comp rx=0 tx=0).stop 2024-09-16T15:38:08.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.988+0000 7fde4f06a640 1 -- 172.21.15.98:0/2196707311 shutdown_connections 2024-09-16T15:38:08.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.988+0000 7fde4f06a640 1 --2- 172.21.15.98:0/2196707311 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fde28078850 0x7fde2807ad10 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:08.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.988+0000 7fde4f06a640 1 --2- 172.21.15.98:0/2196707311 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde481618c0 0x7fde481564f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:08.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.988+0000 7fde4f06a640 1 --2- 172.21.15.98:0/2196707311 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fde481614e0 0x7fde480cdba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:08.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.988+0000 7fde4f06a640 1 --2- 172.21.15.98:0/2196707311 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde480cf630 0x7fde4815c750 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:08.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.988+0000 7fde4f06a640 1 -- 172.21.15.98:0/2196707311 >> 172.21.15.98:0/2196707311 conn(0x7fde480d40a0 msgr2=0x7fde4806e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:08.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.988+0000 7fde4f06a640 1 -- 172.21.15.98:0/2196707311 shutdown_connections 2024-09-16T15:38:08.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:08.988+0000 7fde4f06a640 1 -- 172.21.15.98:0/2196707311 wait complete. 2024-09-16T15:38:09.000 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-16T15:38:09.104 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.103+0000 7f5fb67e8640 1 -- 172.21.15.98:0/3969267914 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f98003a30 msgr2=0x7f5f98003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:09.104 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.103+0000 7f5fb67e8640 1 --2- 172.21.15.98:0/3969267914 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f98003a30 0x7f5f98003e50 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5fa0009b50 tx=0x7f5f98005830 comp rx=0 tx=0).stop 2024-09-16T15:38:09.104 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.103+0000 7f5fb4d85640 1 -- 172.21.15.98:0/3969267914 reap_dead start 2024-09-16T15:38:09.104 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.103+0000 7f5fb67e8640 1 -- 172.21.15.98:0/3969267914 shutdown_connections 2024-09-16T15:38:09.105 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.103+0000 7f5fb67e8640 1 -- 172.21.15.98:0/3969267914 >> 172.21.15.98:0/3969267914 conn(0x7f5fb00d1e20 msgr2=0x7f5fb00d2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:09.105 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.103+0000 7f5fb67e8640 1 -- 172.21.15.98:0/3969267914 shutdown_connections 2024-09-16T15:38:09.105 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.103+0000 7f5fb67e8640 1 -- 172.21.15.98:0/3969267914 wait complete. 2024-09-16T15:38:09.105 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.104+0000 7f5fb67e8640 1 Processor -- start 2024-09-16T15:38:09.105 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.104+0000 7f5fb67e8640 1 -- start start 2024-09-16T15:38:09.107 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.105+0000 7f5fb67e8640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5f98003a30 0x7f5fb00c80c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:09.107 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.105+0000 7f5fb67e8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5fb00cb350 0x7f5fb01f2820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:09.107 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.105+0000 7f5fb67e8640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5fb01f2d60 0x7f5fb00c8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:09.108 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.105+0000 7f5fb67e8640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5fb00cf9f0 con 0x7f5fb01f2d60 2024-09-16T15:38:09.108 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.105+0000 7f5fb67e8640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5fb015c430 con 0x7f5fb00cb350 2024-09-16T15:38:09.108 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.105+0000 7f5fb67e8640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f5fb00cfb70 con 0x7f5f98003a30 2024-09-16T15:38:09.108 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.105+0000 7f5fb4d85640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5fb01f2d60 0x7f5fb00c8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:09.108 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.105+0000 7f5fb4d85640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5fb01f2d60 0x7f5fb00c8ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54610/0 (socket says 172.21.15.98:54610) 2024-09-16T15:38:09.108 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.105+0000 7f5fb4d85640 1 -- 172.21.15.98:0/1556321985 learned_addr learned my addr 172.21.15.98:0/1556321985 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:09.108 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.105+0000 7f5faffff640 1 --2- 172.21.15.98:0/1556321985 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5f98003a30 0x7f5fb00c80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:09.108 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.105+0000 7f5faf7fe640 1 --2- 172.21.15.98:0/1556321985 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5fb00cb350 0x7f5fb01f2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:09.108 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.106+0000 7f5fb4d85640 1 -- 172.21.15.98:0/1556321985 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5f98003a30 msgr2=0x7f5fb00c80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:09.108 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.106+0000 7f5fb4d85640 1 --2- 172.21.15.98:0/1556321985 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5f98003a30 0x7f5fb00c80c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:09.108 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.106+0000 7f5fb4d85640 1 -- 172.21.15.98:0/1556321985 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5fb00cb350 msgr2=0x7f5fb01f2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:09.108 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.106+0000 7f5fb4d85640 1 --2- 172.21.15.98:0/1556321985 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5fb00cb350 0x7f5fb01f2820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:09.108 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.106+0000 7f5fb4d85640 1 -- 172.21.15.98:0/1556321985 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fb01f3590 con 0x7f5fb01f2d60 2024-09-16T15:38:09.109 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.106+0000 7f5fb4d85640 1 --2- 172.21.15.98:0/1556321985 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5fb01f2d60 0x7f5fb00c8ef0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5fa80012e0 tx=0x7f5fa800edb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:09.109 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.106+0000 7f5facff9640 1 -- 172.21.15.98:0/1556321985 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fa8015070 con 0x7f5fb01f2d60 2024-09-16T15:38:09.109 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.106+0000 7f5facff9640 1 -- 172.21.15.98:0/1556321985 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5fa800cd10 con 0x7f5fb01f2d60 2024-09-16T15:38:09.109 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.106+0000 7f5fb67e8640 1 -- 172.21.15.98:0/1556321985 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fb00ca890 con 0x7f5fb01f2d60 2024-09-16T15:38:09.109 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.106+0000 7f5facff9640 1 -- 172.21.15.98:0/1556321985 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fa80116c0 con 0x7f5fb01f2d60 2024-09-16T15:38:09.109 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.106+0000 7f5fb67e8640 1 -- 172.21.15.98:0/1556321985 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fb01f31e0 con 0x7f5fb01f2d60 2024-09-16T15:38:09.110 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.107+0000 7f5fb67e8640 1 -- 172.21.15.98:0/1556321985 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fb01606e0 con 0x7f5fb01f2d60 2024-09-16T15:38:09.110 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.108+0000 7f5facff9640 1 -- 172.21.15.98:0/1556321985 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7f5fa8018070 con 0x7f5fb01f2d60 2024-09-16T15:38:09.110 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.108+0000 7f5facff9640 1 --2- 172.21.15.98:0/1556321985 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f5f9c078880 0x7f5f9c07ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:09.110 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.108+0000 7f5facff9640 1 -- 172.21.15.98:0/1556321985 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f5fa809ad30 con 0x7f5fb01f2d60 2024-09-16T15:38:09.110 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.109+0000 7f5faffff640 1 --2- 172.21.15.98:0/1556321985 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f5f9c078880 0x7f5f9c07ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:09.110 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.109+0000 7f5faffff640 1 --2- 172.21.15.98:0/1556321985 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f5f9c078880 0x7f5f9c07ad40 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5fa0035000 tx=0x7f5fa002d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:09.113 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.112+0000 7f5facff9640 1 -- 172.21.15.98:0/1556321985 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7f5fa8062de0 con 0x7f5fb01f2d60 2024-09-16T15:38:09.289 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.288+0000 7f5fb67e8640 1 -- 172.21.15.98:0/1556321985 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f5fb0069630 con 0x7f5fb01f2d60 2024-09-16T15:38:09.289 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.288+0000 7f5facff9640 1 -- 172.21.15.98:0/1556321985 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) ==== 100+0+11 (secure 0 0 0) 0x7f5fa8067810 con 0x7f5fb01f2d60 2024-09-16T15:38:09.289 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 64 2024-09-16T15:38:09.291 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.290+0000 7f5fb67e8640 1 -- 172.21.15.98:0/1556321985 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f5f9c078880 msgr2=0x7f5f9c07ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:09.292 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.290+0000 7f5fb67e8640 1 --2- 172.21.15.98:0/1556321985 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f5f9c078880 0x7f5f9c07ad40 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5fa0035000 tx=0x7f5fa002d040 comp rx=0 tx=0).stop 2024-09-16T15:38:09.292 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.290+0000 7f5fb67e8640 1 -- 172.21.15.98:0/1556321985 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5fb01f2d60 msgr2=0x7f5fb00c8ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:09.292 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.290+0000 7f5fb67e8640 1 --2- 172.21.15.98:0/1556321985 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5fb01f2d60 0x7f5fb00c8ef0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5fa80012e0 tx=0x7f5fa800edb0 comp rx=0 tx=0).stop 2024-09-16T15:38:09.292 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.290+0000 7f5fb67e8640 1 -- 172.21.15.98:0/1556321985 shutdown_connections 2024-09-16T15:38:09.292 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.290+0000 7f5fb67e8640 1 --2- 172.21.15.98:0/1556321985 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5fb01f2d60 0x7f5fb00c8ef0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:09.292 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.290+0000 7f5fb67e8640 1 --2- 172.21.15.98:0/1556321985 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f5f9c078880 0x7f5f9c07ad40 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:09.292 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.290+0000 7f5fb67e8640 1 --2- 172.21.15.98:0/1556321985 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5fb00cb350 0x7f5fb01f2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:09.292 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.290+0000 7f5fb67e8640 1 --2- 172.21.15.98:0/1556321985 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5f98003a30 0x7f5fb00c80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:09.292 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.290+0000 7f5fb67e8640 1 -- 172.21.15.98:0/1556321985 >> 172.21.15.98:0/1556321985 conn(0x7f5fb00d1e20 msgr2=0x7f5fb00b65a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:09.292 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.290+0000 7f5fb67e8640 1 -- 172.21.15.98:0/1556321985 shutdown_connections 2024-09-16T15:38:09.292 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.291+0000 7f5fb67e8640 1 -- 172.21.15.98:0/1556321985 wait complete. 2024-09-16T15:38:09.303 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestPerModuleFinsherThread.test_volumes_module_finisher_thread' 2024-09-16T15:38:09.403 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.402+0000 7f46360dd640 1 -- 172.21.15.98:0/2201428375 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f463015f220 msgr2=0x7f46300cfc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:09.403 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.402+0000 7f46360dd640 1 --2- 172.21.15.98:0/2201428375 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f463015f220 0x7f46300cfc40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4620005fd0 tx=0x7f462002aa90 comp rx=0 tx=0).stop 2024-09-16T15:38:09.403 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.402+0000 7f46360dd640 1 -- 172.21.15.98:0/2201428375 shutdown_connections 2024-09-16T15:38:09.404 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.402+0000 7f46360dd640 1 --2- 172.21.15.98:0/2201428375 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f463015b0c0 0x7f463015b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:09.404 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.402+0000 7f46360dd640 1 --2- 172.21.15.98:0/2201428375 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f463015f220 0x7f46300cfc40 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:09.404 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.402+0000 7f46360dd640 1 -- 172.21.15.98:0/2201428375 >> 172.21.15.98:0/2201428375 conn(0x7f46300b2b90 msgr2=0x7f46300b2f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:09.404 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.402+0000 7f46360dd640 1 -- 172.21.15.98:0/2201428375 shutdown_connections 2024-09-16T15:38:09.404 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.402+0000 7f46360dd640 1 -- 172.21.15.98:0/2201428375 wait complete. 2024-09-16T15:38:09.404 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.403+0000 7f46360dd640 1 Processor -- start 2024-09-16T15:38:09.404 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.403+0000 7f46360dd640 1 -- start start 2024-09-16T15:38:09.406 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.404+0000 7f46360dd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f46300cd8a0 0x7f463014f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:09.406 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.404+0000 7f46360dd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f463015b0c0 0x7f463014ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:09.406 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.404+0000 7f46360dd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f463015f220 0x7f46301f1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:09.406 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.404+0000 7f46360dd640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4630070940 con 0x7f463015b0c0 2024-09-16T15:38:09.407 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.404+0000 7f46360dd640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f46300707c0 con 0x7f463015f220 2024-09-16T15:38:09.407 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.404+0000 7f46360dd640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f4630070ac0 con 0x7f46300cd8a0 2024-09-16T15:38:09.407 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.404+0000 7f462effd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f463015b0c0 0x7f463014ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:09.407 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.404+0000 7f462effd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f463015b0c0 0x7f463014ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54636/0 (socket says 172.21.15.98:54636) 2024-09-16T15:38:09.407 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.404+0000 7f462effd640 1 -- 172.21.15.98:0/5774413 learned_addr learned my addr 172.21.15.98:0/5774413 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:09.407 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.404+0000 7f462ffff640 1 --2- 172.21.15.98:0/5774413 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f463015f220 0x7f46301f1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:09.407 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.404+0000 7f462f7fe640 1 --2- 172.21.15.98:0/5774413 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f46300cd8a0 0x7f463014f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:09.407 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.404+0000 7f462effd640 1 -- 172.21.15.98:0/5774413 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f46300cd8a0 msgr2=0x7f463014f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:09.407 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.404+0000 7f462effd640 1 --2- 172.21.15.98:0/5774413 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f46300cd8a0 0x7f463014f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:09.407 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.404+0000 7f462effd640 1 -- 172.21.15.98:0/5774413 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f463015f220 msgr2=0x7f46301f1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:09.407 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.404+0000 7f462effd640 1 --2- 172.21.15.98:0/5774413 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f463015f220 0x7f46301f1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:09.407 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.404+0000 7f462effd640 1 -- 172.21.15.98:0/5774413 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f463014dbe0 con 0x7f463015b0c0 2024-09-16T15:38:09.407 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.405+0000 7f462effd640 1 --2- 172.21.15.98:0/5774413 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f463015b0c0 0x7f463014ce60 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f462400c450 tx=0x7f462400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:09.407 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.405+0000 7f4617fff640 1 -- 172.21.15.98:0/5774413 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46240052d0 con 0x7f463015b0c0 2024-09-16T15:38:09.407 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.405+0000 7f4617fff640 1 -- 172.21.15.98:0/5774413 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4624005470 con 0x7f463015b0c0 2024-09-16T15:38:09.408 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.405+0000 7f46360dd640 1 -- 172.21.15.98:0/5774413 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f463014d3a0 con 0x7f463015b0c0 2024-09-16T15:38:09.408 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.405+0000 7f4617fff640 1 -- 172.21.15.98:0/5774413 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4624012870 con 0x7f463015b0c0 2024-09-16T15:38:09.408 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.405+0000 7f46360dd640 1 -- 172.21.15.98:0/5774413 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f463014d900 con 0x7f463015b0c0 2024-09-16T15:38:09.409 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.406+0000 7f46360dd640 1 -- 172.21.15.98:0/5774413 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4630070fb0 con 0x7f463015b0c0 2024-09-16T15:38:09.409 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.406+0000 7f4617fff640 1 -- 172.21.15.98:0/5774413 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7f46240035f0 con 0x7f463015b0c0 2024-09-16T15:38:09.409 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.407+0000 7f4617fff640 1 --2- 172.21.15.98:0/5774413 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f461c078850 0x7f461c07ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:09.409 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.407+0000 7f4617fff640 1 -- 172.21.15.98:0/5774413 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f462409a380 con 0x7f463015b0c0 2024-09-16T15:38:09.410 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.407+0000 7f462f7fe640 1 --2- 172.21.15.98:0/5774413 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f461c078850 0x7f461c07ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:09.410 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.408+0000 7f462f7fe640 1 --2- 172.21.15.98:0/5774413 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f461c078850 0x7f461c07ad10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4620035000 tx=0x7f4620038040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:09.412 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.411+0000 7f4617fff640 1 -- 172.21.15.98:0/5774413 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7f463014d3a0 con 0x7f463015b0c0 2024-09-16T15:38:09.654 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.653+0000 7f46360dd640 1 -- 172.21.15.98:0/5774413 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestPerModuleFinsherThread.test_volumes_module_finisher_thread"]} v 0) -- 0x7f46300cff60 con 0x7f463015b0c0 2024-09-16T15:38:09.810 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.810+0000 7f4617fff640 1 -- 172.21.15.98:0/5774413 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestPerModuleFinsherThread.test_volumes_module_finisher_thread"]}]=0 v47) ==== 170+0+0 (secure 0 0 0) 0x7f463014dbe0 con 0x7f463015b0c0 2024-09-16T15:38:09.814 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.812+0000 7f46360dd640 1 -- 172.21.15.98:0/5774413 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f461c078850 msgr2=0x7f461c07ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:09.814 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.812+0000 7f46360dd640 1 --2- 172.21.15.98:0/5774413 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f461c078850 0x7f461c07ad10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4620035000 tx=0x7f4620038040 comp rx=0 tx=0).stop 2024-09-16T15:38:09.814 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.812+0000 7f46360dd640 1 -- 172.21.15.98:0/5774413 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f463015b0c0 msgr2=0x7f463014ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:09.814 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.812+0000 7f46360dd640 1 --2- 172.21.15.98:0/5774413 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f463015b0c0 0x7f463014ce60 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f462400c450 tx=0x7f462400c910 comp rx=0 tx=0).stop 2024-09-16T15:38:09.814 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.812+0000 7f46360dd640 1 -- 172.21.15.98:0/5774413 shutdown_connections 2024-09-16T15:38:09.814 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.812+0000 7f46360dd640 1 --2- 172.21.15.98:0/5774413 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f461c078850 0x7f461c07ad10 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:09.814 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.812+0000 7f46360dd640 1 --2- 172.21.15.98:0/5774413 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f463015f220 0x7f46301f1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:09.814 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.812+0000 7f46360dd640 1 --2- 172.21.15.98:0/5774413 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f463015b0c0 0x7f463014ce60 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:09.814 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.812+0000 7f46360dd640 1 --2- 172.21.15.98:0/5774413 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f46300cd8a0 0x7f463014f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:09.814 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.812+0000 7f46360dd640 1 -- 172.21.15.98:0/5774413 >> 172.21.15.98:0/5774413 conn(0x7f46300b2b90 msgr2=0x7f46300711c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:09.815 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.812+0000 7f46360dd640 1 -- 172.21.15.98:0/5774413 shutdown_connections 2024-09-16T15:38:09.815 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.812+0000 7f46360dd640 1 -- 172.21.15.98:0/5774413 wait complete. 2024-09-16T15:38:09.824 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-16T15:38:09.925 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.924+0000 7f20dea7f640 1 -- 172.21.15.98:0/697363862 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f20d80d1610 msgr2=0x7f20d80cecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:09.926 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.924+0000 7f20dea7f640 1 --2- 172.21.15.98:0/697363862 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f20d80d1610 0x7f20d80cecc0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f20d0005fd0 tx=0x7f20d002aa00 comp rx=0 tx=0).stop 2024-09-16T15:38:09.926 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.924+0000 7f20dea7f640 1 -- 172.21.15.98:0/697363862 shutdown_connections 2024-09-16T15:38:09.926 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.924+0000 7f20dea7f640 1 --2- 172.21.15.98:0/697363862 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f20d80d1610 0x7f20d80cecc0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:09.926 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.924+0000 7f20dea7f640 1 --2- 172.21.15.98:0/697363862 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f20d80d2050 0x7f20d80d10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:09.926 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.924+0000 7f20dea7f640 1 -- 172.21.15.98:0/697363862 >> 172.21.15.98:0/697363862 conn(0x7f20d80d3fe0 msgr2=0x7f20d80d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:09.926 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.924+0000 7f20dea7f640 1 -- 172.21.15.98:0/697363862 shutdown_connections 2024-09-16T15:38:09.926 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.924+0000 7f20dea7f640 1 -- 172.21.15.98:0/697363862 wait complete. 2024-09-16T15:38:09.927 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.925+0000 7f20dea7f640 1 Processor -- start 2024-09-16T15:38:09.927 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.926+0000 7f20dea7f640 1 -- start start 2024-09-16T15:38:09.929 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.926+0000 7f20dea7f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20d80d1610 0x7f20d8154030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:09.929 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.926+0000 7f20dea7f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f20d80d2050 0x7f20d80b5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:09.929 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.926+0000 7f20dea7f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f20d815e0d0 0x7f20d80b8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:09.929 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.926+0000 7f20dea7f640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f20d80cf5e0 con 0x7f20d815e0d0 2024-09-16T15:38:09.929 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.926+0000 7f20dea7f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f20d80cf460 con 0x7f20d80d1610 2024-09-16T15:38:09.929 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.926+0000 7f20dea7f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f20d80cf760 con 0x7f20d80d2050 2024-09-16T15:38:09.929 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.927+0000 7f20dd01c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f20d815e0d0 0x7f20d80b8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:09.929 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.927+0000 7f20dd01c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f20d815e0d0 0x7f20d80b8420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54650/0 (socket says 172.21.15.98:54650) 2024-09-16T15:38:09.929 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.927+0000 7f20dd01c640 1 -- 172.21.15.98:0/118558672 learned_addr learned my addr 172.21.15.98:0/118558672 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:09.929 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.927+0000 7f20d7fff640 1 --2- 172.21.15.98:0/118558672 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f20d80d2050 0x7f20d80b5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:09.929 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.927+0000 7f20dc81b640 1 --2- 172.21.15.98:0/118558672 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20d80d1610 0x7f20d8154030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:09.930 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.927+0000 7f20dd01c640 1 -- 172.21.15.98:0/118558672 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f20d80d2050 msgr2=0x7f20d80b5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:09.930 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.927+0000 7f20dd01c640 1 --2- 172.21.15.98:0/118558672 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f20d80d2050 0x7f20d80b5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:09.930 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.927+0000 7f20dd01c640 1 -- 172.21.15.98:0/118558672 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20d80d1610 msgr2=0x7f20d8154030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:09.930 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.927+0000 7f20dd01c640 1 --2- 172.21.15.98:0/118558672 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20d80d1610 0x7f20d8154030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:09.930 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.927+0000 7f20dd01c640 1 -- 172.21.15.98:0/118558672 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20d81f4d10 con 0x7f20d815e0d0 2024-09-16T15:38:09.930 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.927+0000 7f20dc81b640 1 --2- 172.21.15.98:0/118558672 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20d80d1610 0x7f20d8154030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T15:38:09.930 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.927+0000 7f20d7fff640 1 --2- 172.21.15.98:0/118558672 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f20d80d2050 0x7f20d80b5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T15:38:09.930 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.927+0000 7f20dd01c640 1 --2- 172.21.15.98:0/118558672 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f20d815e0d0 0x7f20d80b8420 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f20d0006010 tx=0x7f20d0003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:09.930 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.927+0000 7f20d57fa640 1 -- 172.21.15.98:0/118558672 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d0047070 con 0x7f20d815e0d0 2024-09-16T15:38:09.930 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.927+0000 7f20d57fa640 1 -- 172.21.15.98:0/118558672 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f20d0004250 con 0x7f20d815e0d0 2024-09-16T15:38:09.930 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.927+0000 7f20dea7f640 1 -- 172.21.15.98:0/118558672 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20d81f4ff0 con 0x7f20d815e0d0 2024-09-16T15:38:09.930 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.927+0000 7f20d57fa640 1 -- 172.21.15.98:0/118558672 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d0033050 con 0x7f20d815e0d0 2024-09-16T15:38:09.930 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.927+0000 7f20dea7f640 1 -- 172.21.15.98:0/118558672 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20d80b6210 con 0x7f20d815e0d0 2024-09-16T15:38:09.930 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.928+0000 7f20dea7f640 1 -- 172.21.15.98:0/118558672 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20d80b6600 con 0x7f20d815e0d0 2024-09-16T15:38:09.931 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.929+0000 7f20d57fa640 1 -- 172.21.15.98:0/118558672 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7f20d004a070 con 0x7f20d815e0d0 2024-09-16T15:38:09.931 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.929+0000 7f20d57fa640 1 --2- 172.21.15.98:0/118558672 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f20bc078880 0x7f20bc07ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:09.931 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.929+0000 7f20d57fa640 1 -- 172.21.15.98:0/118558672 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f20d00bbc00 con 0x7f20d815e0d0 2024-09-16T15:38:09.931 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.929+0000 7f20dc81b640 1 --2- 172.21.15.98:0/118558672 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f20bc078880 0x7f20bc07ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:09.931 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.930+0000 7f20dc81b640 1 --2- 172.21.15.98:0/118558672 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f20bc078880 0x7f20bc07ad40 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f20d8157b60 tx=0x7f20cc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:09.934 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:09.933+0000 7f20d57fa640 1 -- 172.21.15.98:0/118558672 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7f20d00c2080 con 0x7f20d815e0d0 2024-09-16T15:38:10.113 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.112+0000 7f20dea7f640 1 -- 172.21.15.98:0/118558672 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f20d80cfce0 con 0x7f20d815e0d0 2024-09-16T15:38:10.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.112+0000 7f20d57fa640 1 -- 172.21.15.98:0/118558672 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v27) ==== 59+0+1998 (secure 0 0 0) 0x7f20d0084270 con 0x7f20d815e0d0 2024-09-16T15:38:10.114 INFO:teuthology.orchestra.run.smithi098.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-16T15:38:10.114 INFO:teuthology.orchestra.run.smithi098.stdout:mon advanced mon_op_complaint_time 120 2024-09-16T15:38:10.114 INFO:teuthology.orchestra.run.smithi098.stdout:mon dev mon_warn_on_pool_no_app false 2024-09-16T15:38:10.115 INFO:teuthology.orchestra.run.smithi098.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-16T15:38:10.115 INFO:teuthology.orchestra.run.smithi098.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 5679.524471 2024-09-16T15:38:10.115 INFO:teuthology.orchestra.run.smithi098.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 5272.867668 2024-09-16T15:38:10.115 INFO:teuthology.orchestra.run.smithi098.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 6047.607760 2024-09-16T15:38:10.115 INFO:teuthology.orchestra.run.smithi098.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 4742.511181 2024-09-16T15:38:10.116 INFO:teuthology.orchestra.run.smithi098.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 5826.277578 2024-09-16T15:38:10.116 INFO:teuthology.orchestra.run.smithi098.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 5488.155206 2024-09-16T15:38:10.116 INFO:teuthology.orchestra.run.smithi098.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 8223.812910 2024-09-16T15:38:10.116 INFO:teuthology.orchestra.run.smithi098.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 5807.730876 2024-09-16T15:38:10.116 INFO:teuthology.orchestra.run.smithi098.stdout:mds advanced debug_mds 20/20 2024-09-16T15:38:10.116 INFO:teuthology.orchestra.run.smithi098.stdout:mds advanced debug_mds_balancer 20/20 2024-09-16T15:38:10.116 INFO:teuthology.orchestra.run.smithi098.stdout:mds advanced debug_ms 2/2 2024-09-16T15:38:10.116 INFO:teuthology.orchestra.run.smithi098.stdout:mds dev mds_debug_frag true 2024-09-16T15:38:10.116 INFO:teuthology.orchestra.run.smithi098.stdout:mds dev mds_debug_scatterstat true 2024-09-16T15:38:10.116 INFO:teuthology.orchestra.run.smithi098.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-16T15:38:10.116 INFO:teuthology.orchestra.run.smithi098.stdout:mds dev mds_verify_scatter true 2024-09-16T15:38:10.117 INFO:teuthology.orchestra.run.smithi098.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-16T15:38:10.117 INFO:teuthology.orchestra.run.smithi098.stdout:mds advanced rados_mon_op_timeout 900 2024-09-16T15:38:10.117 INFO:teuthology.orchestra.run.smithi098.stdout:mds advanced rados_osd_op_timeout 900 2024-09-16T15:38:10.117 INFO:teuthology.orchestra.run.smithi098.stdout:client advanced client_mount_timeout 600 2024-09-16T15:38:10.117 INFO:teuthology.orchestra.run.smithi098.stdout:client advanced debug_client 20/20 2024-09-16T15:38:10.117 INFO:teuthology.orchestra.run.smithi098.stdout:client advanced debug_ms 1/1 2024-09-16T15:38:10.117 INFO:teuthology.orchestra.run.smithi098.stdout:client advanced rados_mon_op_timeout 900 2024-09-16T15:38:10.117 INFO:teuthology.orchestra.run.smithi098.stdout:client advanced rados_osd_op_timeout 900 2024-09-16T15:38:10.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.114+0000 7f20dea7f640 1 -- 172.21.15.98:0/118558672 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f20bc078880 msgr2=0x7f20bc07ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:10.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.114+0000 7f20dea7f640 1 --2- 172.21.15.98:0/118558672 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f20bc078880 0x7f20bc07ad40 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f20d8157b60 tx=0x7f20cc008040 comp rx=0 tx=0).stop 2024-09-16T15:38:10.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.114+0000 7f20dea7f640 1 -- 172.21.15.98:0/118558672 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f20d815e0d0 msgr2=0x7f20d80b8420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:10.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.114+0000 7f20dea7f640 1 --2- 172.21.15.98:0/118558672 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f20d815e0d0 0x7f20d80b8420 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f20d0006010 tx=0x7f20d0003f10 comp rx=0 tx=0).stop 2024-09-16T15:38:10.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.115+0000 7f20dea7f640 1 -- 172.21.15.98:0/118558672 shutdown_connections 2024-09-16T15:38:10.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.115+0000 7f20dea7f640 1 --2- 172.21.15.98:0/118558672 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f20d815e0d0 0x7f20d80b8420 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:10.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.115+0000 7f20dea7f640 1 --2- 172.21.15.98:0/118558672 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f20d80d2050 0x7f20d80b5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:10.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.115+0000 7f20dea7f640 1 --2- 172.21.15.98:0/118558672 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f20bc078880 0x7f20bc07ad40 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:10.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.115+0000 7f20dea7f640 1 --2- 172.21.15.98:0/118558672 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20d80d1610 0x7f20d8154030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:10.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.115+0000 7f20dea7f640 1 -- 172.21.15.98:0/118558672 >> 172.21.15.98:0/118558672 conn(0x7f20d80d3fe0 msgr2=0x7f20d815f650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:10.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.115+0000 7f20dea7f640 1 -- 172.21.15.98:0/118558672 shutdown_connections 2024-09-16T15:38:10.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.115+0000 7f20dea7f640 1 -- 172.21.15.98:0/118558672 wait complete. 2024-09-16T15:38:10.126 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-16T15:38:10.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.230+0000 7fdda72b8640 1 -- 172.21.15.98:0/2749435598 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdda00a1b90 msgr2=0x7fdda0073b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:10.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.230+0000 7fdda72b8640 1 --2- 172.21.15.98:0/2749435598 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdda00a1b90 0x7fdda0073b90 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fdda00d1c90 tx=0x7fdd9002aa30 comp rx=0 tx=0).stop 2024-09-16T15:38:10.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.230+0000 7fdda72b8640 1 -- 172.21.15.98:0/2749435598 shutdown_connections 2024-09-16T15:38:10.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.230+0000 7fdda72b8640 1 --2- 172.21.15.98:0/2749435598 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdda00a1b90 0x7fdda0073b90 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:10.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.230+0000 7fdda72b8640 1 --2- 172.21.15.98:0/2749435598 >> v2:172.21.15.135:3300/0 conn(0x7fdda006d280 0x7fdda0073650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:10.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.230+0000 7fdda72b8640 1 -- 172.21.15.98:0/2749435598 >> 172.21.15.98:0/2749435598 conn(0x7fdda00cd6f0 msgr2=0x7fdda00cdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:10.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.230+0000 7fdda72b8640 1 -- 172.21.15.98:0/2749435598 shutdown_connections 2024-09-16T15:38:10.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.230+0000 7fdda72b8640 1 -- 172.21.15.98:0/2749435598 wait complete. 2024-09-16T15:38:10.234 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.231+0000 7fdda72b8640 1 Processor -- start 2024-09-16T15:38:10.234 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.232+0000 7fdda72b8640 1 -- start start 2024-09-16T15:38:10.234 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.232+0000 7fdda72b8640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdda006d280 0x7fdda00b30e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:10.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.232+0000 7fdda72b8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdda00a1b90 0x7fdda01f6610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:10.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.232+0000 7fdda72b8640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdda015f450 0x7fdda00ca1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:10.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.232+0000 7fdda72b8640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fdda00ce390 con 0x7fdda015f450 2024-09-16T15:38:10.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.232+0000 7fdda72b8640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdda00ce210 con 0x7fdda00a1b90 2024-09-16T15:38:10.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.232+0000 7fdda72b8640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fdda00ce510 con 0x7fdda006d280 2024-09-16T15:38:10.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.232+0000 7fdda5855640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdda015f450 0x7fdda00ca1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:10.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.232+0000 7fdda5855640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdda015f450 0x7fdda00ca1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54662/0 (socket says 172.21.15.98:54662) 2024-09-16T15:38:10.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.232+0000 7fdda5855640 1 -- 172.21.15.98:0/3418894038 learned_addr learned my addr 172.21.15.98:0/3418894038 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:10.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.232+0000 7fdda4853640 1 --2- 172.21.15.98:0/3418894038 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdda00a1b90 0x7fdda01f6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:10.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.232+0000 7fdda5054640 1 --2- 172.21.15.98:0/3418894038 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdda006d280 0x7fdda00b30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:10.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.233+0000 7fdda5855640 1 -- 172.21.15.98:0/3418894038 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdda006d280 msgr2=0x7fdda00b30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:10.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.233+0000 7fdda5855640 1 --2- 172.21.15.98:0/3418894038 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdda006d280 0x7fdda00b30e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:10.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.233+0000 7fdda5855640 1 -- 172.21.15.98:0/3418894038 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdda00a1b90 msgr2=0x7fdda01f6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:10.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.233+0000 7fdda5855640 1 --2- 172.21.15.98:0/3418894038 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdda00a1b90 0x7fdda01f6610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:10.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.233+0000 7fdda5855640 1 -- 172.21.15.98:0/3418894038 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdda01f6b50 con 0x7fdda015f450 2024-09-16T15:38:10.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.233+0000 7fdda5855640 1 --2- 172.21.15.98:0/3418894038 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdda015f450 0x7fdda00ca1f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fdd9002b020 tx=0x7fdd90003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:10.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.233+0000 7fdd9dffb640 1 -- 172.21.15.98:0/3418894038 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd90046070 con 0x7fdda015f450 2024-09-16T15:38:10.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.233+0000 7fdd9dffb640 1 -- 172.21.15.98:0/3418894038 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdd90004250 con 0x7fdda015f450 2024-09-16T15:38:10.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.233+0000 7fdd9dffb640 1 -- 172.21.15.98:0/3418894038 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd90033050 con 0x7fdda015f450 2024-09-16T15:38:10.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.233+0000 7fdda72b8640 1 -- 172.21.15.98:0/3418894038 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdda00c7dc0 con 0x7fdda015f450 2024-09-16T15:38:10.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.233+0000 7fdda72b8640 1 -- 172.21.15.98:0/3418894038 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdda00c8380 con 0x7fdda015f450 2024-09-16T15:38:10.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.234+0000 7fdda72b8640 1 -- 172.21.15.98:0/3418894038 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdda006aaf0 con 0x7fdda015f450 2024-09-16T15:38:10.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.235+0000 7fdd9dffb640 1 -- 172.21.15.98:0/3418894038 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7fdd90049070 con 0x7fdda015f450 2024-09-16T15:38:10.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.235+0000 7fdd9dffb640 1 --2- 172.21.15.98:0/3418894038 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fdd8c078850 0x7fdd8c07ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:10.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.235+0000 7fdd9dffb640 1 -- 172.21.15.98:0/3418894038 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fdd900bb800 con 0x7fdda015f450 2024-09-16T15:38:10.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.236+0000 7fdda5054640 1 --2- 172.21.15.98:0/3418894038 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fdd8c078850 0x7fdd8c07ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:10.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.236+0000 7fdda5054640 1 --2- 172.21.15.98:0/3418894038 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fdd8c078850 0x7fdd8c07ad10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fdd98001720 tx=0x7fdd98009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:10.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.240+0000 7fdd9dffb640 1 -- 172.21.15.98:0/3418894038 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7fdda006aaf0 con 0x7fdda015f450 2024-09-16T15:38:10.415 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.414+0000 7fdda72b8640 1 -- 172.21.15.98:0/3418894038 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fdda00743e0 con 0x7fdda015f450 2024-09-16T15:38:10.418 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.417+0000 7fdd9dffb640 1 -- 172.21.15.98:0/3418894038 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v28)=0 v28) ==== 122+0+0 (secure 0 0 0) 0x7fdd90083820 con 0x7fdda015f450 2024-09-16T15:38:10.421 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.420+0000 7fdda72b8640 1 -- 172.21.15.98:0/3418894038 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fdd8c078850 msgr2=0x7fdd8c07ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:10.421 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.420+0000 7fdda72b8640 1 --2- 172.21.15.98:0/3418894038 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fdd8c078850 0x7fdd8c07ad10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fdd98001720 tx=0x7fdd98009040 comp rx=0 tx=0).stop 2024-09-16T15:38:10.421 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.420+0000 7fdda72b8640 1 -- 172.21.15.98:0/3418894038 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdda015f450 msgr2=0x7fdda00ca1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:10.421 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.420+0000 7fdda72b8640 1 --2- 172.21.15.98:0/3418894038 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdda015f450 0x7fdda00ca1f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fdd9002b020 tx=0x7fdd90003f10 comp rx=0 tx=0).stop 2024-09-16T15:38:10.421 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.420+0000 7fdda72b8640 1 -- 172.21.15.98:0/3418894038 shutdown_connections 2024-09-16T15:38:10.421 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.420+0000 7fdda72b8640 1 --2- 172.21.15.98:0/3418894038 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdda015f450 0x7fdda00ca1f0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:10.421 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.420+0000 7fdda72b8640 1 --2- 172.21.15.98:0/3418894038 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fdd8c078850 0x7fdd8c07ad10 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:10.421 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.420+0000 7fdda72b8640 1 --2- 172.21.15.98:0/3418894038 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdda00a1b90 0x7fdda01f6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:10.421 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.420+0000 7fdda72b8640 1 --2- 172.21.15.98:0/3418894038 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdda006d280 0x7fdda00b30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:10.422 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.420+0000 7fdda72b8640 1 -- 172.21.15.98:0/3418894038 >> 172.21.15.98:0/3418894038 conn(0x7fdda00cd6f0 msgr2=0x7fdda015d400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:10.422 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.420+0000 7fdda72b8640 1 -- 172.21.15.98:0/3418894038 shutdown_connections 2024-09-16T15:38:10.422 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.420+0000 7fdda72b8640 1 -- 172.21.15.98:0/3418894038 wait complete. 2024-09-16T15:38:10.432 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-16T15:38:10.432 DEBUG:teuthology.orchestra.run.smithi098:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T15:38:10.469 DEBUG:teuthology.orchestra.run.smithi135:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T15:38:10.526 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-16T15:38:10.527 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-16T15:38:10.527 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T15:38:10.543 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-16T15:38:10.543 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T15:38:10.598 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-16T15:38:10.598 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T15:38:10.654 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-16T15:38:10.795 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.794+0000 7f22acc62640 1 -- 172.21.15.98:0/2038275715 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22a815e240 msgr2=0x7f22a80cead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:10.796 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.794+0000 7f22acc62640 1 --2- 172.21.15.98:0/2038275715 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22a815e240 0x7f22a80cead0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2298005fd0 tx=0x7f229802a530 comp rx=0 tx=0).stop 2024-09-16T15:38:10.796 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.794+0000 7f22acc62640 1 -- 172.21.15.98:0/2038275715 shutdown_connections 2024-09-16T15:38:10.796 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.794+0000 7f22acc62640 1 --2- 172.21.15.98:0/2038275715 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22a80cf720 0x7f22a80b41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:10.796 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.794+0000 7f22acc62640 1 --2- 172.21.15.98:0/2038275715 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22a815e240 0x7f22a80cead0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:10.796 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.794+0000 7f22acc62640 1 -- 172.21.15.98:0/2038275715 >> 172.21.15.98:0/2038275715 conn(0x7f22a80d3fc0 msgr2=0x7f22a80d43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:10.796 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.794+0000 7f22acc62640 1 -- 172.21.15.98:0/2038275715 shutdown_connections 2024-09-16T15:38:10.796 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.794+0000 7f22acc62640 1 -- 172.21.15.98:0/2038275715 wait complete. 2024-09-16T15:38:10.796 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.796+0000 7f22acc62640 1 Processor -- start 2024-09-16T15:38:10.797 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.796+0000 7f22acc62640 1 -- start start 2024-09-16T15:38:10.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.796+0000 7f22acc62640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22a80cf720 0x7f22a815bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:10.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.796+0000 7f22acc62640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22a815e240 0x7f22a81f89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:10.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.796+0000 7f22acc62640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22a81f4950 0x7f22a80ccb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:10.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.796+0000 7f22acc62640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f22a80b4aa0 con 0x7f22a815e240 2024-09-16T15:38:10.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.796+0000 7f22acc62640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f22a80b4920 con 0x7f22a81f4950 2024-09-16T15:38:10.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.796+0000 7f22acc62640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f22a80b4c20 con 0x7f22a80cf720 2024-09-16T15:38:10.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.796+0000 7f229ffff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22a815e240 0x7f22a81f89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:10.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.796+0000 7f229ffff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22a815e240 0x7f22a81f89c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54682/0 (socket says 172.21.15.98:54682) 2024-09-16T15:38:10.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.797+0000 7f229ffff640 1 -- 172.21.15.98:0/3911114889 learned_addr learned my addr 172.21.15.98:0/3911114889 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:10.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.797+0000 7f22a659c640 1 --2- 172.21.15.98:0/3911114889 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22a80cf720 0x7f22a815bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:10.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.797+0000 7f22a6d9d640 1 --2- 172.21.15.98:0/3911114889 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22a81f4950 0x7f22a80ccb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:10.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.797+0000 7f229ffff640 1 -- 172.21.15.98:0/3911114889 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22a80cf720 msgr2=0x7f22a815bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:10.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.797+0000 7f229ffff640 1 --2- 172.21.15.98:0/3911114889 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22a80cf720 0x7f22a815bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:10.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.797+0000 7f229ffff640 1 -- 172.21.15.98:0/3911114889 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22a81f4950 msgr2=0x7f22a80ccb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:10.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.797+0000 7f229ffff640 1 --2- 172.21.15.98:0/3911114889 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22a81f4950 0x7f22a80ccb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:10.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.797+0000 7f229ffff640 1 -- 172.21.15.98:0/3911114889 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22a81f4f10 con 0x7f22a815e240 2024-09-16T15:38:10.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.797+0000 7f22a659c640 1 --2- 172.21.15.98:0/3911114889 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22a80cf720 0x7f22a815bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T15:38:10.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.797+0000 7f229ffff640 1 --2- 172.21.15.98:0/3911114889 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22a815e240 0x7f22a81f89c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f229000c460 tx=0x7f229000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:10.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.797+0000 7f229effd640 1 -- 172.21.15.98:0/3911114889 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2290016020 con 0x7f22a815e240 2024-09-16T15:38:10.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.797+0000 7f229effd640 1 -- 172.21.15.98:0/3911114889 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2290012960 con 0x7f22a815e240 2024-09-16T15:38:10.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.797+0000 7f22acc62640 1 -- 172.21.15.98:0/3911114889 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22a81f51f0 con 0x7f22a815e240 2024-09-16T15:38:10.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.797+0000 7f229effd640 1 -- 172.21.15.98:0/3911114889 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2290012db0 con 0x7f22a815e240 2024-09-16T15:38:10.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.797+0000 7f22acc62640 1 -- 172.21.15.98:0/3911114889 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22a81f57b0 con 0x7f22a815e240 2024-09-16T15:38:10.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.798+0000 7f22acc62640 1 -- 172.21.15.98:0/3911114889 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22a80d4ab0 con 0x7f22a815e240 2024-09-16T15:38:10.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.799+0000 7f229effd640 1 -- 172.21.15.98:0/3911114889 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7f2290019020 con 0x7f22a815e240 2024-09-16T15:38:10.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.799+0000 7f229effd640 1 --2- 172.21.15.98:0/3911114889 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f2288078850 0x7f228807ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:10.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.799+0000 7f229effd640 1 -- 172.21.15.98:0/3911114889 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f229009a3c0 con 0x7f22a815e240 2024-09-16T15:38:10.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.800+0000 7f22a659c640 1 --2- 172.21.15.98:0/3911114889 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f2288078850 0x7f228807ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:10.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.800+0000 7f22a659c640 1 --2- 172.21.15.98:0/3911114889 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f2288078850 0x7f228807ad10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2298033000 tx=0x7f2298004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:10.804 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.804+0000 7f229effd640 1 -- 172.21.15.98:0/3911114889 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7f22a80d4ab0 con 0x7f22a815e240 2024-09-16T15:38:10.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.990+0000 7f22acc62640 1 -- 172.21.15.98:0/3911114889 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f22a80b41d0 con 0x7f22a815e240 2024-09-16T15:38:10.992 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.991+0000 7f229effd640 1 -- 172.21.15.98:0/3911114889 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7f2290020070 con 0x7f22a815e240 2024-09-16T15:38:10.992 INFO:teuthology.orchestra.run.smithi098.stderr:listed 0 entries 2024-09-16T15:38:10.994 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.993+0000 7f22acc62640 1 -- 172.21.15.98:0/3911114889 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f2288078850 msgr2=0x7f228807ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:10.994 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.993+0000 7f22acc62640 1 --2- 172.21.15.98:0/3911114889 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f2288078850 0x7f228807ad10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2298033000 tx=0x7f2298004730 comp rx=0 tx=0).stop 2024-09-16T15:38:10.994 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.993+0000 7f22acc62640 1 -- 172.21.15.98:0/3911114889 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22a815e240 msgr2=0x7f22a81f89c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:10.994 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.993+0000 7f22acc62640 1 --2- 172.21.15.98:0/3911114889 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22a815e240 0x7f22a81f89c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f229000c460 tx=0x7f229000c920 comp rx=0 tx=0).stop 2024-09-16T15:38:10.994 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.993+0000 7f22acc62640 1 -- 172.21.15.98:0/3911114889 shutdown_connections 2024-09-16T15:38:10.994 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.993+0000 7f22acc62640 1 --2- 172.21.15.98:0/3911114889 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f2288078850 0x7f228807ad10 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:10.994 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.993+0000 7f22acc62640 1 --2- 172.21.15.98:0/3911114889 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22a81f4950 0x7f22a80ccb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:10.994 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.993+0000 7f22acc62640 1 --2- 172.21.15.98:0/3911114889 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22a815e240 0x7f22a81f89c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:10.994 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.993+0000 7f22acc62640 1 --2- 172.21.15.98:0/3911114889 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f22a80cf720 0x7f22a815bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:10.995 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.993+0000 7f22acc62640 1 -- 172.21.15.98:0/3911114889 >> 172.21.15.98:0/3911114889 conn(0x7f22a80d3fc0 msgr2=0x7f22a80d43a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:10.995 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.993+0000 7f22acc62640 1 -- 172.21.15.98:0/3911114889 shutdown_connections 2024-09-16T15:38:10.995 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:10.993+0000 7f22acc62640 1 -- 172.21.15.98:0/3911114889 wait complete. 2024-09-16T15:38:11.005 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-16T15:38:11.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T15:38:11.005 DEBUG:teuthology.orchestra.run.smithi098:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-09-16T15:38:11.030 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi098.front.sepia.ceph.com 2024-09-16T15:38:11.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T15:38:11.031 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-16T15:38:11.096 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-16T15:38:11.096 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T15:38:11.116 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-16T15:38:11.116 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T15:38:11.174 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-16T15:38:11.174 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T15:38:11.232 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-16T15:38:11.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.334+0000 7f1b6edda640 1 -- 172.21.15.98:0/734446037 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1b50003a30 msgr2=0x7f1b50003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:11.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.334+0000 7f1b6edda640 1 --2- 172.21.15.98:0/734446037 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1b50003a30 0x7f1b50003e50 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1b58009b50 tx=0x7f1b50005830 comp rx=0 tx=0).stop 2024-09-16T15:38:11.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.334+0000 7f1b6d377640 1 -- 172.21.15.98:0/734446037 reap_dead start 2024-09-16T15:38:11.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.335+0000 7f1b6edda640 1 -- 172.21.15.98:0/734446037 shutdown_connections 2024-09-16T15:38:11.337 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.335+0000 7f1b6edda640 1 -- 172.21.15.98:0/734446037 >> 172.21.15.98:0/734446037 conn(0x7f1b680b1950 msgr2=0x7f1b680b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:11.337 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.335+0000 7f1b6edda640 1 -- 172.21.15.98:0/734446037 shutdown_connections 2024-09-16T15:38:11.337 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.335+0000 7f1b6edda640 1 -- 172.21.15.98:0/734446037 wait complete. 2024-09-16T15:38:11.339 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.336+0000 7f1b6edda640 1 Processor -- start 2024-09-16T15:38:11.339 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.336+0000 7f1b6edda640 1 -- start start 2024-09-16T15:38:11.339 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.337+0000 7f1b6edda640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1b50003a30 0x7f1b68150bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:11.339 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.337+0000 7f1b6edda640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1b6809c940 0x7f1b6809cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:11.339 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.337+0000 7f1b6edda640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b681f4d80 0x7f1b681f5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:11.339 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.337+0000 7f1b6edda640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1b6806f9f0 con 0x7f1b6809c940 2024-09-16T15:38:11.339 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.337+0000 7f1b6edda640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1b6806f870 con 0x7f1b681f4d80 2024-09-16T15:38:11.339 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.337+0000 7f1b6edda640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f1b680b2440 con 0x7f1b50003a30 2024-09-16T15:38:11.339 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.337+0000 7f1b67fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1b6809c940 0x7f1b6809cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:11.339 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.337+0000 7f1b67fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1b6809c940 0x7f1b6809cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54688/0 (socket says 172.21.15.98:54688) 2024-09-16T15:38:11.339 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.337+0000 7f1b67fff640 1 -- 172.21.15.98:0/2433126982 learned_addr learned my addr 172.21.15.98:0/2433126982 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:11.340 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.337+0000 7f1b6cb76640 1 --2- 172.21.15.98:0/2433126982 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1b50003a30 0x7f1b68150bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:11.340 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.337+0000 7f1b6d377640 1 --2- 172.21.15.98:0/2433126982 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b681f4d80 0x7f1b681f5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:11.340 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.337+0000 7f1b67fff640 1 -- 172.21.15.98:0/2433126982 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1b50003a30 msgr2=0x7f1b68150bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:11.340 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.337+0000 7f1b67fff640 1 --2- 172.21.15.98:0/2433126982 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1b50003a30 0x7f1b68150bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:11.340 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.337+0000 7f1b67fff640 1 -- 172.21.15.98:0/2433126982 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b681f4d80 msgr2=0x7f1b681f5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:11.340 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.337+0000 7f1b67fff640 1 --2- 172.21.15.98:0/2433126982 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b681f4d80 0x7f1b681f5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:11.340 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.337+0000 7f1b67fff640 1 -- 172.21.15.98:0/2433126982 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b680c8fd0 con 0x7f1b6809c940 2024-09-16T15:38:11.340 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.337+0000 7f1b67fff640 1 --2- 172.21.15.98:0/2433126982 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1b6809c940 0x7f1b6809cdc0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c00e660 tx=0x7f1b5c00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:11.340 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.337+0000 7f1b657fa640 1 -- 172.21.15.98:0/2433126982 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c004440 con 0x7f1b6809c940 2024-09-16T15:38:11.340 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.337+0000 7f1b657fa640 1 -- 172.21.15.98:0/2433126982 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1b5c016070 con 0x7f1b6809c940 2024-09-16T15:38:11.340 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.337+0000 7f1b6edda640 1 -- 172.21.15.98:0/2433126982 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b681f82b0 con 0x7f1b6809c940 2024-09-16T15:38:11.340 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.337+0000 7f1b657fa640 1 -- 172.21.15.98:0/2433126982 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c00caa0 con 0x7f1b6809c940 2024-09-16T15:38:11.340 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.337+0000 7f1b6edda640 1 -- 172.21.15.98:0/2433126982 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b681f8870 con 0x7f1b6809c940 2024-09-16T15:38:11.341 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.339+0000 7f1b6edda640 1 -- 172.21.15.98:0/2433126982 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b680aeba0 con 0x7f1b6809c940 2024-09-16T15:38:11.341 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.339+0000 7f1b657fa640 1 -- 172.21.15.98:0/2433126982 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7f1b5c00cc40 con 0x7f1b6809c940 2024-09-16T15:38:11.341 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.340+0000 7f1b657fa640 1 --2- 172.21.15.98:0/2433126982 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f1b54078850 0x7f1b5407ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:11.342 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.340+0000 7f1b657fa640 1 -- 172.21.15.98:0/2433126982 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f1b5c09adb0 con 0x7f1b6809c940 2024-09-16T15:38:11.342 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.340+0000 7f1b6cb76640 1 --2- 172.21.15.98:0/2433126982 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f1b54078850 0x7f1b5407ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:11.342 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.340+0000 7f1b6cb76640 1 --2- 172.21.15.98:0/2433126982 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f1b54078850 0x7f1b5407ad10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1b58035000 tx=0x7f1b5802d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:11.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.344+0000 7f1b657fa640 1 -- 172.21.15.98:0/2433126982 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7f1b680aeba0 con 0x7f1b6809c940 2024-09-16T15:38:11.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.532+0000 7f1b6edda640 1 -- 172.21.15.98:0/2433126982 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f1b68074460 con 0x7f1b6809c940 2024-09-16T15:38:11.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.532+0000 7f1b657fa640 1 -- 172.21.15.98:0/2433126982 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7f1b5c063420 con 0x7f1b6809c940 2024-09-16T15:38:11.534 INFO:teuthology.orchestra.run.smithi098.stderr:listed 0 entries 2024-09-16T15:38:11.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.534+0000 7f1b6edda640 1 -- 172.21.15.98:0/2433126982 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f1b54078850 msgr2=0x7f1b5407ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:11.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.534+0000 7f1b6edda640 1 --2- 172.21.15.98:0/2433126982 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f1b54078850 0x7f1b5407ad10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1b58035000 tx=0x7f1b5802d040 comp rx=0 tx=0).stop 2024-09-16T15:38:11.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.534+0000 7f1b6edda640 1 -- 172.21.15.98:0/2433126982 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1b6809c940 msgr2=0x7f1b6809cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:11.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.534+0000 7f1b6edda640 1 --2- 172.21.15.98:0/2433126982 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1b6809c940 0x7f1b6809cdc0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c00e660 tx=0x7f1b5c00eb20 comp rx=0 tx=0).stop 2024-09-16T15:38:11.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.534+0000 7f1b6edda640 1 -- 172.21.15.98:0/2433126982 shutdown_connections 2024-09-16T15:38:11.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.534+0000 7f1b6edda640 1 --2- 172.21.15.98:0/2433126982 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f1b54078850 0x7f1b5407ad10 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:11.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.534+0000 7f1b6edda640 1 --2- 172.21.15.98:0/2433126982 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b681f4d80 0x7f1b681f5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:11.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.534+0000 7f1b6edda640 1 --2- 172.21.15.98:0/2433126982 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1b6809c940 0x7f1b6809cdc0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:11.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.534+0000 7f1b6edda640 1 --2- 172.21.15.98:0/2433126982 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1b50003a30 0x7f1b68150bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:11.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.534+0000 7f1b6edda640 1 -- 172.21.15.98:0/2433126982 >> 172.21.15.98:0/2433126982 conn(0x7f1b680b1950 msgr2=0x7f1b680ce140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:11.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.535+0000 7f1b6edda640 1 -- 172.21.15.98:0/2433126982 shutdown_connections 2024-09-16T15:38:11.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.535+0000 7f1b6edda640 1 -- 172.21.15.98:0/2433126982 wait complete. 2024-09-16T15:38:11.546 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-16T15:38:11.546 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T15:38:11.546 DEBUG:teuthology.orchestra.run.smithi135:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-09-16T15:38:11.576 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi135.front.sepia.ceph.com 2024-09-16T15:38:11.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T15:38:11.576 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-16T15:38:11.642 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-16T15:38:11.642 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T15:38:11.658 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-16T15:38:11.658 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T15:38:11.714 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-16T15:38:11.714 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T15:38:11.771 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-16T15:38:11.917 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.916+0000 7f5003f3d640 1 -- 172.21.15.98:0/1519683829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ffc1438b0 msgr2=0x7f4ffc0cc5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:11.918 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.916+0000 7f5003f3d640 1 --2- 172.21.15.98:0/1519683829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ffc1438b0 0x7f4ffc0cc5f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4ff8009830 tx=0x7f4ff802a540 comp rx=0 tx=0).stop 2024-09-16T15:38:11.918 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.916+0000 7f5003f3d640 1 -- 172.21.15.98:0/1519683829 shutdown_connections 2024-09-16T15:38:11.918 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.916+0000 7f5003f3d640 1 --2- 172.21.15.98:0/1519683829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ffc1438b0 0x7f4ffc0cc5f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:11.918 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.916+0000 7f5003f3d640 1 -- 172.21.15.98:0/1519683829 >> 172.21.15.98:0/1519683829 conn(0x7f4ffc0b1950 msgr2=0x7f4ffc0b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:11.918 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.916+0000 7f5003f3d640 1 -- 172.21.15.98:0/1519683829 shutdown_connections 2024-09-16T15:38:11.918 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.916+0000 7f5003f3d640 1 -- 172.21.15.98:0/1519683829 wait complete. 2024-09-16T15:38:11.920 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.917+0000 7f5003f3d640 1 Processor -- start 2024-09-16T15:38:11.920 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.917+0000 7f5003f3d640 1 -- start start 2024-09-16T15:38:11.920 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.918+0000 7f5003f3d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4ffc06ff60 0x7f4ffc09b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:11.920 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.918+0000 7f5003f3d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ffc0ccb30 0x7f4ffc09cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:11.920 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.918+0000 7f5003f3d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ffc1438b0 0x7f4ffc09d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:11.921 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.918+0000 7f5003f3d640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4ffc0b4610 con 0x7f4ffc0ccb30 2024-09-16T15:38:11.921 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.918+0000 7f5003f3d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4ffc070b30 con 0x7f4ffc1438b0 2024-09-16T15:38:11.921 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.918+0000 7f5003f3d640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f4ffc0b4790 con 0x7f4ffc06ff60 2024-09-16T15:38:11.921 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.918+0000 7f50014d8640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ffc0ccb30 0x7f4ffc09cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:11.921 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.918+0000 7f50014d8640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ffc0ccb30 0x7f4ffc09cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54694/0 (socket says 172.21.15.98:54694) 2024-09-16T15:38:11.921 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.918+0000 7f50014d8640 1 -- 172.21.15.98:0/1578220384 learned_addr learned my addr 172.21.15.98:0/1578220384 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:11.921 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.918+0000 7f5001cd9640 1 --2- 172.21.15.98:0/1578220384 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4ffc06ff60 0x7f4ffc09b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:11.921 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.918+0000 7f50024da640 1 --2- 172.21.15.98:0/1578220384 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ffc1438b0 0x7f4ffc09d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:11.921 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.918+0000 7f50014d8640 1 -- 172.21.15.98:0/1578220384 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4ffc06ff60 msgr2=0x7f4ffc09b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:11.921 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.918+0000 7f50014d8640 1 --2- 172.21.15.98:0/1578220384 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4ffc06ff60 0x7f4ffc09b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:11.921 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.918+0000 7f50014d8640 1 -- 172.21.15.98:0/1578220384 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ffc1438b0 msgr2=0x7f4ffc09d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:11.921 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.918+0000 7f50014d8640 1 --2- 172.21.15.98:0/1578220384 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ffc1438b0 0x7f4ffc09d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:11.921 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.918+0000 7f50014d8640 1 -- 172.21.15.98:0/1578220384 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ffc09bef0 con 0x7f4ffc0ccb30 2024-09-16T15:38:11.922 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.918+0000 7f50024da640 1 --2- 172.21.15.98:0/1578220384 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ffc1438b0 0x7f4ffc09d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T15:38:11.922 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.919+0000 7f50014d8640 1 --2- 172.21.15.98:0/1578220384 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ffc0ccb30 0x7f4ffc09cbd0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4fec00c490 tx=0x7f4fec00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:11.922 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.919+0000 7f4ff27fc640 1 -- 172.21.15.98:0/1578220384 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fec0052d0 con 0x7f4ffc0ccb30 2024-09-16T15:38:11.922 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.919+0000 7f4ff27fc640 1 -- 172.21.15.98:0/1578220384 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4fec005490 con 0x7f4ffc0ccb30 2024-09-16T15:38:11.922 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.919+0000 7f5003f3d640 1 -- 172.21.15.98:0/1578220384 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ffc0af450 con 0x7f4ffc0ccb30 2024-09-16T15:38:11.922 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.919+0000 7f4ff27fc640 1 -- 172.21.15.98:0/1578220384 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fec012890 con 0x7f4ffc0ccb30 2024-09-16T15:38:11.922 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.919+0000 7f5003f3d640 1 -- 172.21.15.98:0/1578220384 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ffc0afa10 con 0x7f4ffc0ccb30 2024-09-16T15:38:11.923 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.920+0000 7f5003f3d640 1 -- 172.21.15.98:0/1578220384 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ffc0b2560 con 0x7f4ffc0ccb30 2024-09-16T15:38:11.923 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.920+0000 7f4ff27fc640 1 -- 172.21.15.98:0/1578220384 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7f4fec012a30 con 0x7f4ffc0ccb30 2024-09-16T15:38:11.923 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.921+0000 7f4ff27fc640 1 --2- 172.21.15.98:0/1578220384 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f4fe0078850 0x7f4fe007ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:11.923 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.921+0000 7f4ff27fc640 1 -- 172.21.15.98:0/1578220384 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f4fec09a4e0 con 0x7f4ffc0ccb30 2024-09-16T15:38:11.923 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.921+0000 7f5001cd9640 1 --2- 172.21.15.98:0/1578220384 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f4fe0078850 0x7f4fe007ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:11.923 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.922+0000 7f5001cd9640 1 --2- 172.21.15.98:0/1578220384 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f4fe0078850 0x7f4fe007ad10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4ff8034000 tx=0x7f4ff8004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:11.926 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:11.925+0000 7f4ff27fc640 1 -- 172.21.15.98:0/1578220384 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7f4ffc0b2560 con 0x7f4ffc0ccb30 2024-09-16T15:38:12.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.113+0000 7f5003f3d640 1 -- 172.21.15.98:0/1578220384 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f4ffc0b4c40 con 0x7f4ffc0ccb30 2024-09-16T15:38:12.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.113+0000 7f4ff27fc640 1 -- 172.21.15.98:0/1578220384 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7f4fec062ad0 con 0x7f4ffc0ccb30 2024-09-16T15:38:12.114 INFO:teuthology.orchestra.run.smithi098.stderr:listed 0 entries 2024-09-16T15:38:12.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.115+0000 7f5003f3d640 1 -- 172.21.15.98:0/1578220384 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f4fe0078850 msgr2=0x7f4fe007ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:12.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.115+0000 7f5003f3d640 1 --2- 172.21.15.98:0/1578220384 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f4fe0078850 0x7f4fe007ad10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4ff8034000 tx=0x7f4ff8004730 comp rx=0 tx=0).stop 2024-09-16T15:38:12.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.115+0000 7f5003f3d640 1 -- 172.21.15.98:0/1578220384 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ffc0ccb30 msgr2=0x7f4ffc09cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:12.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.115+0000 7f5003f3d640 1 --2- 172.21.15.98:0/1578220384 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ffc0ccb30 0x7f4ffc09cbd0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4fec00c490 tx=0x7f4fec00c950 comp rx=0 tx=0).stop 2024-09-16T15:38:12.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.115+0000 7f5003f3d640 1 -- 172.21.15.98:0/1578220384 shutdown_connections 2024-09-16T15:38:12.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.115+0000 7f5003f3d640 1 --2- 172.21.15.98:0/1578220384 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f4fe0078850 0x7f4fe007ad10 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:12.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.115+0000 7f5003f3d640 1 --2- 172.21.15.98:0/1578220384 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ffc1438b0 0x7f4ffc09d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:12.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.115+0000 7f5003f3d640 1 --2- 172.21.15.98:0/1578220384 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ffc0ccb30 0x7f4ffc09cbd0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:12.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.115+0000 7f5003f3d640 1 --2- 172.21.15.98:0/1578220384 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4ffc06ff60 0x7f4ffc09b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:12.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.115+0000 7f5003f3d640 1 -- 172.21.15.98:0/1578220384 >> 172.21.15.98:0/1578220384 conn(0x7f4ffc0b1950 msgr2=0x7f4ffc15db80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:12.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.115+0000 7f5003f3d640 1 -- 172.21.15.98:0/1578220384 shutdown_connections 2024-09-16T15:38:12.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.115+0000 7f5003f3d640 1 -- 172.21.15.98:0/1578220384 wait complete. 2024-09-16T15:38:12.127 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-09-16T15:38:12.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T15:38:12.127 DEBUG:teuthology.orchestra.run.smithi098:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-09-16T15:38:12.153 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi098.front.sepia.ceph.com 2024-09-16T15:38:12.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T15:38:12.153 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-16T15:38:12.208 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-16T15:38:12.208 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T15:38:12.228 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-16T15:38:12.228 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T15:38:12.287 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-16T15:38:12.287 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T15:38:12.345 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-16T15:38:12.451 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.450+0000 7f9d27233640 1 -- 172.21.15.98:0/2951291689 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9d20073ea0 msgr2=0x7f9d200cb390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:12.451 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.450+0000 7f9d27233640 1 --2- 172.21.15.98:0/2951291689 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9d20073ea0 0x7f9d200cb390 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9d2006f5a0 tx=0x7f9d1802a5f0 comp rx=0 tx=0).stop 2024-09-16T15:38:12.452 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.450+0000 7f9d27233640 1 -- 172.21.15.98:0/2951291689 shutdown_connections 2024-09-16T15:38:12.452 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.450+0000 7f9d27233640 1 --2- 172.21.15.98:0/2951291689 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9d20073ea0 0x7f9d200cb390 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:12.452 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.450+0000 7f9d27233640 1 --2- 172.21.15.98:0/2951291689 >> v2:172.21.15.135:3300/0 conn(0x7f9d2015ac00 0x7f9d200cf830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:12.452 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.450+0000 7f9d27233640 1 -- 172.21.15.98:0/2951291689 >> 172.21.15.98:0/2951291689 conn(0x7f9d200d0d40 msgr2=0x7f9d200d1120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:12.452 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.450+0000 7f9d27233640 1 -- 172.21.15.98:0/2951291689 shutdown_connections 2024-09-16T15:38:12.452 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.450+0000 7f9d27233640 1 -- 172.21.15.98:0/2951291689 wait complete. 2024-09-16T15:38:12.452 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.451+0000 7f9d27233640 1 Processor -- start 2024-09-16T15:38:12.452 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.451+0000 7f9d27233640 1 -- start start 2024-09-16T15:38:12.454 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.452+0000 7f9d27233640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9d20073ea0 0x7f9d200b0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:12.455 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.452+0000 7f9d27233640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9d200ce910 0x7f9d201f2df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:12.455 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.452+0000 7f9d27233640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d2015ac00 0x7f9d2006cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:12.455 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.452+0000 7f9d27233640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9d200cba50 con 0x7f9d200ce910 2024-09-16T15:38:12.455 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.452+0000 7f9d27233640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9d200cb8d0 con 0x7f9d2015ac00 2024-09-16T15:38:12.455 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.452+0000 7f9d27233640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f9d200cbbd0 con 0x7f9d20073ea0 2024-09-16T15:38:12.455 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.452+0000 7f9d1ffff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9d200ce910 0x7f9d201f2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:12.455 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.452+0000 7f9d1ffff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9d200ce910 0x7f9d201f2df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54702/0 (socket says 172.21.15.98:54702) 2024-09-16T15:38:12.455 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.453+0000 7f9d1ffff640 1 -- 172.21.15.98:0/2677289891 learned_addr learned my addr 172.21.15.98:0/2677289891 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:12.455 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.453+0000 7f9d257d0640 1 --2- 172.21.15.98:0/2677289891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d2015ac00 0x7f9d2006cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:12.455 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.453+0000 7f9d24fcf640 1 --2- 172.21.15.98:0/2677289891 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9d20073ea0 0x7f9d200b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:12.455 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.453+0000 7f9d1ffff640 1 -- 172.21.15.98:0/2677289891 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9d20073ea0 msgr2=0x7f9d200b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:12.455 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.453+0000 7f9d1ffff640 1 --2- 172.21.15.98:0/2677289891 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9d20073ea0 0x7f9d200b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:12.455 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.453+0000 7f9d1ffff640 1 -- 172.21.15.98:0/2677289891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d2015ac00 msgr2=0x7f9d2006cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:12.455 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.453+0000 7f9d1ffff640 1 --2- 172.21.15.98:0/2677289891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d2015ac00 0x7f9d2006cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:12.455 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.453+0000 7f9d1ffff640 1 -- 172.21.15.98:0/2677289891 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d2015e780 con 0x7f9d200ce910 2024-09-16T15:38:12.456 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.453+0000 7f9d24fcf640 1 --2- 172.21.15.98:0/2677289891 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9d20073ea0 0x7f9d200b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T15:38:12.456 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.453+0000 7f9d1ffff640 1 --2- 172.21.15.98:0/2677289891 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9d200ce910 0x7f9d201f2df0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9d0800c790 tx=0x7f9d0800cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:12.456 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.453+0000 7f9d1d7fa640 1 -- 172.21.15.98:0/2677289891 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d08003da0 con 0x7f9d200ce910 2024-09-16T15:38:12.456 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.453+0000 7f9d1d7fa640 1 -- 172.21.15.98:0/2677289891 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9d08005070 con 0x7f9d200ce910 2024-09-16T15:38:12.456 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.453+0000 7f9d1d7fa640 1 -- 172.21.15.98:0/2677289891 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d080054e0 con 0x7f9d200ce910 2024-09-16T15:38:12.456 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.453+0000 7f9d27233640 1 -- 172.21.15.98:0/2677289891 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d2015ea60 con 0x7f9d200ce910 2024-09-16T15:38:12.456 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.453+0000 7f9d27233640 1 -- 172.21.15.98:0/2677289891 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d201f38b0 con 0x7f9d200ce910 2024-09-16T15:38:12.457 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.454+0000 7f9d27233640 1 -- 172.21.15.98:0/2677289891 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d201f3ab0 con 0x7f9d200ce910 2024-09-16T15:38:12.457 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.455+0000 7f9d1d7fa640 1 -- 172.21.15.98:0/2677289891 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7f9d08005680 con 0x7f9d200ce910 2024-09-16T15:38:12.457 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.455+0000 7f9d1d7fa640 1 --2- 172.21.15.98:0/2677289891 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f9d00078880 0x7f9d0007ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:12.457 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.455+0000 7f9d1d7fa640 1 -- 172.21.15.98:0/2677289891 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f9d0809a750 con 0x7f9d200ce910 2024-09-16T15:38:12.457 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.455+0000 7f9d24fcf640 1 --2- 172.21.15.98:0/2677289891 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f9d00078880 0x7f9d0007ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:12.457 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.456+0000 7f9d24fcf640 1 --2- 172.21.15.98:0/2677289891 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f9d00078880 0x7f9d0007ad40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9d10009aa0 tx=0x7f9d10005db0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:12.460 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.459+0000 7f9d1d7fa640 1 -- 172.21.15.98:0/2677289891 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7f9d201f3ab0 con 0x7f9d200ce910 2024-09-16T15:38:12.648 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.647+0000 7f9d27233640 1 -- 172.21.15.98:0/2677289891 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f9d200cc120 con 0x7f9d200ce910 2024-09-16T15:38:12.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.648+0000 7f9d1d7fa640 1 -- 172.21.15.98:0/2677289891 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7f9d08062e50 con 0x7f9d200ce910 2024-09-16T15:38:12.649 INFO:teuthology.orchestra.run.smithi098.stderr:listed 0 entries 2024-09-16T15:38:12.651 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.650+0000 7f9d27233640 1 -- 172.21.15.98:0/2677289891 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f9d00078880 msgr2=0x7f9d0007ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:12.651 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.650+0000 7f9d27233640 1 --2- 172.21.15.98:0/2677289891 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f9d00078880 0x7f9d0007ad40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9d10009aa0 tx=0x7f9d10005db0 comp rx=0 tx=0).stop 2024-09-16T15:38:12.651 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.650+0000 7f9d27233640 1 -- 172.21.15.98:0/2677289891 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9d200ce910 msgr2=0x7f9d201f2df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:12.651 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.650+0000 7f9d27233640 1 --2- 172.21.15.98:0/2677289891 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9d200ce910 0x7f9d201f2df0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9d0800c790 tx=0x7f9d0800cc50 comp rx=0 tx=0).stop 2024-09-16T15:38:12.651 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.650+0000 7f9d27233640 1 -- 172.21.15.98:0/2677289891 shutdown_connections 2024-09-16T15:38:12.651 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.650+0000 7f9d27233640 1 --2- 172.21.15.98:0/2677289891 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f9d00078880 0x7f9d0007ad40 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:12.651 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.650+0000 7f9d27233640 1 --2- 172.21.15.98:0/2677289891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d2015ac00 0x7f9d2006cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:12.652 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.650+0000 7f9d27233640 1 --2- 172.21.15.98:0/2677289891 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9d200ce910 0x7f9d201f2df0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:12.652 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.650+0000 7f9d27233640 1 --2- 172.21.15.98:0/2677289891 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9d20073ea0 0x7f9d200b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:12.652 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.650+0000 7f9d27233640 1 -- 172.21.15.98:0/2677289891 >> 172.21.15.98:0/2677289891 conn(0x7f9d200d0d40 msgr2=0x7f9d200b4c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:12.652 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.650+0000 7f9d27233640 1 -- 172.21.15.98:0/2677289891 shutdown_connections 2024-09-16T15:38:12.652 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.650+0000 7f9d27233640 1 -- 172.21.15.98:0/2677289891 wait complete. 2024-09-16T15:38:12.662 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-09-16T15:38:12.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T15:38:12.662 DEBUG:teuthology.orchestra.run.smithi135:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-09-16T15:38:12.673 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T15:38:12.675 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T15:38:12.694 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi135.front.sepia.ceph.com 2024-09-16T15:38:12.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T15:38:12.695 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-16T15:38:12.752 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-16T15:38:12.752 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T15:38:12.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.854+0000 7fdf7687f640 1 -- 172.21.15.98:0/3099733810 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdf5c004d40 msgr2=0x7fdf5c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:12.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.854+0000 7fdf7687f640 1 --2- 172.21.15.98:0/3099733810 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdf5c004d40 0x7fdf5c0051c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fdf680043b0 tx=0x7fdf5c005830 comp rx=0 tx=0).stop 2024-09-16T15:38:12.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.854+0000 7fdf74e1c640 1 -- 172.21.15.98:0/3099733810 reap_dead start 2024-09-16T15:38:12.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.854+0000 7fdf7687f640 1 -- 172.21.15.98:0/3099733810 shutdown_connections 2024-09-16T15:38:12.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.854+0000 7fdf7687f640 1 -- 172.21.15.98:0/3099733810 >> 172.21.15.98:0/3099733810 conn(0x7fdf700d3fe0 msgr2=0x7fdf700d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:12.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.854+0000 7fdf7687f640 1 -- 172.21.15.98:0/3099733810 shutdown_connections 2024-09-16T15:38:12.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.854+0000 7fdf7687f640 1 -- 172.21.15.98:0/3099733810 wait complete. 2024-09-16T15:38:12.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.855+0000 7fdf7687f640 1 Processor -- start 2024-09-16T15:38:12.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.855+0000 7fdf7687f640 1 -- start start 2024-09-16T15:38:12.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.856+0000 7fdf7687f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf5c004d40 0x7fdf701f80e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:12.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.856+0000 7fdf7687f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdf7014bfd0 0x7fdf7014c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:12.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.856+0000 7fdf7687f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdf700ccd60 0x7fdf700cd1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:12.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.856+0000 7fdf7687f640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fdf700cf3d0 con 0x7fdf700ccd60 2024-09-16T15:38:12.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.856+0000 7fdf7687f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdf700d0cb0 con 0x7fdf5c004d40 2024-09-16T15:38:12.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.856+0000 7fdf7687f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fdf700cf550 con 0x7fdf7014bfd0 2024-09-16T15:38:12.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.856+0000 7fdf74e1c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdf700ccd60 0x7fdf700cd1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:12.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.856+0000 7fdf74e1c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdf700ccd60 0x7fdf700cd1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54706/0 (socket says 172.21.15.98:54706) 2024-09-16T15:38:12.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.856+0000 7fdf74e1c640 1 -- 172.21.15.98:0/2055296347 learned_addr learned my addr 172.21.15.98:0/2055296347 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:12.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.856+0000 7fdf6f7fe640 1 --2- 172.21.15.98:0/2055296347 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdf7014bfd0 0x7fdf7014c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:12.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.856+0000 7fdf6ffff640 1 --2- 172.21.15.98:0/2055296347 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf5c004d40 0x7fdf701f80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:12.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.856+0000 7fdf74e1c640 1 -- 172.21.15.98:0/2055296347 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdf7014bfd0 msgr2=0x7fdf7014c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:12.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.856+0000 7fdf74e1c640 1 --2- 172.21.15.98:0/2055296347 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdf7014bfd0 0x7fdf7014c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:12.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.856+0000 7fdf74e1c640 1 -- 172.21.15.98:0/2055296347 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf5c004d40 msgr2=0x7fdf701f80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:12.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.856+0000 7fdf74e1c640 1 --2- 172.21.15.98:0/2055296347 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf5c004d40 0x7fdf701f80e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:12.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.856+0000 7fdf74e1c640 1 -- 172.21.15.98:0/2055296347 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf700cdb00 con 0x7fdf700ccd60 2024-09-16T15:38:12.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.857+0000 7fdf74e1c640 1 --2- 172.21.15.98:0/2055296347 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdf700ccd60 0x7fdf700cd1e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fdf6802abb0 tx=0x7fdf68006d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:12.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.857+0000 7fdf6cff9640 1 -- 172.21.15.98:0/2055296347 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf68042070 con 0x7fdf700ccd60 2024-09-16T15:38:12.860 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.857+0000 7fdf6cff9640 1 -- 172.21.15.98:0/2055296347 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdf68006270 con 0x7fdf700ccd60 2024-09-16T15:38:12.860 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.857+0000 7fdf7687f640 1 -- 172.21.15.98:0/2055296347 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf701f5ae0 con 0x7fdf700ccd60 2024-09-16T15:38:12.860 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.857+0000 7fdf6cff9640 1 -- 172.21.15.98:0/2055296347 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf68037040 con 0x7fdf700ccd60 2024-09-16T15:38:12.860 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.857+0000 7fdf7687f640 1 -- 172.21.15.98:0/2055296347 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf701f60a0 con 0x7fdf700ccd60 2024-09-16T15:38:12.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.858+0000 7fdf7687f640 1 -- 172.21.15.98:0/2055296347 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf700cecc0 con 0x7fdf700ccd60 2024-09-16T15:38:12.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.858+0000 7fdf6cff9640 1 -- 172.21.15.98:0/2055296347 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7fdf68006680 con 0x7fdf700ccd60 2024-09-16T15:38:12.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.859+0000 7fdf6cff9640 1 --2- 172.21.15.98:0/2055296347 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fdf50078850 0x7fdf5007ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:12.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.859+0000 7fdf6cff9640 1 -- 172.21.15.98:0/2055296347 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fdf680ba460 con 0x7fdf700ccd60 2024-09-16T15:38:12.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.859+0000 7fdf6ffff640 1 --2- 172.21.15.98:0/2055296347 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fdf50078850 0x7fdf5007ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:12.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.859+0000 7fdf6ffff640 1 --2- 172.21.15.98:0/2055296347 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fdf50078850 0x7fdf5007ad10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fdf700ce600 tx=0x7fdf6000b260 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:12.864 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:12.863+0000 7fdf6cff9640 1 -- 172.21.15.98:0/2055296347 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7fdf68082480 con 0x7fdf700ccd60 2024-09-16T15:38:13.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.076+0000 7fdf7687f640 1 -- 172.21.15.98:0/2055296347 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdf7006efb0 con 0x7fdf700ccd60 2024-09-16T15:38:13.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.077+0000 7fdf6cff9640 1 -- 172.21.15.98:0/2055296347 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5220 (secure 0 0 0) 0x7fdf68086eb0 con 0x7fdf700ccd60 2024-09-16T15:38:13.078 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:38:13.078 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":7,"btime":"2024-09-16T15:37:47:522910+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4348,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/808747266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":808747266},{"type":"v1","addr":"172.21.15.135:6836","nonce":808747266}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4351,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/1940037746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":1940037746},{"type":"v1","addr":"172.21.15.135:6837","nonce":1940037746}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4353,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6834/3679859923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":3679859923},{"type":"v1","addr":"172.21.15.98:6834","nonce":3679859923}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T15:37:43.891616+0000","modified":"2024-09-16T15:37:46.529306+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4356},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4356":{"gid":4356,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.98:6835/1824614871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6833","nonce":1824614871},{"type":"v1","addr":"172.21.15.98:6835","nonce":1824614871}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4356,"qdb_cluster":[4356]},"id":1}]} 2024-09-16T15:38:13.078 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 7 2024-09-16T15:38:13.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.079+0000 7fdf7687f640 1 -- 172.21.15.98:0/2055296347 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fdf50078850 msgr2=0x7fdf5007ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:13.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.079+0000 7fdf7687f640 1 --2- 172.21.15.98:0/2055296347 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fdf50078850 0x7fdf5007ad10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fdf700ce600 tx=0x7fdf6000b260 comp rx=0 tx=0).stop 2024-09-16T15:38:13.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.079+0000 7fdf7687f640 1 -- 172.21.15.98:0/2055296347 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdf700ccd60 msgr2=0x7fdf700cd1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:13.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.079+0000 7fdf7687f640 1 --2- 172.21.15.98:0/2055296347 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdf700ccd60 0x7fdf700cd1e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fdf6802abb0 tx=0x7fdf68006d30 comp rx=0 tx=0).stop 2024-09-16T15:38:13.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.079+0000 7fdf7687f640 1 -- 172.21.15.98:0/2055296347 shutdown_connections 2024-09-16T15:38:13.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.079+0000 7fdf7687f640 1 --2- 172.21.15.98:0/2055296347 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdf700ccd60 0x7fdf700cd1e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:13.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.079+0000 7fdf7687f640 1 --2- 172.21.15.98:0/2055296347 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdf7014bfd0 0x7fdf7014c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:13.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.079+0000 7fdf7687f640 1 --2- 172.21.15.98:0/2055296347 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fdf50078850 0x7fdf5007ad10 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:13.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.079+0000 7fdf7687f640 1 --2- 172.21.15.98:0/2055296347 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf5c004d40 0x7fdf701f80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:13.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.079+0000 7fdf7687f640 1 -- 172.21.15.98:0/2055296347 >> 172.21.15.98:0/2055296347 conn(0x7fdf700d3fe0 msgr2=0x7fdf70160aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:13.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.079+0000 7fdf7687f640 1 -- 172.21.15.98:0/2055296347 shutdown_connections 2024-09-16T15:38:13.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.079+0000 7fdf7687f640 1 -- 172.21.15.98:0/2055296347 wait complete. 2024-09-16T15:38:13.091 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T15:38:13.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.192+0000 7f909f13d640 1 -- 172.21.15.98:0/2478472719 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9084003a00 msgr2=0x7f9084003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:13.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.192+0000 7f909f13d640 1 --2- 172.21.15.98:0/2478472719 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9084003a00 0x7f9084003e00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f908800ad20 tx=0x7f9084005830 comp rx=0 tx=0).stop 2024-09-16T15:38:13.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.192+0000 7f909f13d640 1 -- 172.21.15.98:0/2478472719 shutdown_connections 2024-09-16T15:38:13.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.192+0000 7f909f13d640 1 --2- 172.21.15.98:0/2478472719 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9084003a00 0x7f9084003e00 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:13.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.192+0000 7f909f13d640 1 -- 172.21.15.98:0/2478472719 >> 172.21.15.98:0/2478472719 conn(0x7f90980d1eb0 msgr2=0x7f90980d22c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:13.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.192+0000 7f909f13d640 1 -- 172.21.15.98:0/2478472719 shutdown_connections 2024-09-16T15:38:13.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.192+0000 7f909f13d640 1 -- 172.21.15.98:0/2478472719 wait complete. 2024-09-16T15:38:13.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.193+0000 7f909f13d640 1 Processor -- start 2024-09-16T15:38:13.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.193+0000 7f909f13d640 1 -- start start 2024-09-16T15:38:13.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.194+0000 7f909f13d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9084003a00 0x7f90980b7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:13.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.194+0000 7f909f13d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f90980b7990 0x7f90980c57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:13.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.194+0000 7f909f13d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90980c7340 0x7f90981f2de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:13.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.194+0000 7f909f13d640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f90980d2db0 con 0x7f90980c7340 2024-09-16T15:38:13.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.194+0000 7f909f13d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f90980d2c30 con 0x7f90980b7990 2024-09-16T15:38:13.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.194+0000 7f909f13d640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f90980cefa0 con 0x7f9084003a00 2024-09-16T15:38:13.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.194+0000 7f909d6da640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90980c7340 0x7f90981f2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:13.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.194+0000 7f909d6da640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90980c7340 0x7f90981f2de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54724/0 (socket says 172.21.15.98:54724) 2024-09-16T15:38:13.197 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.194+0000 7f909d6da640 1 -- 172.21.15.98:0/658105281 learned_addr learned my addr 172.21.15.98:0/658105281 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:13.197 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.194+0000 7f909ced9640 1 --2- 172.21.15.98:0/658105281 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9084003a00 0x7f90980b7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:13.197 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.194+0000 7f9097fff640 1 --2- 172.21.15.98:0/658105281 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f90980b7990 0x7f90980c57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:13.197 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.194+0000 7f909d6da640 1 -- 172.21.15.98:0/658105281 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9084003a00 msgr2=0x7f90980b7450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:13.197 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.194+0000 7f909d6da640 1 --2- 172.21.15.98:0/658105281 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9084003a00 0x7f90980b7450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:13.197 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.194+0000 7f909d6da640 1 -- 172.21.15.98:0/658105281 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f90980b7990 msgr2=0x7f90980c57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:13.197 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.194+0000 7f909d6da640 1 --2- 172.21.15.98:0/658105281 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f90980b7990 0x7f90980c57a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:13.197 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.194+0000 7f909d6da640 1 -- 172.21.15.98:0/658105281 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90980c62a0 con 0x7f90980c7340 2024-09-16T15:38:13.197 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.194+0000 7f909d6da640 1 --2- 172.21.15.98:0/658105281 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90980c7340 0x7f90981f2de0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9090000c00 tx=0x7f9090001840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:13.197 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.195+0000 7f90957fa640 1 -- 172.21.15.98:0/658105281 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9090010890 con 0x7f90980c7340 2024-09-16T15:38:13.197 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.195+0000 7f90957fa640 1 -- 172.21.15.98:0/658105281 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9090016070 con 0x7f90980c7340 2024-09-16T15:38:13.197 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.195+0000 7f90957fa640 1 -- 172.21.15.98:0/658105281 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9090010dc0 con 0x7f90980c7340 2024-09-16T15:38:13.197 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.195+0000 7f909f13d640 1 -- 172.21.15.98:0/658105281 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90980c6580 con 0x7f90980c7340 2024-09-16T15:38:13.198 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.195+0000 7f909f13d640 1 -- 172.21.15.98:0/658105281 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90980c6b40 con 0x7f90980c7340 2024-09-16T15:38:13.198 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.196+0000 7f909f13d640 1 -- 172.21.15.98:0/658105281 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90980c7030 con 0x7f90980c7340 2024-09-16T15:38:13.199 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.196+0000 7f90957fa640 1 -- 172.21.15.98:0/658105281 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7f909001b460 con 0x7f90980c7340 2024-09-16T15:38:13.199 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.197+0000 7f90957fa640 1 --2- 172.21.15.98:0/658105281 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f9078078850 0x7f907807ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:13.199 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.197+0000 7f90957fa640 1 -- 172.21.15.98:0/658105281 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f909009aad0 con 0x7f90980c7340 2024-09-16T15:38:13.199 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.197+0000 7f909ced9640 1 --2- 172.21.15.98:0/658105281 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f9078078850 0x7f907807ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:13.199 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.198+0000 7f909ced9640 1 --2- 172.21.15.98:0/658105281 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f9078078850 0x7f907807ad10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9088033000 tx=0x7f9088004a40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:13.201 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.201+0000 7f90957fa640 1 -- 172.21.15.98:0/658105281 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7f9090062af0 con 0x7f90980c7340 2024-09-16T15:38:13.413 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.412+0000 7f909f13d640 1 -- 172.21.15.98:0/658105281 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f90980b15f0 con 0x7f90980c7340 2024-09-16T15:38:13.414 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.413+0000 7f90957fa640 1 -- 172.21.15.98:0/658105281 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5220 (secure 0 0 0) 0x7f9090067520 con 0x7f90980c7340 2024-09-16T15:38:13.414 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:38:13.414 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":7,"btime":"2024-09-16T15:37:47:522910+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4348,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/808747266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":808747266},{"type":"v1","addr":"172.21.15.135:6836","nonce":808747266}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4351,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/1940037746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":1940037746},{"type":"v1","addr":"172.21.15.135:6837","nonce":1940037746}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4353,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6834/3679859923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":3679859923},{"type":"v1","addr":"172.21.15.98:6834","nonce":3679859923}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T15:37:43.891616+0000","modified":"2024-09-16T15:37:46.529306+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4356},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4356":{"gid":4356,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.98:6835/1824614871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6833","nonce":1824614871},{"type":"v1","addr":"172.21.15.98:6835","nonce":1824614871}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4356,"qdb_cluster":[4356]},"id":1}]} 2024-09-16T15:38:13.414 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 7 2024-09-16T15:38:13.416 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.415+0000 7f909f13d640 1 -- 172.21.15.98:0/658105281 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f9078078850 msgr2=0x7f907807ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:13.416 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.415+0000 7f909f13d640 1 --2- 172.21.15.98:0/658105281 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f9078078850 0x7f907807ad10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9088033000 tx=0x7f9088004a40 comp rx=0 tx=0).stop 2024-09-16T15:38:13.416 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.415+0000 7f909f13d640 1 -- 172.21.15.98:0/658105281 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90980c7340 msgr2=0x7f90981f2de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:13.416 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.415+0000 7f909f13d640 1 --2- 172.21.15.98:0/658105281 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90980c7340 0x7f90981f2de0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9090000c00 tx=0x7f9090001840 comp rx=0 tx=0).stop 2024-09-16T15:38:13.416 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.415+0000 7f909f13d640 1 -- 172.21.15.98:0/658105281 shutdown_connections 2024-09-16T15:38:13.416 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.415+0000 7f909f13d640 1 --2- 172.21.15.98:0/658105281 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90980c7340 0x7f90981f2de0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:13.417 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.415+0000 7f909f13d640 1 --2- 172.21.15.98:0/658105281 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f9078078850 0x7f907807ad10 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:13.417 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.415+0000 7f909f13d640 1 --2- 172.21.15.98:0/658105281 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f90980b7990 0x7f90980c57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:13.417 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.415+0000 7f909f13d640 1 --2- 172.21.15.98:0/658105281 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9084003a00 0x7f90980b7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:13.417 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.415+0000 7f909f13d640 1 -- 172.21.15.98:0/658105281 >> 172.21.15.98:0/658105281 conn(0x7f90980d1eb0 msgr2=0x7f90980d2290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:13.417 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.415+0000 7f909f13d640 1 -- 172.21.15.98:0/658105281 shutdown_connections 2024-09-16T15:38:13.417 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.415+0000 7f909f13d640 1 -- 172.21.15.98:0/658105281 wait complete. 2024-09-16T15:38:13.427 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T15:38:13.528 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.527+0000 7fdb3f07f640 1 -- 172.21.15.98:0/4009289416 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdb380b50c0 msgr2=0x7fdb38161230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:13.529 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.527+0000 7fdb3f07f640 1 --2- 172.21.15.98:0/4009289416 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdb380b50c0 0x7fdb38161230 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fdb20009830 tx=0x7fdb2002a640 comp rx=0 tx=0).stop 2024-09-16T15:38:13.529 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.527+0000 7fdb3f07f640 1 -- 172.21.15.98:0/4009289416 shutdown_connections 2024-09-16T15:38:13.529 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.527+0000 7fdb3f07f640 1 --2- 172.21.15.98:0/4009289416 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdb380b50c0 0x7fdb38161230 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:13.529 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.527+0000 7fdb3f07f640 1 -- 172.21.15.98:0/4009289416 >> 172.21.15.98:0/4009289416 conn(0x7fdb380d3fe0 msgr2=0x7fdb380d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:13.529 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.527+0000 7fdb3f07f640 1 -- 172.21.15.98:0/4009289416 shutdown_connections 2024-09-16T15:38:13.529 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.527+0000 7fdb3f07f640 1 -- 172.21.15.98:0/4009289416 wait complete. 2024-09-16T15:38:13.529 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.528+0000 7fdb3f07f640 1 Processor -- start 2024-09-16T15:38:13.529 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.528+0000 7fdb3f07f640 1 -- start start 2024-09-16T15:38:13.531 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.529+0000 7fdb3f07f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdb380b50c0 0x7fdb38157b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:13.532 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.529+0000 7fdb3f07f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb380d21c0 0x7fdb3809f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:13.532 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.529+0000 7fdb3f07f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdb38161770 0x7fdb380d11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:13.532 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.529+0000 7fdb3f07f640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fdb380b25c0 con 0x7fdb38161770 2024-09-16T15:38:13.532 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.529+0000 7fdb3f07f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdb380d2ea0 con 0x7fdb380d21c0 2024-09-16T15:38:13.532 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.529+0000 7fdb3f07f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fdb380b2740 con 0x7fdb380b50c0 2024-09-16T15:38:13.532 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.529+0000 7fdb3d61c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdb38161770 0x7fdb380d11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:13.532 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.529+0000 7fdb3d61c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdb38161770 0x7fdb380d11b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54738/0 (socket says 172.21.15.98:54738) 2024-09-16T15:38:13.532 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.529+0000 7fdb3d61c640 1 -- 172.21.15.98:0/4139049940 learned_addr learned my addr 172.21.15.98:0/4139049940 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:13.532 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.530+0000 7fdb37fff640 1 --2- 172.21.15.98:0/4139049940 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb380d21c0 0x7fdb3809f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:13.532 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.530+0000 7fdb3ce1b640 1 --2- 172.21.15.98:0/4139049940 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdb380b50c0 0x7fdb38157b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:13.532 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.530+0000 7fdb3d61c640 1 -- 172.21.15.98:0/4139049940 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdb380b50c0 msgr2=0x7fdb38157b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:13.532 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.530+0000 7fdb3d61c640 1 --2- 172.21.15.98:0/4139049940 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdb380b50c0 0x7fdb38157b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:13.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.530+0000 7fdb3d61c640 1 -- 172.21.15.98:0/4139049940 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb380d21c0 msgr2=0x7fdb3809f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:13.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.530+0000 7fdb3d61c640 1 --2- 172.21.15.98:0/4139049940 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb380d21c0 0x7fdb3809f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:13.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.530+0000 7fdb3d61c640 1 -- 172.21.15.98:0/4139049940 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb380cb250 con 0x7fdb38161770 2024-09-16T15:38:13.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.530+0000 7fdb3d61c640 1 --2- 172.21.15.98:0/4139049940 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdb38161770 0x7fdb380d11b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fdb2800c390 tx=0x7fdb2800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:13.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.530+0000 7fdb357fa640 1 -- 172.21.15.98:0/4139049940 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb28017070 con 0x7fdb38161770 2024-09-16T15:38:13.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.530+0000 7fdb357fa640 1 -- 172.21.15.98:0/4139049940 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdb280035f0 con 0x7fdb38161770 2024-09-16T15:38:13.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.530+0000 7fdb3f07f640 1 -- 172.21.15.98:0/4139049940 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb380cb530 con 0x7fdb38161770 2024-09-16T15:38:13.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.530+0000 7fdb357fa640 1 -- 172.21.15.98:0/4139049940 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb28003a40 con 0x7fdb38161770 2024-09-16T15:38:13.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.530+0000 7fdb3f07f640 1 -- 172.21.15.98:0/4139049940 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb380cbaf0 con 0x7fdb38161770 2024-09-16T15:38:13.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.531+0000 7fdb3f07f640 1 -- 172.21.15.98:0/4139049940 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb380b2c60 con 0x7fdb38161770 2024-09-16T15:38:13.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.532+0000 7fdb357fa640 1 -- 172.21.15.98:0/4139049940 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7fdb2801a070 con 0x7fdb38161770 2024-09-16T15:38:13.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.532+0000 7fdb357fa640 1 --2- 172.21.15.98:0/4139049940 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fdb1c078880 0x7fdb1c07ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:13.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.532+0000 7fdb357fa640 1 -- 172.21.15.98:0/4139049940 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fdb28099990 con 0x7fdb38161770 2024-09-16T15:38:13.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.533+0000 7fdb3ce1b640 1 --2- 172.21.15.98:0/4139049940 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fdb1c078880 0x7fdb1c07ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:13.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.533+0000 7fdb3ce1b640 1 --2- 172.21.15.98:0/4139049940 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fdb1c078880 0x7fdb1c07ad40 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fdb30007fd0 tx=0x7fdb30009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:13.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.536+0000 7fdb357fa640 1 -- 172.21.15.98:0/4139049940 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7fdb28062090 con 0x7fdb38161770 2024-09-16T15:38:13.713 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.712+0000 7fdb3f07f640 1 -- 172.21.15.98:0/4139049940 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdb38158040 con 0x7fdb38161770 2024-09-16T15:38:13.714 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.713+0000 7fdb357fa640 1 -- 172.21.15.98:0/4139049940 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16681 (secure 0 0 0) 0x7fdb28061990 con 0x7fdb38161770 2024-09-16T15:38:13.714 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:38:13.714 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":23,"fsid":"52a38a45-21d2-4cb0-bb3a-4fb8be3a08df","created":"2024-09-16T15:37:20.387654+0000","modified":"2024-09-16T15:37:45.512714+0000","last_up_change":"2024-09-16T15:37:33.417470+0000","last_in_change":"2024-09-16T15:37:23.430578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T15:37:34.725090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-16T15:37:42.223874+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-16T15:37:42.808291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a2d61df4-2577-47e6-a4ac-c36bbb85ab8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1967099790},{"type":"v1","addr":"172.21.15.98:6825","nonce":1967099790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1967099790},{"type":"v1","addr":"172.21.15.98:6827","nonce":1967099790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":1967099790},{"type":"v1","addr":"172.21.15.98:6831","nonce":1967099790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1967099790},{"type":"v1","addr":"172.21.15.98:6829","nonce":1967099790}]},"public_addr":"172.21.15.98:6825/1967099790","cluster_addr":"172.21.15.98:6827/1967099790","heartbeat_back_addr":"172.21.15.98:6831/1967099790","heartbeat_front_addr":"172.21.15.98:6829/1967099790","state":["exists","up"]},{"osd":1,"uuid":"bb3a68a5-c22f-442b-b292-7c272fe01ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":3571460482},{"type":"v1","addr":"172.21.15.98:6809","nonce":3571460482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":3571460482},{"type":"v1","addr":"172.21.15.98:6811","nonce":3571460482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":3571460482},{"type":"v1","addr":"172.21.15.98:6815","nonce":3571460482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":3571460482},{"type":"v1","addr":"172.21.15.98:6813","nonce":3571460482}]},"public_addr":"172.21.15.98:6809/3571460482","cluster_addr":"172.21.15.98:6811/3571460482","heartbeat_back_addr":"172.21.15.98:6815/3571460482","heartbeat_front_addr":"172.21.15.98:6813/3571460482","state":["exists","up"]},{"osd":2,"uuid":"c8429195-a480-409b-8e5f-8dc4c6abc0a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":2573210695},{"type":"v1","addr":"172.21.15.98:6801","nonce":2573210695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":2573210695},{"type":"v1","addr":"172.21.15.98:6803","nonce":2573210695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":2573210695},{"type":"v1","addr":"172.21.15.98:6807","nonce":2573210695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":2573210695},{"type":"v1","addr":"172.21.15.98:6805","nonce":2573210695}]},"public_addr":"172.21.15.98:6801/2573210695","cluster_addr":"172.21.15.98:6803/2573210695","heartbeat_back_addr":"172.21.15.98:6807/2573210695","heartbeat_front_addr":"172.21.15.98:6805/2573210695","state":["exists","up"]},{"osd":3,"uuid":"0e800d7b-096f-4f65-b3cc-c7cda3870de4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":3951374837},{"type":"v1","addr":"172.21.15.98:6817","nonce":3951374837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":3951374837},{"type":"v1","addr":"172.21.15.98:6819","nonce":3951374837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":3951374837},{"type":"v1","addr":"172.21.15.98:6823","nonce":3951374837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":3951374837},{"type":"v1","addr":"172.21.15.98:6821","nonce":3951374837}]},"public_addr":"172.21.15.98:6817/3951374837","cluster_addr":"172.21.15.98:6819/3951374837","heartbeat_back_addr":"172.21.15.98:6823/3951374837","heartbeat_front_addr":"172.21.15.98:6821/3951374837","state":["exists","up"]},{"osd":4,"uuid":"c7822e9b-8e29-48d9-b92a-e8f9c7bc5247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":724302036},{"type":"v1","addr":"172.21.15.135:6811","nonce":724302036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":724302036},{"type":"v1","addr":"172.21.15.135:6813","nonce":724302036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":724302036},{"type":"v1","addr":"172.21.15.135:6817","nonce":724302036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":724302036},{"type":"v1","addr":"172.21.15.135:6815","nonce":724302036}]},"public_addr":"172.21.15.135:6811/724302036","cluster_addr":"172.21.15.135:6813/724302036","heartbeat_back_addr":"172.21.15.135:6817/724302036","heartbeat_front_addr":"172.21.15.135:6815/724302036","state":["exists","up"]},{"osd":5,"uuid":"35805e02-484a-4404-a78f-aa44f4daa41f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3083482635},{"type":"v1","addr":"172.21.15.135:6803","nonce":3083482635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3083482635},{"type":"v1","addr":"172.21.15.135:6805","nonce":3083482635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3083482635},{"type":"v1","addr":"172.21.15.135:6809","nonce":3083482635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3083482635},{"type":"v1","addr":"172.21.15.135:6807","nonce":3083482635}]},"public_addr":"172.21.15.135:6803/3083482635","cluster_addr":"172.21.15.135:6805/3083482635","heartbeat_back_addr":"172.21.15.135:6809/3083482635","heartbeat_front_addr":"172.21.15.135:6807/3083482635","state":["exists","up"]},{"osd":6,"uuid":"6327ba84-aaeb-41fa-9717-188988ff2c4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3376376340},{"type":"v1","addr":"172.21.15.135:6819","nonce":3376376340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3376376340},{"type":"v1","addr":"172.21.15.135:6821","nonce":3376376340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":3376376340},{"type":"v1","addr":"172.21.15.135:6825","nonce":3376376340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3376376340},{"type":"v1","addr":"172.21.15.135:6823","nonce":3376376340}]},"public_addr":"172.21.15.135:6819/3376376340","cluster_addr":"172.21.15.135:6821/3376376340","heartbeat_back_addr":"172.21.15.135:6825/3376376340","heartbeat_front_addr":"172.21.15.135:6823/3376376340","state":["exists","up"]},{"osd":7,"uuid":"392d0958-dff9-4248-b3d8-a1201c10f354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2559837727},{"type":"v1","addr":"172.21.15.135:6827","nonce":2559837727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2559837727},{"type":"v1","addr":"172.21.15.135:6829","nonce":2559837727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":2559837727},{"type":"v1","addr":"172.21.15.135:6833","nonce":2559837727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2559837727},{"type":"v1","addr":"172.21.15.135:6831","nonce":2559837727}]},"public_addr":"172.21.15.135:6827/2559837727","cluster_addr":"172.21.15.135:6829/2559837727","heartbeat_back_addr":"172.21.15.135:6833/2559837727","heartbeat_front_addr":"172.21.15.135:6831/2559837727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.939904+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.717296+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.785817+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:30.211718+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.973359+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:30.250109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.699327+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:30.173063+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T15:38:13.716 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.715+0000 7fdb3f07f640 1 -- 172.21.15.98:0/4139049940 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fdb1c078880 msgr2=0x7fdb1c07ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:13.717 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.715+0000 7fdb3f07f640 1 --2- 172.21.15.98:0/4139049940 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fdb1c078880 0x7fdb1c07ad40 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fdb30007fd0 tx=0x7fdb30009040 comp rx=0 tx=0).stop 2024-09-16T15:38:13.717 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.715+0000 7fdb3f07f640 1 -- 172.21.15.98:0/4139049940 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdb38161770 msgr2=0x7fdb380d11b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:13.717 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.715+0000 7fdb3f07f640 1 --2- 172.21.15.98:0/4139049940 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdb38161770 0x7fdb380d11b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fdb2800c390 tx=0x7fdb2800c850 comp rx=0 tx=0).stop 2024-09-16T15:38:13.717 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.715+0000 7fdb3f07f640 1 -- 172.21.15.98:0/4139049940 shutdown_connections 2024-09-16T15:38:13.717 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.715+0000 7fdb3f07f640 1 --2- 172.21.15.98:0/4139049940 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdb38161770 0x7fdb380d11b0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:13.717 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.715+0000 7fdb3f07f640 1 --2- 172.21.15.98:0/4139049940 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fdb1c078880 0x7fdb1c07ad40 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:13.717 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.715+0000 7fdb3f07f640 1 --2- 172.21.15.98:0/4139049940 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb380d21c0 0x7fdb3809f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:13.717 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.715+0000 7fdb3f07f640 1 --2- 172.21.15.98:0/4139049940 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdb380b50c0 0x7fdb38157b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:13.717 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.715+0000 7fdb3f07f640 1 -- 172.21.15.98:0/4139049940 >> 172.21.15.98:0/4139049940 conn(0x7fdb380d3fe0 msgr2=0x7fdb380d25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:13.717 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.715+0000 7fdb3f07f640 1 -- 172.21.15.98:0/4139049940 shutdown_connections 2024-09-16T15:38:13.717 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.715+0000 7fdb3f07f640 1 -- 172.21.15.98:0/4139049940 wait complete. 2024-09-16T15:38:13.727 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-16T15:38:13.727 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T15:38:13.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.828+0000 7f45658e4640 1 -- 172.21.15.98:0/273719601 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4548004d40 msgr2=0x7f45480051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:13.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.828+0000 7f45658e4640 1 --2- 172.21.15.98:0/273719601 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4548004d40 0x7f45480051c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f45580016c0 tx=0x7f4548005830 comp rx=0 tx=0).stop 2024-09-16T15:38:13.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.828+0000 7f455f7fe640 1 -- 172.21.15.98:0/273719601 reap_dead start 2024-09-16T15:38:13.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.828+0000 7f45658e4640 1 -- 172.21.15.98:0/273719601 shutdown_connections 2024-09-16T15:38:13.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.828+0000 7f45658e4640 1 -- 172.21.15.98:0/273719601 >> 172.21.15.98:0/273719601 conn(0x7f45600b2850 msgr2=0x7f45600b2c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:13.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.828+0000 7f45658e4640 1 -- 172.21.15.98:0/273719601 shutdown_connections 2024-09-16T15:38:13.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.828+0000 7f45658e4640 1 -- 172.21.15.98:0/273719601 wait complete. 2024-09-16T15:38:13.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.830+0000 7f45658e4640 1 Processor -- start 2024-09-16T15:38:13.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.830+0000 7f45658e4640 1 -- start start 2024-09-16T15:38:13.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.830+0000 7f45658e4640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4548004d40 0x7f45600cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:13.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.830+0000 7f45658e4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f456014d670 0x7f45601f48f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:13.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.830+0000 7f45658e4640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4560154bc0 0x7f45601e5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:13.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.830+0000 7f45658e4640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f45600cc210 con 0x7f4548004d40 2024-09-16T15:38:13.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.830+0000 7f45658e4640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f45600cc090 con 0x7f456014d670 2024-09-16T15:38:13.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.830+0000 7f45658e4640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f45600cc390 con 0x7f4560154bc0 2024-09-16T15:38:13.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.831+0000 7f455effd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4548004d40 0x7f45600cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:13.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.831+0000 7f455effd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4548004d40 0x7f45600cabf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54766/0 (socket says 172.21.15.98:54766) 2024-09-16T15:38:13.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.831+0000 7f455effd640 1 -- 172.21.15.98:0/3290766700 learned_addr learned my addr 172.21.15.98:0/3290766700 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:13.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.831+0000 7f455e7fc640 1 --2- 172.21.15.98:0/3290766700 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f456014d670 0x7f45601f48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:13.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.831+0000 7f455f7fe640 1 --2- 172.21.15.98:0/3290766700 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4560154bc0 0x7f45601e5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:13.834 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.831+0000 7f455effd640 1 -- 172.21.15.98:0/3290766700 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4560154bc0 msgr2=0x7f45601e5740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:13.834 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.831+0000 7f455effd640 1 --2- 172.21.15.98:0/3290766700 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4560154bc0 0x7f45601e5740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:13.834 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.831+0000 7f455effd640 1 -- 172.21.15.98:0/3290766700 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f456014d670 msgr2=0x7f45601f48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:13.834 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.831+0000 7f455effd640 1 --2- 172.21.15.98:0/3290766700 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f456014d670 0x7f45601f48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:13.834 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.831+0000 7f455effd640 1 -- 172.21.15.98:0/3290766700 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45600d19d0 con 0x7f4548004d40 2024-09-16T15:38:13.834 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.831+0000 7f455f7fe640 1 --2- 172.21.15.98:0/3290766700 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4560154bc0 0x7f45601e5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T15:38:13.834 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.831+0000 7f455e7fc640 1 --2- 172.21.15.98:0/3290766700 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f456014d670 0x7f45601f48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T15:38:13.834 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.831+0000 7f455effd640 1 --2- 172.21.15.98:0/3290766700 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4548004d40 0x7f45600cabf0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4550011dc0 tx=0x7f455000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:13.834 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.831+0000 7f4547fff640 1 -- 172.21.15.98:0/3290766700 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4550003d80 con 0x7f4548004d40 2024-09-16T15:38:13.834 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.831+0000 7f4547fff640 1 -- 172.21.15.98:0/3290766700 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4550004b20 con 0x7f4548004d40 2024-09-16T15:38:13.834 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.831+0000 7f4547fff640 1 -- 172.21.15.98:0/3290766700 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4550004050 con 0x7f4548004d40 2024-09-16T15:38:13.834 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.831+0000 7f45658e4640 1 -- 172.21.15.98:0/3290766700 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45600b47b0 con 0x7f4548004d40 2024-09-16T15:38:13.834 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.831+0000 7f45658e4640 1 -- 172.21.15.98:0/3290766700 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45600c7e30 con 0x7f4548004d40 2024-09-16T15:38:13.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.832+0000 7f45658e4640 1 -- 172.21.15.98:0/3290766700 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45600c4600 con 0x7f4548004d40 2024-09-16T15:38:13.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.833+0000 7f4547fff640 1 -- 172.21.15.98:0/3290766700 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7f45500041f0 con 0x7f4548004d40 2024-09-16T15:38:13.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.833+0000 7f4547fff640 1 --2- 172.21.15.98:0/3290766700 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f454c078850 0x7f454c07ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:13.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.833+0000 7f4547fff640 1 -- 172.21.15.98:0/3290766700 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f455009b8e0 con 0x7f4548004d40 2024-09-16T15:38:13.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.833+0000 7f455e7fc640 1 --2- 172.21.15.98:0/3290766700 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f454c078850 0x7f454c07ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:13.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.834+0000 7f455e7fc640 1 --2- 172.21.15.98:0/3290766700 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f454c078850 0x7f454c07ad10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4554000c00 tx=0x7f45540067a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:13.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:13.837+0000 7f4547fff640 1 -- 172.21.15.98:0/3290766700 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7f4550063fe0 con 0x7f4548004d40 2024-09-16T15:38:14.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.050+0000 7f45658e4640 1 -- 172.21.15.98:0/3290766700 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f45600cfa60 con 0x7f4548004d40 2024-09-16T15:38:14.051 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.050+0000 7f4547fff640 1 -- 172.21.15.98:0/3290766700 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5220 (secure 0 0 0) 0x7f45500638e0 con 0x7f4548004d40 2024-09-16T15:38:14.051 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:38:14.051 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":7,"btime":"2024-09-16T15:37:47:522910+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4348,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/808747266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":808747266},{"type":"v1","addr":"172.21.15.135:6836","nonce":808747266}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4351,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/1940037746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":1940037746},{"type":"v1","addr":"172.21.15.135:6837","nonce":1940037746}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4353,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6834/3679859923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":3679859923},{"type":"v1","addr":"172.21.15.98:6834","nonce":3679859923}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T15:37:43.891616+0000","modified":"2024-09-16T15:37:46.529306+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4356},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4356":{"gid":4356,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.98:6835/1824614871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6833","nonce":1824614871},{"type":"v1","addr":"172.21.15.98:6835","nonce":1824614871}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4356,"qdb_cluster":[4356]},"id":1}]} 2024-09-16T15:38:14.051 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 7 2024-09-16T15:38:14.054 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.052+0000 7f45658e4640 1 -- 172.21.15.98:0/3290766700 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f454c078850 msgr2=0x7f454c07ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:14.054 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.052+0000 7f45658e4640 1 --2- 172.21.15.98:0/3290766700 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f454c078850 0x7f454c07ad10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4554000c00 tx=0x7f45540067a0 comp rx=0 tx=0).stop 2024-09-16T15:38:14.054 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.052+0000 7f45658e4640 1 -- 172.21.15.98:0/3290766700 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4548004d40 msgr2=0x7f45600cabf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:14.054 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.052+0000 7f45658e4640 1 --2- 172.21.15.98:0/3290766700 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4548004d40 0x7f45600cabf0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4550011dc0 tx=0x7f455000f790 comp rx=0 tx=0).stop 2024-09-16T15:38:14.054 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.052+0000 7f45658e4640 1 -- 172.21.15.98:0/3290766700 shutdown_connections 2024-09-16T15:38:14.054 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.052+0000 7f45658e4640 1 --2- 172.21.15.98:0/3290766700 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4560154bc0 0x7f45601e5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:14.054 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.052+0000 7f45658e4640 1 --2- 172.21.15.98:0/3290766700 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f454c078850 0x7f454c07ad10 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:14.054 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.052+0000 7f45658e4640 1 --2- 172.21.15.98:0/3290766700 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f456014d670 0x7f45601f48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:14.054 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.052+0000 7f45658e4640 1 --2- 172.21.15.98:0/3290766700 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4548004d40 0x7f45600cabf0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:14.054 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.053+0000 7f45658e4640 1 -- 172.21.15.98:0/3290766700 >> 172.21.15.98:0/3290766700 conn(0x7f45600b2850 msgr2=0x7f45600b5d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:14.054 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.053+0000 7f45658e4640 1 -- 172.21.15.98:0/3290766700 shutdown_connections 2024-09-16T15:38:14.055 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.053+0000 7f45658e4640 1 -- 172.21.15.98:0/3290766700 wait complete. 2024-09-16T15:38:14.065 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T15:38:14.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.164+0000 7f8495516640 1 -- 172.21.15.98:0/283012461 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f849015e0d0 msgr2=0x7f84900d09c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:14.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.164+0000 7f8495516640 1 --2- 172.21.15.98:0/283012461 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f849015e0d0 0x7f84900d09c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8480009830 tx=0x7f848002a510 comp rx=0 tx=0).stop 2024-09-16T15:38:14.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.164+0000 7f8495516640 1 -- 172.21.15.98:0/283012461 shutdown_connections 2024-09-16T15:38:14.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.164+0000 7f8495516640 1 --2- 172.21.15.98:0/283012461 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f84900d2050 0x7f84900d0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:14.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.164+0000 7f8495516640 1 --2- 172.21.15.98:0/283012461 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f849015e0d0 0x7f84900d09c0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:14.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.164+0000 7f8495516640 1 -- 172.21.15.98:0/283012461 >> 172.21.15.98:0/283012461 conn(0x7f84900d3fe0 msgr2=0x7f84900d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:14.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.165+0000 7f8495516640 1 -- 172.21.15.98:0/283012461 shutdown_connections 2024-09-16T15:38:14.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.165+0000 7f8495516640 1 -- 172.21.15.98:0/283012461 wait complete. 2024-09-16T15:38:14.167 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.166+0000 7f8495516640 1 Processor -- start 2024-09-16T15:38:14.167 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.166+0000 7f8495516640 1 -- start start 2024-09-16T15:38:14.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.167+0000 7f8495516640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84900d1440 0x7f849015fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:14.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.167+0000 7f8495516640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f84900d2050 0x7f8490160430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:14.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.167+0000 7f8495516640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f849015e0d0 0x7f84901f48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:14.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.167+0000 7f8495516640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f849015ebc0 con 0x7f84900d1440 2024-09-16T15:38:14.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.167+0000 7f8495516640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f84900cfee0 con 0x7f849015e0d0 2024-09-16T15:38:14.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.167+0000 7f8495516640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f849015ed40 con 0x7f84900d2050 2024-09-16T15:38:14.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.167+0000 7f848effd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84900d1440 0x7f849015fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:14.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.167+0000 7f848effd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84900d1440 0x7f849015fef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54782/0 (socket says 172.21.15.98:54782) 2024-09-16T15:38:14.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.167+0000 7f848effd640 1 -- 172.21.15.98:0/2674652966 learned_addr learned my addr 172.21.15.98:0/2674652966 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:14.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.167+0000 7f848e7fc640 1 --2- 172.21.15.98:0/2674652966 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f84900d2050 0x7f8490160430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:14.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.167+0000 7f848effd640 1 -- 172.21.15.98:0/2674652966 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f84900d2050 msgr2=0x7f8490160430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:14.170 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.167+0000 7f848effd640 1 --2- 172.21.15.98:0/2674652966 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f84900d2050 0x7f8490160430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:14.170 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.167+0000 7f848effd640 1 -- 172.21.15.98:0/2674652966 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f849015e0d0 msgr2=0x7f84901f48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:14.170 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.167+0000 7f848effd640 1 --2- 172.21.15.98:0/2674652966 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f849015e0d0 0x7f84901f48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:14.170 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.167+0000 7f848effd640 1 -- 172.21.15.98:0/2674652966 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84900a13d0 con 0x7f84900d1440 2024-09-16T15:38:14.170 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.167+0000 7f848effd640 1 --2- 172.21.15.98:0/2674652966 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84900d1440 0x7f849015fef0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8480009950 tx=0x7f8480033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:14.170 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.167+0000 7f84777fe640 1 -- 172.21.15.98:0/2674652966 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8480031d60 con 0x7f84900d1440 2024-09-16T15:38:14.170 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.167+0000 7f84777fe640 1 -- 172.21.15.98:0/2674652966 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8480033e10 con 0x7f84900d1440 2024-09-16T15:38:14.170 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.167+0000 7f84777fe640 1 -- 172.21.15.98:0/2674652966 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8480005260 con 0x7f84900d1440 2024-09-16T15:38:14.170 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.167+0000 7f8495516640 1 -- 172.21.15.98:0/2674652966 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f849014f570 con 0x7f84900d1440 2024-09-16T15:38:14.170 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.168+0000 7f8495516640 1 -- 172.21.15.98:0/2674652966 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f849014fb30 con 0x7f84900d1440 2024-09-16T15:38:14.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.169+0000 7f8495516640 1 -- 172.21.15.98:0/2674652966 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f849015f260 con 0x7f84900d1440 2024-09-16T15:38:14.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.169+0000 7f84777fe640 1 -- 172.21.15.98:0/2674652966 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7f8480005400 con 0x7f84900d1440 2024-09-16T15:38:14.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.170+0000 7f84777fe640 1 --2- 172.21.15.98:0/2674652966 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f847c078880 0x7f847c07ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:14.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.170+0000 7f84777fe640 1 -- 172.21.15.98:0/2674652966 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f84800bb9b0 con 0x7f84900d1440 2024-09-16T15:38:14.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.170+0000 7f848e7fc640 1 --2- 172.21.15.98:0/2674652966 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f847c078880 0x7f847c07ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:14.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.170+0000 7f848e7fc640 1 --2- 172.21.15.98:0/2674652966 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f847c078880 0x7f847c07ad40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8484005fd0 tx=0x7f8484005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:14.175 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.174+0000 7f84777fe640 1 -- 172.21.15.98:0/2674652966 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7f848003f030 con 0x7f84900d1440 2024-09-16T15:38:14.388 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.387+0000 7f8495516640 1 -- 172.21.15.98:0/2674652966 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f84900b6640 con 0x7f84900d1440 2024-09-16T15:38:14.388 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.388+0000 7f84777fe640 1 -- 172.21.15.98:0/2674652966 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5220 (secure 0 0 0) 0x7f8480084020 con 0x7f84900d1440 2024-09-16T15:38:14.389 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:38:14.389 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":7,"btime":"2024-09-16T15:37:47:522910+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4348,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/808747266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":808747266},{"type":"v1","addr":"172.21.15.135:6836","nonce":808747266}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4351,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/1940037746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":1940037746},{"type":"v1","addr":"172.21.15.135:6837","nonce":1940037746}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4353,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6834/3679859923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":3679859923},{"type":"v1","addr":"172.21.15.98:6834","nonce":3679859923}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T15:37:43.891616+0000","modified":"2024-09-16T15:37:46.529306+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4356},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4356":{"gid":4356,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.98:6835/1824614871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6833","nonce":1824614871},{"type":"v1","addr":"172.21.15.98:6835","nonce":1824614871}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4356,"qdb_cluster":[4356]},"id":1}]} 2024-09-16T15:38:14.389 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 7 2024-09-16T15:38:14.391 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.390+0000 7f8495516640 1 -- 172.21.15.98:0/2674652966 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f847c078880 msgr2=0x7f847c07ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:14.391 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.390+0000 7f8495516640 1 --2- 172.21.15.98:0/2674652966 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f847c078880 0x7f847c07ad40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8484005fd0 tx=0x7f8484005850 comp rx=0 tx=0).stop 2024-09-16T15:38:14.391 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.390+0000 7f8495516640 1 -- 172.21.15.98:0/2674652966 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84900d1440 msgr2=0x7f849015fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:14.392 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.390+0000 7f8495516640 1 --2- 172.21.15.98:0/2674652966 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84900d1440 0x7f849015fef0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8480009950 tx=0x7f8480033c20 comp rx=0 tx=0).stop 2024-09-16T15:38:14.392 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.390+0000 7f8495516640 1 -- 172.21.15.98:0/2674652966 shutdown_connections 2024-09-16T15:38:14.392 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.390+0000 7f8495516640 1 --2- 172.21.15.98:0/2674652966 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f847c078880 0x7f847c07ad40 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:14.392 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.390+0000 7f8495516640 1 --2- 172.21.15.98:0/2674652966 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f849015e0d0 0x7f84901f48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:14.392 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.390+0000 7f8495516640 1 --2- 172.21.15.98:0/2674652966 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f84900d2050 0x7f8490160430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:14.392 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.390+0000 7f8495516640 1 --2- 172.21.15.98:0/2674652966 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84900d1440 0x7f849015fef0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:14.392 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.390+0000 7f8495516640 1 -- 172.21.15.98:0/2674652966 >> 172.21.15.98:0/2674652966 conn(0x7f84900d3fe0 msgr2=0x7f84900ca910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:14.392 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.390+0000 7f8495516640 1 -- 172.21.15.98:0/2674652966 shutdown_connections 2024-09-16T15:38:14.392 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.390+0000 7f8495516640 1 -- 172.21.15.98:0/2674652966 wait complete. 2024-09-16T15:38:14.403 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T15:38:14.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.502+0000 7f4cd9060640 1 -- 172.21.15.98:0/2054479667 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4cd40ce780 msgr2=0x7f4cd40d29d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:14.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.502+0000 7f4cd9060640 1 --2- 172.21.15.98:0/2054479667 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4cd40ce780 0x7f4cd40d29d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4cc4005fd0 tx=0x7f4cc402aa10 comp rx=0 tx=0).stop 2024-09-16T15:38:14.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.502+0000 7f4cd9060640 1 -- 172.21.15.98:0/2054479667 shutdown_connections 2024-09-16T15:38:14.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.502+0000 7f4cd9060640 1 --2- 172.21.15.98:0/2054479667 >> v2:172.21.15.135:3300/0 conn(0x7f4cd40b1e60 0x7f4cd40b2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:14.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.502+0000 7f4cd9060640 1 --2- 172.21.15.98:0/2054479667 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4cd40ce780 0x7f4cd40d29d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:14.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.502+0000 7f4cd9060640 1 -- 172.21.15.98:0/2054479667 >> 172.21.15.98:0/2054479667 conn(0x7f4cd40d1eb0 msgr2=0x7f4cd40d22c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:14.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.503+0000 7f4cd9060640 1 -- 172.21.15.98:0/2054479667 shutdown_connections 2024-09-16T15:38:14.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.503+0000 7f4cd9060640 1 -- 172.21.15.98:0/2054479667 wait complete. 2024-09-16T15:38:14.505 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.504+0000 7f4cd9060640 1 Processor -- start 2024-09-16T15:38:14.505 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.504+0000 7f4cd9060640 1 -- start start 2024-09-16T15:38:14.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.505+0000 7f4cd9060640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4cd40b1e60 0x7f4cd414d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:14.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.505+0000 7f4cd9060640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4cd40ce780 0x7f4cd41f63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:14.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.505+0000 7f4cd9060640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4cd40ceb60 0x7f4cd40b05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:14.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.505+0000 7f4cd9060640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4cd40b29d0 con 0x7f4cd40ceb60 2024-09-16T15:38:14.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.505+0000 7f4cd9060640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4cd40b2850 con 0x7f4cd40ce780 2024-09-16T15:38:14.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.505+0000 7f4cd9060640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f4cd40b2b50 con 0x7f4cd40b1e60 2024-09-16T15:38:14.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.505+0000 7f4cd359e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4cd40ceb60 0x7f4cd40b05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:14.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.505+0000 7f4cd359e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4cd40ceb60 0x7f4cd40b05c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54792/0 (socket says 172.21.15.98:54792) 2024-09-16T15:38:14.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.505+0000 7f4cd359e640 1 -- 172.21.15.98:0/2562050308 learned_addr learned my addr 172.21.15.98:0/2562050308 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:14.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.505+0000 7f4cd2d9d640 1 --2- 172.21.15.98:0/2562050308 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4cd40b1e60 0x7f4cd414d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:14.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.505+0000 7f4cd259c640 1 --2- 172.21.15.98:0/2562050308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4cd40ce780 0x7f4cd41f63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:14.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.505+0000 7f4cd359e640 1 -- 172.21.15.98:0/2562050308 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4cd40b1e60 msgr2=0x7f4cd414d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:14.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.505+0000 7f4cd359e640 1 --2- 172.21.15.98:0/2562050308 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4cd40b1e60 0x7f4cd414d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:14.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.505+0000 7f4cd359e640 1 -- 172.21.15.98:0/2562050308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4cd40ce780 msgr2=0x7f4cd41f63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:14.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.505+0000 7f4cd359e640 1 --2- 172.21.15.98:0/2562050308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4cd40ce780 0x7f4cd41f63c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:14.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.505+0000 7f4cd359e640 1 -- 172.21.15.98:0/2562050308 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cd41f6d80 con 0x7f4cd40ceb60 2024-09-16T15:38:14.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.505+0000 7f4cd359e640 1 --2- 172.21.15.98:0/2562050308 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4cd40ceb60 0x7f4cd40b05c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc00e970 tx=0x7f4ccc00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:14.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.505+0000 7f4ccb7fe640 1 -- 172.21.15.98:0/2562050308 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ccc00ccc0 con 0x7f4cd40ceb60 2024-09-16T15:38:14.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.506+0000 7f4ccb7fe640 1 -- 172.21.15.98:0/2562050308 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4ccc00ce60 con 0x7f4cd40ceb60 2024-09-16T15:38:14.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.506+0000 7f4ccb7fe640 1 -- 172.21.15.98:0/2562050308 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ccc005280 con 0x7f4cd40ceb60 2024-09-16T15:38:14.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.506+0000 7f4cd9060640 1 -- 172.21.15.98:0/2562050308 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cd41f7060 con 0x7f4cd40ceb60 2024-09-16T15:38:14.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.506+0000 7f4cd9060640 1 -- 172.21.15.98:0/2562050308 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cd40b68b0 con 0x7f4cd40ceb60 2024-09-16T15:38:14.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.507+0000 7f4cd9060640 1 -- 172.21.15.98:0/2562050308 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cd40b30e0 con 0x7f4cd40ceb60 2024-09-16T15:38:14.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.507+0000 7f4ccb7fe640 1 -- 172.21.15.98:0/2562050308 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7f4ccc005420 con 0x7f4cd40ceb60 2024-09-16T15:38:14.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.508+0000 7f4ccb7fe640 1 --2- 172.21.15.98:0/2562050308 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f4cb4078880 0x7f4cb407ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:14.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.508+0000 7f4ccb7fe640 1 -- 172.21.15.98:0/2562050308 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f4ccc09b240 con 0x7f4cd40ceb60 2024-09-16T15:38:14.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.508+0000 7f4cd2d9d640 1 --2- 172.21.15.98:0/2562050308 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f4cb4078880 0x7f4cb407ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:14.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.508+0000 7f4cd2d9d640 1 --2- 172.21.15.98:0/2562050308 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f4cb4078880 0x7f4cb407ad40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4cc4035000 tx=0x7f4cc403b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:14.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.512+0000 7f4ccb7fe640 1 -- 172.21.15.98:0/2562050308 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7f4ccc063270 con 0x7f4cd40ceb60 2024-09-16T15:38:14.687 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.686+0000 7f4cd9060640 1 -- 172.21.15.98:0/2562050308 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4cd4159ef0 con 0x7f4cd40ceb60 2024-09-16T15:38:14.688 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.687+0000 7f4ccb7fe640 1 -- 172.21.15.98:0/2562050308 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16681 (secure 0 0 0) 0x7f4ccc067ca0 con 0x7f4cd40ceb60 2024-09-16T15:38:14.688 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:38:14.688 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":23,"fsid":"52a38a45-21d2-4cb0-bb3a-4fb8be3a08df","created":"2024-09-16T15:37:20.387654+0000","modified":"2024-09-16T15:37:45.512714+0000","last_up_change":"2024-09-16T15:37:33.417470+0000","last_in_change":"2024-09-16T15:37:23.430578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T15:37:34.725090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-16T15:37:42.223874+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-16T15:37:42.808291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a2d61df4-2577-47e6-a4ac-c36bbb85ab8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1967099790},{"type":"v1","addr":"172.21.15.98:6825","nonce":1967099790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1967099790},{"type":"v1","addr":"172.21.15.98:6827","nonce":1967099790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":1967099790},{"type":"v1","addr":"172.21.15.98:6831","nonce":1967099790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1967099790},{"type":"v1","addr":"172.21.15.98:6829","nonce":1967099790}]},"public_addr":"172.21.15.98:6825/1967099790","cluster_addr":"172.21.15.98:6827/1967099790","heartbeat_back_addr":"172.21.15.98:6831/1967099790","heartbeat_front_addr":"172.21.15.98:6829/1967099790","state":["exists","up"]},{"osd":1,"uuid":"bb3a68a5-c22f-442b-b292-7c272fe01ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":3571460482},{"type":"v1","addr":"172.21.15.98:6809","nonce":3571460482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":3571460482},{"type":"v1","addr":"172.21.15.98:6811","nonce":3571460482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":3571460482},{"type":"v1","addr":"172.21.15.98:6815","nonce":3571460482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":3571460482},{"type":"v1","addr":"172.21.15.98:6813","nonce":3571460482}]},"public_addr":"172.21.15.98:6809/3571460482","cluster_addr":"172.21.15.98:6811/3571460482","heartbeat_back_addr":"172.21.15.98:6815/3571460482","heartbeat_front_addr":"172.21.15.98:6813/3571460482","state":["exists","up"]},{"osd":2,"uuid":"c8429195-a480-409b-8e5f-8dc4c6abc0a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":2573210695},{"type":"v1","addr":"172.21.15.98:6801","nonce":2573210695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":2573210695},{"type":"v1","addr":"172.21.15.98:6803","nonce":2573210695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":2573210695},{"type":"v1","addr":"172.21.15.98:6807","nonce":2573210695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":2573210695},{"type":"v1","addr":"172.21.15.98:6805","nonce":2573210695}]},"public_addr":"172.21.15.98:6801/2573210695","cluster_addr":"172.21.15.98:6803/2573210695","heartbeat_back_addr":"172.21.15.98:6807/2573210695","heartbeat_front_addr":"172.21.15.98:6805/2573210695","state":["exists","up"]},{"osd":3,"uuid":"0e800d7b-096f-4f65-b3cc-c7cda3870de4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":3951374837},{"type":"v1","addr":"172.21.15.98:6817","nonce":3951374837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":3951374837},{"type":"v1","addr":"172.21.15.98:6819","nonce":3951374837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":3951374837},{"type":"v1","addr":"172.21.15.98:6823","nonce":3951374837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":3951374837},{"type":"v1","addr":"172.21.15.98:6821","nonce":3951374837}]},"public_addr":"172.21.15.98:6817/3951374837","cluster_addr":"172.21.15.98:6819/3951374837","heartbeat_back_addr":"172.21.15.98:6823/3951374837","heartbeat_front_addr":"172.21.15.98:6821/3951374837","state":["exists","up"]},{"osd":4,"uuid":"c7822e9b-8e29-48d9-b92a-e8f9c7bc5247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":724302036},{"type":"v1","addr":"172.21.15.135:6811","nonce":724302036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":724302036},{"type":"v1","addr":"172.21.15.135:6813","nonce":724302036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":724302036},{"type":"v1","addr":"172.21.15.135:6817","nonce":724302036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":724302036},{"type":"v1","addr":"172.21.15.135:6815","nonce":724302036}]},"public_addr":"172.21.15.135:6811/724302036","cluster_addr":"172.21.15.135:6813/724302036","heartbeat_back_addr":"172.21.15.135:6817/724302036","heartbeat_front_addr":"172.21.15.135:6815/724302036","state":["exists","up"]},{"osd":5,"uuid":"35805e02-484a-4404-a78f-aa44f4daa41f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3083482635},{"type":"v1","addr":"172.21.15.135:6803","nonce":3083482635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3083482635},{"type":"v1","addr":"172.21.15.135:6805","nonce":3083482635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3083482635},{"type":"v1","addr":"172.21.15.135:6809","nonce":3083482635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3083482635},{"type":"v1","addr":"172.21.15.135:6807","nonce":3083482635}]},"public_addr":"172.21.15.135:6803/3083482635","cluster_addr":"172.21.15.135:6805/3083482635","heartbeat_back_addr":"172.21.15.135:6809/3083482635","heartbeat_front_addr":"172.21.15.135:6807/3083482635","state":["exists","up"]},{"osd":6,"uuid":"6327ba84-aaeb-41fa-9717-188988ff2c4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3376376340},{"type":"v1","addr":"172.21.15.135:6819","nonce":3376376340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3376376340},{"type":"v1","addr":"172.21.15.135:6821","nonce":3376376340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":3376376340},{"type":"v1","addr":"172.21.15.135:6825","nonce":3376376340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3376376340},{"type":"v1","addr":"172.21.15.135:6823","nonce":3376376340}]},"public_addr":"172.21.15.135:6819/3376376340","cluster_addr":"172.21.15.135:6821/3376376340","heartbeat_back_addr":"172.21.15.135:6825/3376376340","heartbeat_front_addr":"172.21.15.135:6823/3376376340","state":["exists","up"]},{"osd":7,"uuid":"392d0958-dff9-4248-b3d8-a1201c10f354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2559837727},{"type":"v1","addr":"172.21.15.135:6827","nonce":2559837727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2559837727},{"type":"v1","addr":"172.21.15.135:6829","nonce":2559837727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":2559837727},{"type":"v1","addr":"172.21.15.135:6833","nonce":2559837727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2559837727},{"type":"v1","addr":"172.21.15.135:6831","nonce":2559837727}]},"public_addr":"172.21.15.135:6827/2559837727","cluster_addr":"172.21.15.135:6829/2559837727","heartbeat_back_addr":"172.21.15.135:6833/2559837727","heartbeat_front_addr":"172.21.15.135:6831/2559837727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.939904+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.717296+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.785817+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:30.211718+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.973359+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:30.250109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.699327+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:30.173063+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T15:38:14.690 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.689+0000 7f4cd9060640 1 -- 172.21.15.98:0/2562050308 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f4cb4078880 msgr2=0x7f4cb407ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:14.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.689+0000 7f4cd9060640 1 --2- 172.21.15.98:0/2562050308 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f4cb4078880 0x7f4cb407ad40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4cc4035000 tx=0x7f4cc403b040 comp rx=0 tx=0).stop 2024-09-16T15:38:14.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.689+0000 7f4cd9060640 1 -- 172.21.15.98:0/2562050308 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4cd40ceb60 msgr2=0x7f4cd40b05c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:14.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.689+0000 7f4cd9060640 1 --2- 172.21.15.98:0/2562050308 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4cd40ceb60 0x7f4cd40b05c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc00e970 tx=0x7f4ccc00ed70 comp rx=0 tx=0).stop 2024-09-16T15:38:14.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.689+0000 7f4cd9060640 1 -- 172.21.15.98:0/2562050308 shutdown_connections 2024-09-16T15:38:14.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.689+0000 7f4cd9060640 1 --2- 172.21.15.98:0/2562050308 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4cd40ceb60 0x7f4cd40b05c0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:14.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.689+0000 7f4cd9060640 1 --2- 172.21.15.98:0/2562050308 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f4cb4078880 0x7f4cb407ad40 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:14.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.689+0000 7f4cd9060640 1 --2- 172.21.15.98:0/2562050308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4cd40ce780 0x7f4cd41f63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:14.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.689+0000 7f4cd9060640 1 --2- 172.21.15.98:0/2562050308 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4cd40b1e60 0x7f4cd414d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:14.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.689+0000 7f4cd9060640 1 -- 172.21.15.98:0/2562050308 >> 172.21.15.98:0/2562050308 conn(0x7f4cd40d1eb0 msgr2=0x7f4cd4071490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:14.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.689+0000 7f4cd9060640 1 -- 172.21.15.98:0/2562050308 shutdown_connections 2024-09-16T15:38:14.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.689+0000 7f4cd9060640 1 -- 172.21.15.98:0/2562050308 wait complete. 2024-09-16T15:38:14.702 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-16T15:38:14.804 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.803+0000 7fd16f764640 1 -- 172.21.15.98:0/748884960 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd150003a50 msgr2=0x7fd150003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:14.804 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.803+0000 7fd16f764640 1 --2- 172.21.15.98:0/748884960 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd150003a50 0x7fd150003e70 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd15800c640 tx=0x7fd150005830 comp rx=0 tx=0).stop 2024-09-16T15:38:14.804 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.803+0000 7fd16f764640 1 -- 172.21.15.98:0/748884960 shutdown_connections 2024-09-16T15:38:14.804 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.803+0000 7fd16f764640 1 --2- 172.21.15.98:0/748884960 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd150003a50 0x7fd150003e70 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:14.804 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.803+0000 7fd16f764640 1 -- 172.21.15.98:0/748884960 >> 172.21.15.98:0/748884960 conn(0x7fd1680d0d40 msgr2=0x7fd1680d1120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:14.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.803+0000 7fd16f764640 1 -- 172.21.15.98:0/748884960 shutdown_connections 2024-09-16T15:38:14.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.803+0000 7fd16f764640 1 -- 172.21.15.98:0/748884960 wait complete. 2024-09-16T15:38:14.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.804+0000 7fd16f764640 1 Processor -- start 2024-09-16T15:38:14.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.804+0000 7fd16f764640 1 -- start start 2024-09-16T15:38:14.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.805+0000 7fd16f764640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd150003a50 0x7fd16814b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:14.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.805+0000 7fd16f764640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd1681f66c0 0x7fd1680c8e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:14.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.805+0000 7fd16f764640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd1681f5ab0 0x7fd1681f5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:14.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.805+0000 7fd16f764640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd16806ccf0 con 0x7fd1681f5ab0 2024-09-16T15:38:14.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.805+0000 7fd16f764640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd16806cb70 con 0x7fd150003a50 2024-09-16T15:38:14.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.805+0000 7fd16f764640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fd16806ce70 con 0x7fd1681f66c0 2024-09-16T15:38:14.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.805+0000 7fd16dd01640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd1681f5ab0 0x7fd1681f5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:14.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.805+0000 7fd16dd01640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd1681f5ab0 0x7fd1681f5f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54808/0 (socket says 172.21.15.98:54808) 2024-09-16T15:38:14.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.805+0000 7fd16dd01640 1 -- 172.21.15.98:0/3719891049 learned_addr learned my addr 172.21.15.98:0/3719891049 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:14.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.805+0000 7fd16d500640 1 --2- 172.21.15.98:0/3719891049 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd150003a50 0x7fd16814b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:14.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.805+0000 7fd16ccff640 1 --2- 172.21.15.98:0/3719891049 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd1681f66c0 0x7fd1680c8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:14.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.805+0000 7fd16dd01640 1 -- 172.21.15.98:0/3719891049 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd1681f66c0 msgr2=0x7fd1680c8e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:14.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.805+0000 7fd16dd01640 1 --2- 172.21.15.98:0/3719891049 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd1681f66c0 0x7fd1680c8e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:14.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.805+0000 7fd16dd01640 1 -- 172.21.15.98:0/3719891049 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd150003a50 msgr2=0x7fd16814b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:14.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.805+0000 7fd16dd01640 1 --2- 172.21.15.98:0/3719891049 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd150003a50 0x7fd16814b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:14.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.805+0000 7fd16dd01640 1 -- 172.21.15.98:0/3719891049 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1680ca7e0 con 0x7fd1681f5ab0 2024-09-16T15:38:14.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.805+0000 7fd16dd01640 1 --2- 172.21.15.98:0/3719891049 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd1681f5ab0 0x7fd1681f5f60 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd1680c7d70 tx=0x7fd160004f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:14.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.805+0000 7fd165ffb640 1 -- 172.21.15.98:0/3719891049 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd160011460 con 0x7fd1681f5ab0 2024-09-16T15:38:14.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.805+0000 7fd165ffb640 1 -- 172.21.15.98:0/3719891049 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd160017070 con 0x7fd1681f5ab0 2024-09-16T15:38:14.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.805+0000 7fd16f764640 1 -- 172.21.15.98:0/3719891049 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1680c9740 con 0x7fd1681f5ab0 2024-09-16T15:38:14.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.806+0000 7fd165ffb640 1 -- 172.21.15.98:0/3719891049 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd160011990 con 0x7fd1681f5ab0 2024-09-16T15:38:14.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.806+0000 7fd16f764640 1 -- 172.21.15.98:0/3719891049 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1680c9d00 con 0x7fd1681f5ab0 2024-09-16T15:38:14.810 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.807+0000 7fd16f764640 1 -- 172.21.15.98:0/3719891049 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd16806fa20 con 0x7fd1681f5ab0 2024-09-16T15:38:14.810 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.807+0000 7fd165ffb640 1 -- 172.21.15.98:0/3719891049 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7fd160011b30 con 0x7fd1681f5ab0 2024-09-16T15:38:14.810 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.808+0000 7fd165ffb640 1 --2- 172.21.15.98:0/3719891049 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fd154078880 0x7fd15407ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:14.810 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.808+0000 7fd165ffb640 1 -- 172.21.15.98:0/3719891049 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fd16009ab60 con 0x7fd1681f5ab0 2024-09-16T15:38:14.810 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.808+0000 7fd16d500640 1 --2- 172.21.15.98:0/3719891049 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fd154078880 0x7fd15407ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:14.810 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.809+0000 7fd16d500640 1 --2- 172.21.15.98:0/3719891049 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fd154078880 0x7fd15407ad40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd158033000 tx=0x7fd168070280 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:14.813 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:14.812+0000 7fd165ffb640 1 -- 172.21.15.98:0/3719891049 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7fd160011e20 con 0x7fd1681f5ab0 2024-09-16T15:38:15.023 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:15.022+0000 7fd16f764640 1 -- 172.21.15.98:0/3719891049 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fd1680ccb20 con 0x7fd1681f5ab0 2024-09-16T15:38:15.023 INFO:tasks.ceph.mon.a.smithi098.stderr:2024-09-16T15:38:15.022+0000 7f7b90b34640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-16T15:38:15.025 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:15.024+0000 7fd165ffb640 1 -- 172.21.15.98:0/3719891049 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) ==== 161+0+0 (secure 0 0 0) 0x7fd160063240 con 0x7fd1681f5ab0 2024-09-16T15:38:15.025 INFO:teuthology.orchestra.run.smithi098.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-16T15:38:15.028 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:15.027+0000 7fd16f764640 1 -- 172.21.15.98:0/3719891049 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fd154078880 msgr2=0x7fd15407ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:15.028 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:15.027+0000 7fd16f764640 1 --2- 172.21.15.98:0/3719891049 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fd154078880 0x7fd15407ad40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd158033000 tx=0x7fd168070280 comp rx=0 tx=0).stop 2024-09-16T15:38:15.028 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:15.027+0000 7fd16f764640 1 -- 172.21.15.98:0/3719891049 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd1681f5ab0 msgr2=0x7fd1681f5f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:15.028 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:15.027+0000 7fd16f764640 1 --2- 172.21.15.98:0/3719891049 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd1681f5ab0 0x7fd1681f5f60 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd1680c7d70 tx=0x7fd160004f00 comp rx=0 tx=0).stop 2024-09-16T15:38:15.028 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:15.027+0000 7fd16f764640 1 -- 172.21.15.98:0/3719891049 shutdown_connections 2024-09-16T15:38:15.028 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:15.027+0000 7fd16f764640 1 --2- 172.21.15.98:0/3719891049 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd1681f5ab0 0x7fd1681f5f60 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:15.029 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:15.027+0000 7fd16f764640 1 --2- 172.21.15.98:0/3719891049 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd1681f66c0 0x7fd1680c8e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:15.029 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:15.027+0000 7fd16f764640 1 --2- 172.21.15.98:0/3719891049 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fd154078880 0x7fd15407ad40 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:15.029 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:15.027+0000 7fd16f764640 1 --2- 172.21.15.98:0/3719891049 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd150003a50 0x7fd16814b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:15.029 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:15.027+0000 7fd16f764640 1 -- 172.21.15.98:0/3719891049 >> 172.21.15.98:0/3719891049 conn(0x7fd1680d0d40 msgr2=0x7fd168159f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:15.029 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:15.027+0000 7fd16f764640 1 -- 172.21.15.98:0/3719891049 shutdown_connections 2024-09-16T15:38:15.029 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:15.027+0000 7fd16f764640 1 -- 172.21.15.98:0/3719891049 wait complete. 2024-09-16T15:38:15.030 INFO:tasks.ceph.mds.c.smithi098.stderr: -6802> 2024-09-16T15:37:50.017+0000 7fac4e82e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-16T15:38:15.040 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-16T15:38:15.062 INFO:tasks.ceph.mds.c.smithi098.stdout:starting mds.c at 2024-09-16T15:38:15.143 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:15.142+0000 7f98ddb89640 1 -- 172.21.15.98:0/758021943 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f98d80b3370 msgr2=0x7f98d80cebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:15.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:15.142+0000 7f98ddb89640 1 --2- 172.21.15.98:0/758021943 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f98d80b3370 0x7f98d80cebe0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f98c8005fd0 tx=0x7f98c802a8b0 comp rx=0 tx=0).stop 2024-09-16T15:38:15.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:15.142+0000 7f98ddb89640 1 -- 172.21.15.98:0/758021943 shutdown_connections 2024-09-16T15:38:15.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:15.142+0000 7f98ddb89640 1 --2- 172.21.15.98:0/758021943 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f98d80b3370 0x7f98d80cebe0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:15.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:15.142+0000 7f98ddb89640 1 -- 172.21.15.98:0/758021943 >> 172.21.15.98:0/758021943 conn(0x7f98d80b1840 msgr2=0x7f98d80b1c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:15.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:15.142+0000 7f98ddb89640 1 -- 172.21.15.98:0/758021943 shutdown_connections 2024-09-16T15:38:15.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:15.142+0000 7f98ddb89640 1 -- 172.21.15.98:0/758021943 wait complete. 2024-09-16T15:38:15.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:15.143+0000 7f98ddb89640 1 Processor -- start 2024-09-16T15:38:15.145 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:15.143+0000 7f98ddb89640 1 -- start start 2024-09-16T15:38:15.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:15.144+0000 7f98ddb89640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f98d80b3370 0x7f98d8154c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:15.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:15.144+0000 7f98ddb89640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f98d815c080 0x7f98d80cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:15.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:15.144+0000 7f98ddb89640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98d815f090 0x7f98d8150b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:15.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:15.144+0000 7f98ddb89640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f98d80cf590 con 0x7f98d80b3370 2024-09-16T15:38:15.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:15.144+0000 7f98ddb89640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f98d80cf410 con 0x7f98d815f090 2024-09-16T15:38:15.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:15.144+0000 7f98ddb89640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f98d81661b0 con 0x7f98d815c080 2024-09-16T15:38:15.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:15.144+0000 7f98d77fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f98d80b3370 0x7f98d8154c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:15.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:15.144+0000 7f98d77fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f98d80b3370 0x7f98d8154c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:45918/0 (socket says 172.21.15.98:45918) 2024-09-16T15:38:15.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:15.144+0000 7f98d77fe640 1 -- 172.21.15.98:0/3174853241 learned_addr learned my addr 172.21.15.98:0/3174853241 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:15.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:15.145+0000 7f98d6ffd640 1 --2- 172.21.15.98:0/3174853241 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f98d815c080 0x7f98d80cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:15.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:15.145+0000 7f98d7fff640 1 --2- 172.21.15.98:0/3174853241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98d815f090 0x7f98d8150b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:15.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:15.145+0000 7f98d77fe640 1 -- 172.21.15.98:0/3174853241 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f98d815c080 msgr2=0x7f98d80cdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:15.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:15.145+0000 7f98d77fe640 1 --2- 172.21.15.98:0/3174853241 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f98d815c080 0x7f98d80cdd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:15.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:15.145+0000 7f98d77fe640 1 -- 172.21.15.98:0/3174853241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98d815f090 msgr2=0x7f98d8150b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:15.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:15.145+0000 7f98d77fe640 1 --2- 172.21.15.98:0/3174853241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98d815f090 0x7f98d8150b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:15.148 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:15.145+0000 7f98d77fe640 1 -- 172.21.15.98:0/3174853241 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98d81389c0 con 0x7f98d80b3370 2024-09-16T15:38:15.148 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:15.145+0000 7f98d77fe640 1 --2- 172.21.15.98:0/3174853241 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f98d80b3370 0x7f98d8154c30 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f98c8009cd0 tx=0x7f98c80039f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:15.148 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:15.145+0000 7f98bffff640 1 -- 172.21.15.98:0/3174853241 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98c8040070 con 0x7f98d80b3370 2024-09-16T15:38:15.148 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:15.145+0000 7f98bffff640 1 -- 172.21.15.98:0/3174853241 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f98c8004130 con 0x7f98d80b3370 2024-09-16T15:38:15.148 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:15.145+0000 7f98bffff640 1 -- 172.21.15.98:0/3174853241 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98c8004540 con 0x7f98d80b3370 2024-09-16T15:38:15.148 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:15.145+0000 7f98ddb89640 1 -- 172.21.15.98:0/3174853241 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98d81f2ad0 con 0x7f98d80b3370 2024-09-16T15:38:15.148 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:15.145+0000 7f98ddb89640 1 -- 172.21.15.98:0/3174853241 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98d81f3370 con 0x7f98d80b3370 2024-09-16T15:38:15.149 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:15.146+0000 7f98ddb89640 1 -- 172.21.15.98:0/3174853241 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98d80cebe0 con 0x7f98d80b3370 2024-09-16T15:38:15.149 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:15.146+0000 7f98bffff640 1 -- 172.21.15.98:0/3174853241 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7f98c8039040 con 0x7f98d80b3370 2024-09-16T15:38:15.149 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:15.147+0000 7f98bffff640 1 --2- 172.21.15.98:0/3174853241 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f98c4078880 0x7f98c407ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:15.149 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:15.147+0000 7f98bffff640 1 -- 172.21.15.98:0/3174853241 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5795+0+0 (secure 0 0 0) 0x7f98c80bc090 con 0x7f98d80b3370 2024-09-16T15:38:15.149 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:15.147+0000 7f98d6ffd640 1 --2- 172.21.15.98:0/3174853241 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f98c4078880 0x7f98c407ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:15.149 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:15.148+0000 7f98d6ffd640 1 --2- 172.21.15.98:0/3174853241 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f98c4078880 0x7f98c407ad40 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f98d80b0820 tx=0x7f98cc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:15.152 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:15.151+0000 7f98bffff640 1 -- 172.21.15.98:0/3174853241 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7f98d81389c0 con 0x7f98d80b3370 2024-09-16T15:38:15.364 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:15.363+0000 7f98ddb89640 1 -- 172.21.15.98:0/3174853241 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f98d80b1620 con 0x7f98d80b3370 2024-09-16T15:38:16.026 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:16.025+0000 7f98bffff640 1 -- 172.21.15.98:0/3174853241 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) ==== 104+0+0 (secure 0 0 0) 0x7f98c8084730 con 0x7f98d80b3370 2024-09-16T15:38:16.029 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:16.028+0000 7f98ddb89640 1 -- 172.21.15.98:0/3174853241 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f98c4078880 msgr2=0x7f98c407ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:16.029 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:16.028+0000 7f98ddb89640 1 --2- 172.21.15.98:0/3174853241 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f98c4078880 0x7f98c407ad40 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f98d80b0820 tx=0x7f98cc009040 comp rx=0 tx=0).stop 2024-09-16T15:38:16.029 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:16.028+0000 7f98ddb89640 1 -- 172.21.15.98:0/3174853241 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f98d80b3370 msgr2=0x7f98d8154c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:16.029 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:16.028+0000 7f98ddb89640 1 --2- 172.21.15.98:0/3174853241 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f98d80b3370 0x7f98d8154c30 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f98c8009cd0 tx=0x7f98c80039f0 comp rx=0 tx=0).stop 2024-09-16T15:38:16.029 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:16.028+0000 7f98ddb89640 1 -- 172.21.15.98:0/3174853241 shutdown_connections 2024-09-16T15:38:16.029 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:16.028+0000 7f98ddb89640 1 --2- 172.21.15.98:0/3174853241 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f98c4078880 0x7f98c407ad40 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:16.029 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:16.028+0000 7f98ddb89640 1 --2- 172.21.15.98:0/3174853241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98d815f090 0x7f98d8150b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:16.029 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:16.028+0000 7f98ddb89640 1 --2- 172.21.15.98:0/3174853241 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f98d815c080 0x7f98d80cdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:16.030 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:16.028+0000 7f98ddb89640 1 --2- 172.21.15.98:0/3174853241 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f98d80b3370 0x7f98d8154c30 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:16.030 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:16.028+0000 7f98ddb89640 1 -- 172.21.15.98:0/3174853241 >> 172.21.15.98:0/3174853241 conn(0x7f98d80b1840 msgr2=0x7f98d80af750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:16.030 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:16.028+0000 7f98ddb89640 1 -- 172.21.15.98:0/3174853241 shutdown_connections 2024-09-16T15:38:16.030 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:16.028+0000 7f98ddb89640 1 -- 172.21.15.98:0/3174853241 wait complete. 2024-09-16T15:38:16.041 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-16T15:38:16.190 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:16.188+0000 7f9999c39640 1 -- 172.21.15.98:0/2684169356 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9994074550 msgr2=0x7f999406fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:16.190 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:16.188+0000 7f9999c39640 1 --2- 172.21.15.98:0/2684169356 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9994074550 0x7f999406fed0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9984005fd0 tx=0x7f998402aa00 comp rx=0 tx=0).stop 2024-09-16T15:38:16.190 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:16.189+0000 7f9999c39640 1 -- 172.21.15.98:0/2684169356 shutdown_connections 2024-09-16T15:38:16.190 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:16.189+0000 7f9999c39640 1 --2- 172.21.15.98:0/2684169356 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9994072bc0 0x7f9994072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:16.190 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:16.189+0000 7f9999c39640 1 --2- 172.21.15.98:0/2684169356 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9994074550 0x7f999406fed0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:16.190 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:16.189+0000 7f9999c39640 1 -- 172.21.15.98:0/2684169356 >> 172.21.15.98:0/2684169356 conn(0x7f99940cffe0 msgr2=0x7f99940d03f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:16.190 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:16.189+0000 7f9999c39640 1 -- 172.21.15.98:0/2684169356 shutdown_connections 2024-09-16T15:38:16.190 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:16.189+0000 7f9999c39640 1 -- 172.21.15.98:0/2684169356 wait complete. 2024-09-16T15:38:16.191 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:16.190+0000 7f9999c39640 1 Processor -- start 2024-09-16T15:38:16.191 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:16.190+0000 7f9999c39640 1 -- start start 2024-09-16T15:38:16.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:16.191+0000 7f9999c39640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9994072bc0 0x7f99940c9930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:16.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:16.191+0000 7f9999c39640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9994074550 0x7f99941e64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:16.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:16.191+0000 7f9999c39640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9994074930 0x7f99941587c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:16.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:16.191+0000 7f9999c39640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9994073870 con 0x7f9994072bc0 2024-09-16T15:38:16.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:16.191+0000 7f9999c39640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f99940736f0 con 0x7f9994074930 2024-09-16T15:38:16.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:16.191+0000 7f9999c39640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f99940739f0 con 0x7f9994074550 2024-09-16T15:38:16.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:16.191+0000 7f99937fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9994072bc0 0x7f99940c9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:16.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:16.191+0000 7f99937fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9994072bc0 0x7f99940c9930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:45938/0 (socket says 172.21.15.98:45938) 2024-09-16T15:38:16.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:16.191+0000 7f99937fe640 1 -- 172.21.15.98:0/1717125527 learned_addr learned my addr 172.21.15.98:0/1717125527 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:16.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:16.191+0000 7f9992ffd640 1 --2- 172.21.15.98:0/1717125527 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9994074550 0x7f99941e64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:16.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:16.191+0000 7f9993fff640 1 --2- 172.21.15.98:0/1717125527 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9994074930 0x7f99941587c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:16.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:16.191+0000 7f99937fe640 1 -- 172.21.15.98:0/1717125527 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9994074550 msgr2=0x7f99941e64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:16.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:16.191+0000 7f99937fe640 1 --2- 172.21.15.98:0/1717125527 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9994074550 0x7f99941e64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:16.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:16.191+0000 7f99937fe640 1 -- 172.21.15.98:0/1717125527 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9994074930 msgr2=0x7f99941587c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:16.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:16.191+0000 7f99937fe640 1 --2- 172.21.15.98:0/1717125527 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9994074930 0x7f99941587c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:16.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:16.191+0000 7f99937fe640 1 -- 172.21.15.98:0/1717125527 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99940a0bc0 con 0x7f9994072bc0 2024-09-16T15:38:16.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:16.191+0000 7f9993fff640 1 --2- 172.21.15.98:0/1717125527 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9994074930 0x7f99941587c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T15:38:16.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:16.191+0000 7f99937fe640 1 --2- 172.21.15.98:0/1717125527 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9994072bc0 0x7f99940c9930 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9984006010 tx=0x7f9984003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:16.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:16.191+0000 7f997bfff640 1 -- 172.21.15.98:0/1717125527 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9984047070 con 0x7f9994072bc0 2024-09-16T15:38:16.195 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:16.191+0000 7f997bfff640 1 -- 172.21.15.98:0/1717125527 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9984004310 con 0x7f9994072bc0 2024-09-16T15:38:16.195 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:16.192+0000 7f997bfff640 1 -- 172.21.15.98:0/1717125527 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9984033050 con 0x7f9994072bc0 2024-09-16T15:38:16.195 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:16.192+0000 7f9999c39640 1 -- 172.21.15.98:0/1717125527 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99940a0ea0 con 0x7f9994072bc0 2024-09-16T15:38:16.195 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:16.192+0000 7f9999c39640 1 -- 172.21.15.98:0/1717125527 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f999409f3f0 con 0x7f9994072bc0 2024-09-16T15:38:16.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:16.193+0000 7f9999c39640 1 -- 172.21.15.98:0/1717125527 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9994072fa0 con 0x7f9994072bc0 2024-09-16T15:38:16.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:16.193+0000 7f997bfff640 1 -- 172.21.15.98:0/1717125527 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7f998404a070 con 0x7f9994072bc0 2024-09-16T15:38:16.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:16.194+0000 7f997bfff640 1 --2- 172.21.15.98:0/1717125527 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f9980078850 0x7f998007ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:16.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:16.194+0000 7f997bfff640 1 -- 172.21.15.98:0/1717125527 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5795+0+0 (secure 0 0 0) 0x7f99840bbb90 con 0x7f9994072bc0 2024-09-16T15:38:16.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:16.194+0000 7f9992ffd640 1 --2- 172.21.15.98:0/1717125527 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f9980078850 0x7f998007ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:16.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:16.194+0000 7f9992ffd640 1 --2- 172.21.15.98:0/1717125527 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f9980078850 0x7f998007ad10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f999415c600 tx=0x7f9988009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:16.199 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:16.198+0000 7f997bfff640 1 -- 172.21.15.98:0/1717125527 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7f9994070410 con 0x7f9994072bc0 2024-09-16T15:38:16.373 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:16.372+0000 7f9999c39640 1 -- 172.21.15.98:0/1717125527 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f99940b5f60 con 0x7f9994072bc0 2024-09-16T15:38:17.030 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:17.029+0000 7f997bfff640 1 -- 172.21.15.98:0/1717125527 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v25) ==== 181+0+0 (secure 0 0 0) 0x7f9984083b50 con 0x7f9994072bc0 2024-09-16T15:38:17.030 INFO:teuthology.orchestra.run.smithi098.stderr:pool 'cephfs_metadata' removed 2024-09-16T15:38:17.034 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:17.032+0000 7f9999c39640 1 -- 172.21.15.98:0/1717125527 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f9980078850 msgr2=0x7f998007ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:17.034 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:17.032+0000 7f9999c39640 1 --2- 172.21.15.98:0/1717125527 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f9980078850 0x7f998007ad10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f999415c600 tx=0x7f9988009060 comp rx=0 tx=0).stop 2024-09-16T15:38:17.034 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:17.033+0000 7f9999c39640 1 -- 172.21.15.98:0/1717125527 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9994072bc0 msgr2=0x7f99940c9930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:17.034 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:17.033+0000 7f9999c39640 1 --2- 172.21.15.98:0/1717125527 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9994072bc0 0x7f99940c9930 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9984006010 tx=0x7f9984003f10 comp rx=0 tx=0).stop 2024-09-16T15:38:17.034 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:17.033+0000 7f9999c39640 1 -- 172.21.15.98:0/1717125527 shutdown_connections 2024-09-16T15:38:17.034 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:17.033+0000 7f9999c39640 1 --2- 172.21.15.98:0/1717125527 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f9980078850 0x7f998007ad10 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:17.034 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:17.033+0000 7f9999c39640 1 --2- 172.21.15.98:0/1717125527 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9994074930 0x7f99941587c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:17.034 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:17.033+0000 7f9999c39640 1 --2- 172.21.15.98:0/1717125527 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9994074550 0x7f99941e64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:17.034 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:17.033+0000 7f9999c39640 1 --2- 172.21.15.98:0/1717125527 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9994072bc0 0x7f99940c9930 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:17.035 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:17.033+0000 7f9999c39640 1 -- 172.21.15.98:0/1717125527 >> 172.21.15.98:0/1717125527 conn(0x7f99940cffe0 msgr2=0x7f9994155f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:17.035 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:17.033+0000 7f9999c39640 1 -- 172.21.15.98:0/1717125527 shutdown_connections 2024-09-16T15:38:17.035 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:17.033+0000 7f9999c39640 1 -- 172.21.15.98:0/1717125527 wait complete. 2024-09-16T15:38:17.046 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-16T15:38:17.155 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:17.153+0000 7fd63d93d640 1 -- 172.21.15.98:0/4188408176 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd6380cf120 msgr2=0x7fd63815e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:17.155 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:17.153+0000 7fd63d93d640 1 --2- 172.21.15.98:0/4188408176 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd6380cf120 0x7fd63815e960 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd6380b2680 tx=0x7fd63002a980 comp rx=0 tx=0).stop 2024-09-16T15:38:17.155 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:17.153+0000 7fd63d93d640 1 -- 172.21.15.98:0/4188408176 shutdown_connections 2024-09-16T15:38:17.155 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:17.153+0000 7fd63d93d640 1 --2- 172.21.15.98:0/4188408176 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd6380cf120 0x7fd63815e960 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:17.155 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:17.153+0000 7fd63d93d640 1 --2- 172.21.15.98:0/4188408176 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd63806ffa0 0x7fd6380cebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:17.155 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:17.153+0000 7fd63d93d640 1 --2- 172.21.15.98:0/4188408176 >> v2:172.21.15.135:3300/0 conn(0x7fd63815ae70 0x7fd6380b49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:17.155 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:17.153+0000 7fd63d93d640 1 -- 172.21.15.98:0/4188408176 >> 172.21.15.98:0/4188408176 conn(0x7fd6380b18e0 msgr2=0x7fd6380b1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:17.155 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:17.154+0000 7fd63d93d640 1 -- 172.21.15.98:0/4188408176 shutdown_connections 2024-09-16T15:38:17.155 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:17.154+0000 7fd63d93d640 1 -- 172.21.15.98:0/4188408176 wait complete. 2024-09-16T15:38:17.158 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:17.155+0000 7fd63d93d640 1 Processor -- start 2024-09-16T15:38:17.158 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:17.155+0000 7fd63d93d640 1 -- start start 2024-09-16T15:38:17.158 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:17.155+0000 7fd63d93d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd63806ffa0 0x7fd6380ae030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:17.158 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:17.155+0000 7fd63d93d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd6380cf120 0x7fd638148290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:17.158 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:17.155+0000 7fd63d93d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd63815ae70 0x7fd6381487d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:17.158 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:17.155+0000 7fd63d93d640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd63815f020 con 0x7fd63806ffa0 2024-09-16T15:38:17.158 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:17.155+0000 7fd63d93d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd63815eea0 con 0x7fd6380cf120 2024-09-16T15:38:17.158 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:17.155+0000 7fd63d93d640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fd63815f1a0 con 0x7fd63815ae70 2024-09-16T15:38:17.158 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:17.156+0000 7fd636ffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd63806ffa0 0x7fd6380ae030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:17.158 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:17.156+0000 7fd636ffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd63806ffa0 0x7fd6380ae030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:45968/0 (socket says 172.21.15.98:45968) 2024-09-16T15:38:17.158 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:17.156+0000 7fd636ffd640 1 -- 172.21.15.98:0/571120829 learned_addr learned my addr 172.21.15.98:0/571120829 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:17.158 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:17.156+0000 7fd62ffff640 1 --2- 172.21.15.98:0/571120829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd6380cf120 0x7fd638148290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:17.159 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:17.156+0000 7fd6377fe640 1 --2- 172.21.15.98:0/571120829 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd63815ae70 0x7fd6381487d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:17.159 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:17.156+0000 7fd636ffd640 1 -- 172.21.15.98:0/571120829 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd63815ae70 msgr2=0x7fd6381487d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:17.159 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:17.156+0000 7fd636ffd640 1 --2- 172.21.15.98:0/571120829 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd63815ae70 0x7fd6381487d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:17.159 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:17.156+0000 7fd636ffd640 1 -- 172.21.15.98:0/571120829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd6380cf120 msgr2=0x7fd638148290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:17.159 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:17.156+0000 7fd636ffd640 1 --2- 172.21.15.98:0/571120829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd6380cf120 0x7fd638148290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:17.159 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:17.156+0000 7fd636ffd640 1 -- 172.21.15.98:0/571120829 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6381f3380 con 0x7fd63806ffa0 2024-09-16T15:38:17.159 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:17.156+0000 7fd636ffd640 1 --2- 172.21.15.98:0/571120829 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd63806ffa0 0x7fd6380ae030 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd62800d740 tx=0x7fd62800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:17.159 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:17.156+0000 7fd634ff9640 1 -- 172.21.15.98:0/571120829 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd628017070 con 0x7fd63806ffa0 2024-09-16T15:38:17.159 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:17.156+0000 7fd634ff9640 1 -- 172.21.15.98:0/571120829 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd628009d20 con 0x7fd63806ffa0 2024-09-16T15:38:17.159 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:17.156+0000 7fd634ff9640 1 -- 172.21.15.98:0/571120829 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6280106c0 con 0x7fd63806ffa0 2024-09-16T15:38:17.159 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:17.156+0000 7fd63d93d640 1 -- 172.21.15.98:0/571120829 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6381f25c0 con 0x7fd63806ffa0 2024-09-16T15:38:17.160 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:17.156+0000 7fd63d93d640 1 -- 172.21.15.98:0/571120829 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6381f2b80 con 0x7fd63806ffa0 2024-09-16T15:38:17.160 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:17.157+0000 7fd63d93d640 1 -- 172.21.15.98:0/571120829 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd638069360 con 0x7fd63806ffa0 2024-09-16T15:38:17.160 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:17.158+0000 7fd634ff9640 1 -- 172.21.15.98:0/571120829 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7fd62801a070 con 0x7fd63806ffa0 2024-09-16T15:38:17.160 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:17.158+0000 7fd634ff9640 1 --2- 172.21.15.98:0/571120829 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fd618078850 0x7fd61807ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:17.161 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:17.159+0000 7fd634ff9640 1 -- 172.21.15.98:0/571120829 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5357+0+0 (secure 0 0 0) 0x7fd62809a8e0 con 0x7fd63806ffa0 2024-09-16T15:38:17.161 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:17.159+0000 7fd62ffff640 1 --2- 172.21.15.98:0/571120829 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fd618078850 0x7fd61807ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:17.161 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:17.159+0000 7fd62ffff640 1 --2- 172.21.15.98:0/571120829 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fd618078850 0x7fd61807ad10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd638074780 tx=0x7fd62000a2d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:17.163 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:17.163+0000 7fd634ff9640 1 -- 172.21.15.98:0/571120829 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7fd6280629e0 con 0x7fd63806ffa0 2024-09-16T15:38:17.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:17.345+0000 7fd63d93d640 1 -- 172.21.15.98:0/571120829 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fd63815f690 con 0x7fd63806ffa0 2024-09-16T15:38:18.035 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:18.034+0000 7fd634ff9640 1 -- 172.21.15.98:0/571120829 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v26) ==== 169+0+0 (secure 0 0 0) 0x7fd628067410 con 0x7fd63806ffa0 2024-09-16T15:38:18.035 INFO:teuthology.orchestra.run.smithi098.stderr:pool 'cephfs_data' removed 2024-09-16T15:38:18.039 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:18.038+0000 7fd63d93d640 1 -- 172.21.15.98:0/571120829 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fd618078850 msgr2=0x7fd61807ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:18.039 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:18.038+0000 7fd63d93d640 1 --2- 172.21.15.98:0/571120829 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fd618078850 0x7fd61807ad10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd638074780 tx=0x7fd62000a2d0 comp rx=0 tx=0).stop 2024-09-16T15:38:18.039 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:18.038+0000 7fd63d93d640 1 -- 172.21.15.98:0/571120829 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd63806ffa0 msgr2=0x7fd6380ae030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:18.039 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:18.038+0000 7fd63d93d640 1 --2- 172.21.15.98:0/571120829 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd63806ffa0 0x7fd6380ae030 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd62800d740 tx=0x7fd62800dc00 comp rx=0 tx=0).stop 2024-09-16T15:38:18.039 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:18.038+0000 7fd63d93d640 1 -- 172.21.15.98:0/571120829 shutdown_connections 2024-09-16T15:38:18.039 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:18.038+0000 7fd63d93d640 1 --2- 172.21.15.98:0/571120829 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd63815ae70 0x7fd6381487d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:18.039 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:18.038+0000 7fd63d93d640 1 --2- 172.21.15.98:0/571120829 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fd618078850 0x7fd61807ad10 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:18.039 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:18.038+0000 7fd63d93d640 1 --2- 172.21.15.98:0/571120829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd6380cf120 0x7fd638148290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:18.039 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:18.038+0000 7fd63d93d640 1 --2- 172.21.15.98:0/571120829 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd63806ffa0 0x7fd6380ae030 secure :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd62800d740 tx=0x7fd62800dc00 comp rx=0 tx=0).stop 2024-09-16T15:38:18.040 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:18.038+0000 7fd63d93d640 1 -- 172.21.15.98:0/571120829 >> 172.21.15.98:0/571120829 conn(0x7fd6380b18e0 msgr2=0x7fd6380b1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:18.040 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:18.038+0000 7fd63d93d640 1 -- 172.21.15.98:0/571120829 shutdown_connections 2024-09-16T15:38:18.040 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:18.038+0000 7fd63d93d640 1 -- 172.21.15.98:0/571120829 wait complete. 2024-09-16T15:38:18.052 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-16T15:38:18.052 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-16T15:38:18.052 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-16T15:38:18.052 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T15:38:18.052 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-16T15:38:18.053 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-16T15:38:18.053 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-16T15:38:18.053 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T15:38:18.053 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-16T15:38:18.053 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-16T15:38:18.053 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-16T15:38:18.053 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T15:38:18.054 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-16T15:38:18.054 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-16T15:38:18.054 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-16T15:38:18.054 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T15:38:18.063 INFO:tasks.ceph.mds.c:Stopped 2024-09-16T15:38:18.063 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-16T15:38:18.064 INFO:tasks.ceph.mds.a:Stopped 2024-09-16T15:38:18.064 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-16T15:38:18.065 INFO:tasks.ceph.mds.b:Stopped 2024-09-16T15:38:18.066 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-16T15:38:18.066 INFO:tasks.ceph.mds.d:Stopped 2024-09-16T15:38:18.066 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-16T15:38:18.106 INFO:tasks.ceph.mds.c:Started 2024-09-16T15:38:18.106 DEBUG:teuthology.parallel:result is None 2024-09-16T15:38:18.107 INFO:tasks.ceph.mds.a:Started 2024-09-16T15:38:18.107 DEBUG:teuthology.parallel:result is None 2024-09-16T15:38:18.109 INFO:tasks.ceph.mds.b:Started 2024-09-16T15:38:18.109 DEBUG:teuthology.parallel:result is None 2024-09-16T15:38:18.109 INFO:tasks.ceph.mds.d:Started 2024-09-16T15:38:18.110 DEBUG:teuthology.parallel:result is None 2024-09-16T15:38:18.110 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-16T15:38:18.184 INFO:tasks.ceph.mds.c.smithi098.stdout:starting mds.c at 2024-09-16T15:38:18.184 INFO:tasks.ceph.mds.a.smithi098.stdout:starting mds.a at 2024-09-16T15:38:18.187 INFO:tasks.ceph.mds.b.smithi135.stdout:starting mds.b at 2024-09-16T15:38:18.187 INFO:tasks.ceph.mds.d.smithi135.stdout:starting mds.d at 2024-09-16T15:38:18.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:18.217+0000 7fc0c44c5640 1 -- 172.21.15.98:0/1925839848 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc0a80039e0 msgr2=0x7fc0a8003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:18.219 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:18.217+0000 7fc0c44c5640 1 --2- 172.21.15.98:0/1925839848 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc0a80039e0 0x7fc0a8003dc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc0b8006f90 tx=0x7fc0a8005830 comp rx=0 tx=0).stop 2024-09-16T15:38:18.219 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:18.217+0000 7fc0c2a62640 1 -- 172.21.15.98:0/1925839848 reap_dead start 2024-09-16T15:38:18.219 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:18.217+0000 7fc0c44c5640 1 -- 172.21.15.98:0/1925839848 shutdown_connections 2024-09-16T15:38:18.219 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:18.217+0000 7fc0c44c5640 1 -- 172.21.15.98:0/1925839848 >> 172.21.15.98:0/1925839848 conn(0x7fc0bc0d1da0 msgr2=0x7fc0bc0d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:18.219 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:18.217+0000 7fc0c44c5640 1 -- 172.21.15.98:0/1925839848 shutdown_connections 2024-09-16T15:38:18.219 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:18.217+0000 7fc0c44c5640 1 -- 172.21.15.98:0/1925839848 wait complete. 2024-09-16T15:38:18.220 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:18.218+0000 7fc0c44c5640 1 Processor -- start 2024-09-16T15:38:18.220 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:18.219+0000 7fc0c44c5640 1 -- start start 2024-09-16T15:38:18.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:18.219+0000 7fc0c44c5640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc0a80039e0 0x7fc0bc0b6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:18.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:18.219+0000 7fc0c44c5640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc0bc14f120 0x7fc0bc151ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:18.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:18.219+0000 7fc0c44c5640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc0bc0af770 0x7fc0bc0afbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:18.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:18.219+0000 7fc0c44c5640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc0bc164bb0 con 0x7fc0a80039e0 2024-09-16T15:38:18.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:18.219+0000 7fc0c44c5640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc0bc164a30 con 0x7fc0bc14f120 2024-09-16T15:38:18.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:18.219+0000 7fc0c44c5640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fc0bc164d30 con 0x7fc0bc0af770 2024-09-16T15:38:18.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:18.219+0000 7fc0c2261640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc0a80039e0 0x7fc0bc0b6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:18.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:18.219+0000 7fc0c2261640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc0a80039e0 0x7fc0bc0b6fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46012/0 (socket says 172.21.15.98:46012) 2024-09-16T15:38:18.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:18.219+0000 7fc0c2261640 1 -- 172.21.15.98:0/570370175 learned_addr learned my addr 172.21.15.98:0/570370175 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:18.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:18.220+0000 7fc0c1a60640 1 --2- 172.21.15.98:0/570370175 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc0bc14f120 0x7fc0bc151ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:18.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:18.220+0000 7fc0c2a62640 1 --2- 172.21.15.98:0/570370175 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc0bc0af770 0x7fc0bc0afbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:18.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:18.220+0000 7fc0c2261640 1 -- 172.21.15.98:0/570370175 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc0bc0af770 msgr2=0x7fc0bc0afbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:18.223 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:18.220+0000 7fc0c2261640 1 --2- 172.21.15.98:0/570370175 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc0bc0af770 0x7fc0bc0afbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:18.223 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:18.220+0000 7fc0c2261640 1 -- 172.21.15.98:0/570370175 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc0bc14f120 msgr2=0x7fc0bc151ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:18.223 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:18.220+0000 7fc0c2261640 1 --2- 172.21.15.98:0/570370175 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc0bc14f120 0x7fc0bc151ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:18.223 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:18.220+0000 7fc0c2261640 1 -- 172.21.15.98:0/570370175 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0bc1529d0 con 0x7fc0a80039e0 2024-09-16T15:38:18.223 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:18.220+0000 7fc0c2261640 1 --2- 172.21.15.98:0/570370175 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc0a80039e0 0x7fc0bc0b6fb0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc0b800c350 tx=0x7fc0b8001d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:18.223 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:18.220+0000 7fc0aeffd640 1 -- 172.21.15.98:0/570370175 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b8032030 con 0x7fc0a80039e0 2024-09-16T15:38:18.223 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:18.220+0000 7fc0aeffd640 1 -- 172.21.15.98:0/570370175 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc0b8003af0 con 0x7fc0a80039e0 2024-09-16T15:38:18.223 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:18.220+0000 7fc0aeffd640 1 -- 172.21.15.98:0/570370175 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b802e480 con 0x7fc0a80039e0 2024-09-16T15:38:18.223 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:18.220+0000 7fc0c44c5640 1 -- 172.21.15.98:0/570370175 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0bc152cb0 con 0x7fc0a80039e0 2024-09-16T15:38:18.223 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:18.220+0000 7fc0c44c5640 1 -- 172.21.15.98:0/570370175 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0bc0c84f0 con 0x7fc0a80039e0 2024-09-16T15:38:18.224 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:18.221+0000 7fc0c44c5640 1 -- 172.21.15.98:0/570370175 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0bc0ce4a0 con 0x7fc0a80039e0 2024-09-16T15:38:18.224 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:18.222+0000 7fc0aeffd640 1 -- 172.21.15.98:0/570370175 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7fc0b8035020 con 0x7fc0a80039e0 2024-09-16T15:38:18.224 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:18.222+0000 7fc0aeffd640 1 --2- 172.21.15.98:0/570370175 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fc0a0078850 0x7fc0a007ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:18.224 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:18.222+0000 7fc0aeffd640 1 -- 172.21.15.98:0/570370175 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 4943+0+0 (secure 0 0 0) 0x7fc0b80ba9a0 con 0x7fc0a80039e0 2024-09-16T15:38:18.224 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:18.222+0000 7fc0c1a60640 1 --2- 172.21.15.98:0/570370175 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fc0a0078850 0x7fc0a007ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:18.224 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:18.223+0000 7fc0c1a60640 1 --2- 172.21.15.98:0/570370175 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fc0a0078850 0x7fc0a007ad10 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc0c88f0 tx=0x7fc0b0006b10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:18.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:18.226+0000 7fc0aeffd640 1 -- 172.21.15.98:0/570370175 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7fc0b80833a0 con 0x7fc0a80039e0 2024-09-16T15:38:18.418 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:18.417+0000 7fc0c44c5640 1 -- 172.21.15.98:0/570370175 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fc0bc0d2250 con 0x7fc0a80039e0 2024-09-16T15:38:19.045 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.043+0000 7fc0aeffd640 1 -- 172.21.15.98:0/570370175 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v28) ==== 97+0+0 (secure 0 0 0) 0x7fc0b8082ca0 con 0x7fc0a80039e0 2024-09-16T15:38:19.045 INFO:teuthology.orchestra.run.smithi098.stderr: removed all blocklist entries 2024-09-16T15:38:19.047 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.046+0000 7fc0c44c5640 1 -- 172.21.15.98:0/570370175 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fc0a0078850 msgr2=0x7fc0a007ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:19.047 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.046+0000 7fc0c44c5640 1 --2- 172.21.15.98:0/570370175 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fc0a0078850 0x7fc0a007ad10 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc0c88f0 tx=0x7fc0b0006b10 comp rx=0 tx=0).stop 2024-09-16T15:38:19.048 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.046+0000 7fc0c44c5640 1 -- 172.21.15.98:0/570370175 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc0a80039e0 msgr2=0x7fc0bc0b6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:19.048 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.046+0000 7fc0c44c5640 1 --2- 172.21.15.98:0/570370175 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc0a80039e0 0x7fc0bc0b6fb0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc0b800c350 tx=0x7fc0b8001d40 comp rx=0 tx=0).stop 2024-09-16T15:38:19.048 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.046+0000 7fc0c44c5640 1 -- 172.21.15.98:0/570370175 shutdown_connections 2024-09-16T15:38:19.048 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.046+0000 7fc0c44c5640 1 --2- 172.21.15.98:0/570370175 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc0bc0af770 0x7fc0bc0afbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:19.048 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.046+0000 7fc0c44c5640 1 --2- 172.21.15.98:0/570370175 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fc0a0078850 0x7fc0a007ad10 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:19.048 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.046+0000 7fc0c44c5640 1 --2- 172.21.15.98:0/570370175 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc0bc14f120 0x7fc0bc151ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:19.048 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.046+0000 7fc0c44c5640 1 --2- 172.21.15.98:0/570370175 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc0a80039e0 0x7fc0bc0b6fb0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:19.048 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.046+0000 7fc0c44c5640 1 -- 172.21.15.98:0/570370175 >> 172.21.15.98:0/570370175 conn(0x7fc0bc0d1da0 msgr2=0x7fc0bc0b2290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:19.048 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.046+0000 7fc0c44c5640 1 -- 172.21.15.98:0/570370175 shutdown_connections 2024-09-16T15:38:19.048 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.046+0000 7fc0c44c5640 1 -- 172.21.15.98:0/570370175 wait complete. 2024-09-16T15:38:19.060 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-16T15:38:19.162 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.161+0000 7efd84a2a640 1 -- 172.21.15.98:0/972001243 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efd6c004d40 msgr2=0x7efd6c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:19.162 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.161+0000 7efd84a2a640 1 --2- 172.21.15.98:0/972001243 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efd6c004d40 0x7efd6c0051c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7efd700016c0 tx=0x7efd6c005830 comp rx=0 tx=0).stop 2024-09-16T15:38:19.162 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.161+0000 7efd7ed9d640 1 -- 172.21.15.98:0/972001243 reap_dead start 2024-09-16T15:38:19.162 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.161+0000 7efd84a2a640 1 -- 172.21.15.98:0/972001243 shutdown_connections 2024-09-16T15:38:19.163 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.161+0000 7efd84a2a640 1 -- 172.21.15.98:0/972001243 >> 172.21.15.98:0/972001243 conn(0x7efd800b1950 msgr2=0x7efd800b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:19.163 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.161+0000 7efd84a2a640 1 -- 172.21.15.98:0/972001243 shutdown_connections 2024-09-16T15:38:19.163 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.161+0000 7efd84a2a640 1 -- 172.21.15.98:0/972001243 wait complete. 2024-09-16T15:38:19.163 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.162+0000 7efd84a2a640 1 Processor -- start 2024-09-16T15:38:19.163 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.163+0000 7efd84a2a640 1 -- start start 2024-09-16T15:38:19.165 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.163+0000 7efd84a2a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd6c004d40 0x7efd800c8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:19.165 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.163+0000 7efd84a2a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efd8015e880 0x7efd801585e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:19.165 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.163+0000 7efd84a2a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efd8006f2d0 0x7efd8006f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:19.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.163+0000 7efd84a2a640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7efd800729a0 con 0x7efd8006f2d0 2024-09-16T15:38:19.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.163+0000 7efd84a2a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7efd800b4eb0 con 0x7efd6c004d40 2024-09-16T15:38:19.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.163+0000 7efd84a2a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7efd80072b20 con 0x7efd8015e880 2024-09-16T15:38:19.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.163+0000 7efd7ed9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efd8006f2d0 0x7efd8006f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:19.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.163+0000 7efd7ed9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efd8006f2d0 0x7efd8006f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46038/0 (socket says 172.21.15.98:46038) 2024-09-16T15:38:19.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.163+0000 7efd7ed9d640 1 -- 172.21.15.98:0/3415658405 learned_addr learned my addr 172.21.15.98:0/3415658405 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:19.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.163+0000 7efd7dd9b640 1 --2- 172.21.15.98:0/3415658405 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efd8015e880 0x7efd801585e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:19.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.163+0000 7efd7e59c640 1 --2- 172.21.15.98:0/3415658405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd6c004d40 0x7efd800c8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:19.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.164+0000 7efd7ed9d640 1 -- 172.21.15.98:0/3415658405 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efd8015e880 msgr2=0x7efd801585e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:19.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.164+0000 7efd7ed9d640 1 --2- 172.21.15.98:0/3415658405 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efd8015e880 0x7efd801585e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:19.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.164+0000 7efd7ed9d640 1 -- 172.21.15.98:0/3415658405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd6c004d40 msgr2=0x7efd800c8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:19.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.164+0000 7efd7ed9d640 1 --2- 172.21.15.98:0/3415658405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd6c004d40 0x7efd800c8fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:19.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.164+0000 7efd7ed9d640 1 -- 172.21.15.98:0/3415658405 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd8013dde0 con 0x7efd8006f2d0 2024-09-16T15:38:19.167 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.164+0000 7efd7ed9d640 1 --2- 172.21.15.98:0/3415658405 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efd8006f2d0 0x7efd8006f750 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7efd7002a930 tx=0x7efd7002aeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:19.167 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.164+0000 7efd76ffd640 1 -- 172.21.15.98:0/3415658405 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd70038070 con 0x7efd8006f2d0 2024-09-16T15:38:19.167 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.164+0000 7efd76ffd640 1 -- 172.21.15.98:0/3415658405 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efd700035f0 con 0x7efd8006f2d0 2024-09-16T15:38:19.167 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.164+0000 7efd84a2a640 1 -- 172.21.15.98:0/3415658405 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd8006e7f0 con 0x7efd8006f2d0 2024-09-16T15:38:19.167 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.164+0000 7efd76ffd640 1 -- 172.21.15.98:0/3415658405 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd70003a20 con 0x7efd8006f2d0 2024-09-16T15:38:19.167 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.164+0000 7efd84a2a640 1 -- 172.21.15.98:0/3415658405 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd8006edb0 con 0x7efd8006f2d0 2024-09-16T15:38:19.168 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.165+0000 7efd84a2a640 1 -- 172.21.15.98:0/3415658405 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd8006efb0 con 0x7efd8006f2d0 2024-09-16T15:38:19.168 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.166+0000 7efd76ffd640 1 -- 172.21.15.98:0/3415658405 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7efd70044020 con 0x7efd8006f2d0 2024-09-16T15:38:19.168 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.166+0000 7efd76ffd640 1 --2- 172.21.15.98:0/3415658405 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7efd60078850 0x7efd6007ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:19.168 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.166+0000 7efd76ffd640 1 -- 172.21.15.98:0/3415658405 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7efd700b9920 con 0x7efd8006f2d0 2024-09-16T15:38:19.168 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.166+0000 7efd7e59c640 1 --2- 172.21.15.98:0/3415658405 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7efd60078850 0x7efd6007ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:19.168 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.167+0000 7efd7e59c640 1 --2- 172.21.15.98:0/3415658405 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7efd60078850 0x7efd6007ad10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7efd78001220 tx=0x7efd78006720 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:19.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.170+0000 7efd76ffd640 1 -- 172.21.15.98:0/3415658405 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7efd8006efb0 con 0x7efd8006f2d0 2024-09-16T15:38:19.415 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.414+0000 7efd84a2a640 1 -- 172.21.15.98:0/3415658405 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7efd800cebf0 con 0x7efd8006f2d0 2024-09-16T15:38:19.416 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.415+0000 7efd76ffd640 1 -- 172.21.15.98:0/3415658405 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v10) ==== 80+0+6645 (secure 0 0 0) 0x7efd70081d20 con 0x7efd8006f2d0 2024-09-16T15:38:19.416 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:38:19.416 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-16T15:38:19.416 INFO:teuthology.orchestra.run.smithi098.stdout: "auth_dump": [ 2024-09-16T15:38:19.416 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:19.416 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "mds.a", 2024-09-16T15:38:19.416 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQCMUOhmkTQKORAAZi8qcnJ6e57exdaFWPN1QA==", 2024-09-16T15:38:19.416 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2024-09-16T15:38:19.416 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2024-09-16T15:38:19.417 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow *", 2024-09-16T15:38:19.417 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow *", 2024-09-16T15:38:19.417 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2024-09-16T15:38:19.417 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:19.417 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:19.417 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:19.417 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "mds.b", 2024-09-16T15:38:19.417 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQCNUOhminwOCRAAmz2Mt2RS2IKnruB12U9mVA==", 2024-09-16T15:38:19.417 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2024-09-16T15:38:19.417 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2024-09-16T15:38:19.417 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow *", 2024-09-16T15:38:19.417 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow *", 2024-09-16T15:38:19.417 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2024-09-16T15:38:19.417 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:19.418 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:19.418 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:19.418 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "mds.c", 2024-09-16T15:38:19.418 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQCNUOhmOJ1rBBAASEumP033msjxcNvGJG5Siw==", 2024-09-16T15:38:19.418 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2024-09-16T15:38:19.418 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2024-09-16T15:38:19.418 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow *", 2024-09-16T15:38:19.418 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow *", 2024-09-16T15:38:19.418 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2024-09-16T15:38:19.418 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:19.418 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:19.418 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:19.418 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "mds.d", 2024-09-16T15:38:19.418 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQCNUOhmLKkZEBAA4TrNTOyyoA8q5O4LgwCmxg==", 2024-09-16T15:38:19.419 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2024-09-16T15:38:19.419 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2024-09-16T15:38:19.419 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow *", 2024-09-16T15:38:19.419 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow *", 2024-09-16T15:38:19.419 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2024-09-16T15:38:19.419 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:19.419 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:19.419 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:19.419 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.0", 2024-09-16T15:38:19.419 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQCQUOhmHu2QLBAAPVPtMpG5B3zZxnuq4DpMVQ==", 2024-09-16T15:38:19.419 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2024-09-16T15:38:19.419 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2024-09-16T15:38:19.419 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2024-09-16T15:38:19.419 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2024-09-16T15:38:19.419 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:19.420 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:19.420 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:19.420 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.1", 2024-09-16T15:38:19.420 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQCTUOhmU+pSLhAALgsA/Y5p4gmq770Zbu+uDw==", 2024-09-16T15:38:19.420 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2024-09-16T15:38:19.420 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2024-09-16T15:38:19.420 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2024-09-16T15:38:19.420 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2024-09-16T15:38:19.420 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:19.420 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:19.420 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:19.420 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.2", 2024-09-16T15:38:19.420 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQCWUOhm/+bmLxAAc8wUBWIaqb+p6peuujpQlQ==", 2024-09-16T15:38:19.420 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2024-09-16T15:38:19.421 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2024-09-16T15:38:19.421 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2024-09-16T15:38:19.421 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2024-09-16T15:38:19.421 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:19.421 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:19.421 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:19.421 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.3", 2024-09-16T15:38:19.421 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQCaUOhmKBdDBRAAKSNaZgD5EWOtiDrxCxHJTA==", 2024-09-16T15:38:19.421 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2024-09-16T15:38:19.421 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2024-09-16T15:38:19.421 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2024-09-16T15:38:19.421 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2024-09-16T15:38:19.421 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:19.421 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:19.422 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:19.422 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.4", 2024-09-16T15:38:19.422 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQCgUOhm4/U2DhAAaxH/dR03udDCOLBwhxLnaw==", 2024-09-16T15:38:19.422 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2024-09-16T15:38:19.422 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2024-09-16T15:38:19.422 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2024-09-16T15:38:19.422 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2024-09-16T15:38:19.422 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:19.422 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:19.422 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:19.422 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.5", 2024-09-16T15:38:19.422 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQCjUOhmpf8fHhAAuQR+fMwdlXbNDU6GH/90ZA==", 2024-09-16T15:38:19.422 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2024-09-16T15:38:19.422 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2024-09-16T15:38:19.422 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2024-09-16T15:38:19.423 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2024-09-16T15:38:19.423 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:19.423 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:19.423 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:19.423 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.6", 2024-09-16T15:38:19.423 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQCnUOhm6v7uABAAyY9B6iGGQDseicwWMkOfeA==", 2024-09-16T15:38:19.423 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2024-09-16T15:38:19.423 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2024-09-16T15:38:19.423 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2024-09-16T15:38:19.423 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2024-09-16T15:38:19.423 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:19.423 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:19.423 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:19.423 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "osd.7", 2024-09-16T15:38:19.424 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQCqUOhmfo0QAhAAuhwkDXjYo5BJMNxPrWx0yQ==", 2024-09-16T15:38:19.424 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2024-09-16T15:38:19.424 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow profile osd", 2024-09-16T15:38:19.424 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile osd", 2024-09-16T15:38:19.424 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2024-09-16T15:38:19.424 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:19.424 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:19.424 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:19.424 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "client.0", 2024-09-16T15:38:19.424 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQCNUOhm6+4tFBAAxdHfj+ZVPqgZXxWTlCBNMg==", 2024-09-16T15:38:19.424 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2024-09-16T15:38:19.424 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2024-09-16T15:38:19.424 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow r", 2024-09-16T15:38:19.425 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow rw", 2024-09-16T15:38:19.425 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow rwx" 2024-09-16T15:38:19.425 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:19.425 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:19.425 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:19.425 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "client.1", 2024-09-16T15:38:19.425 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQCNUOhmXULiHBAAL5UT/XVWMjFfaIffgDBlGQ==", 2024-09-16T15:38:19.425 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2024-09-16T15:38:19.425 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2024-09-16T15:38:19.425 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow r", 2024-09-16T15:38:19.425 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow rw", 2024-09-16T15:38:19.425 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow rwx" 2024-09-16T15:38:19.425 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:19.425 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:19.425 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:19.425 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "client.2", 2024-09-16T15:38:19.426 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQCNUOhm5VW0GRAA9qmRFVE7nn29uPoYWC0oHA==", 2024-09-16T15:38:19.426 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2024-09-16T15:38:19.426 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2024-09-16T15:38:19.426 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow r", 2024-09-16T15:38:19.426 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow rw", 2024-09-16T15:38:19.426 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow rwx" 2024-09-16T15:38:19.426 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:19.426 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:19.426 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:19.426 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "client.3", 2024-09-16T15:38:19.426 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQCNUOhmHd5vIhAAak22Jp8LOK2eYiZiTbZVTg==", 2024-09-16T15:38:19.426 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2024-09-16T15:38:19.426 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow", 2024-09-16T15:38:19.426 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow r", 2024-09-16T15:38:19.426 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow rw", 2024-09-16T15:38:19.426 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow rwx" 2024-09-16T15:38:19.427 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:19.427 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:19.427 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:19.427 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "client.admin", 2024-09-16T15:38:19.427 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQCMUOhmCPOEHRAAOeAOLfo1qQdD5t1IE4bQNw==", 2024-09-16T15:38:19.427 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2024-09-16T15:38:19.427 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow *", 2024-09-16T15:38:19.427 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr": "allow *", 2024-09-16T15:38:19.427 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow *", 2024-09-16T15:38:19.427 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2024-09-16T15:38:19.427 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:19.427 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:19.427 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:19.427 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "client.bootstrap-mds", 2024-09-16T15:38:19.427 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQCwUOhmceshFxAAWFYjeqiYHUPrdP1wDmEDNA==", 2024-09-16T15:38:19.428 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2024-09-16T15:38:19.428 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile bootstrap-mds" 2024-09-16T15:38:19.428 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:19.428 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:19.428 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:19.428 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "client.bootstrap-mgr", 2024-09-16T15:38:19.428 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQCwUOhm//MhFxAAUxRd3RrPouk5fNiJvgNRhA==", 2024-09-16T15:38:19.428 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2024-09-16T15:38:19.428 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile bootstrap-mgr" 2024-09-16T15:38:19.428 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:19.428 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:19.428 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:19.428 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "client.bootstrap-osd", 2024-09-16T15:38:19.428 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQCwUOhm3/ohFxAAhmOadSmRCaw8x447JOzgVA==", 2024-09-16T15:38:19.429 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2024-09-16T15:38:19.429 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile bootstrap-osd" 2024-09-16T15:38:19.429 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:19.429 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:19.429 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:19.429 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "client.bootstrap-rbd", 2024-09-16T15:38:19.429 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQCwUOhmmgEiFxAADmi+2kFY0I9eSjZNJZjPfQ==", 2024-09-16T15:38:19.429 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2024-09-16T15:38:19.429 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile bootstrap-rbd" 2024-09-16T15:38:19.429 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:19.429 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:19.429 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:19.429 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-09-16T15:38:19.429 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQCwUOhm4goiFxAAJvbknv41aHqvNtNk8H0Mug==", 2024-09-16T15:38:19.430 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2024-09-16T15:38:19.430 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-09-16T15:38:19.430 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:19.430 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:19.430 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:19.430 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "client.bootstrap-rgw", 2024-09-16T15:38:19.430 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQCwUOhm2hEiFxAAO4y2jZdySfx17M3wz9qrag==", 2024-09-16T15:38:19.430 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2024-09-16T15:38:19.430 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile bootstrap-rgw" 2024-09-16T15:38:19.430 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:19.430 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:19.430 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:19.430 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "mgr.x", 2024-09-16T15:38:19.430 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQCMUOhmUZHdNRAAZBWh9sMBY5e3h+JKzChbUA==", 2024-09-16T15:38:19.430 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2024-09-16T15:38:19.431 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow *", 2024-09-16T15:38:19.431 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile mgr", 2024-09-16T15:38:19.431 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2024-09-16T15:38:19.431 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:19.431 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:19.431 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:19.431 INFO:teuthology.orchestra.run.smithi098.stdout: "entity": "mgr.y", 2024-09-16T15:38:19.431 INFO:teuthology.orchestra.run.smithi098.stdout: "key": "AQCMUOhmulMTMhAAFw74sprswWnX8sJCf58Opw==", 2024-09-16T15:38:19.431 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": { 2024-09-16T15:38:19.431 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": "allow *", 2024-09-16T15:38:19.431 INFO:teuthology.orchestra.run.smithi098.stdout: "mon": "allow profile mgr", 2024-09-16T15:38:19.431 INFO:teuthology.orchestra.run.smithi098.stdout: "osd": "allow *" 2024-09-16T15:38:19.431 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:19.431 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:19.431 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-16T15:38:19.432 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-16T15:38:19.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.417+0000 7efd84a2a640 1 -- 172.21.15.98:0/3415658405 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7efd60078850 msgr2=0x7efd6007ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:19.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.417+0000 7efd84a2a640 1 --2- 172.21.15.98:0/3415658405 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7efd60078850 0x7efd6007ad10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7efd78001220 tx=0x7efd78006720 comp rx=0 tx=0).stop 2024-09-16T15:38:19.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.417+0000 7efd84a2a640 1 -- 172.21.15.98:0/3415658405 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efd8006f2d0 msgr2=0x7efd8006f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:19.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.417+0000 7efd84a2a640 1 --2- 172.21.15.98:0/3415658405 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efd8006f2d0 0x7efd8006f750 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7efd7002a930 tx=0x7efd7002aeb0 comp rx=0 tx=0).stop 2024-09-16T15:38:19.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.417+0000 7efd84a2a640 1 -- 172.21.15.98:0/3415658405 shutdown_connections 2024-09-16T15:38:19.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.417+0000 7efd84a2a640 1 --2- 172.21.15.98:0/3415658405 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efd8006f2d0 0x7efd8006f750 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:19.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.417+0000 7efd84a2a640 1 --2- 172.21.15.98:0/3415658405 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efd8015e880 0x7efd801585e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:19.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.417+0000 7efd84a2a640 1 --2- 172.21.15.98:0/3415658405 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7efd60078850 0x7efd6007ad10 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:19.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.417+0000 7efd84a2a640 1 --2- 172.21.15.98:0/3415658405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd6c004d40 0x7efd800c8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:19.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.417+0000 7efd84a2a640 1 -- 172.21.15.98:0/3415658405 >> 172.21.15.98:0/3415658405 conn(0x7efd800b1950 msgr2=0x7efd80075890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:19.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.417+0000 7efd84a2a640 1 -- 172.21.15.98:0/3415658405 shutdown_connections 2024-09-16T15:38:19.434 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.417+0000 7efd84a2a640 1 -- 172.21.15.98:0/3415658405 wait complete. 2024-09-16T15:38:19.434 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-09-16T15:38:19.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.535+0000 7f040f1ad640 1 -- 172.21.15.98:0/422989317 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04080b4ca0 msgr2=0x7f04080cf130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:19.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.535+0000 7f040f1ad640 1 --2- 172.21.15.98:0/422989317 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04080b4ca0 0x7f04080cf130 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0400005fd0 tx=0x7f040002a8d0 comp rx=0 tx=0).stop 2024-09-16T15:38:19.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.535+0000 7f040f1ad640 1 -- 172.21.15.98:0/422989317 shutdown_connections 2024-09-16T15:38:19.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.535+0000 7f040f1ad640 1 --2- 172.21.15.98:0/422989317 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04080b4ca0 0x7f04080cf130 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:19.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.535+0000 7f040f1ad640 1 --2- 172.21.15.98:0/422989317 >> v2:172.21.15.135:3300/0 conn(0x7f04081445d0 0x7f04080cebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:19.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.535+0000 7f040f1ad640 1 -- 172.21.15.98:0/422989317 >> 172.21.15.98:0/422989317 conn(0x7f04080b1950 msgr2=0x7f04080b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:19.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.535+0000 7f040f1ad640 1 -- 172.21.15.98:0/422989317 shutdown_connections 2024-09-16T15:38:19.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.535+0000 7f040f1ad640 1 -- 172.21.15.98:0/422989317 wait complete. 2024-09-16T15:38:19.539 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.536+0000 7f040f1ad640 1 Processor -- start 2024-09-16T15:38:19.539 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.536+0000 7f040f1ad640 1 -- start start 2024-09-16T15:38:19.540 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.537+0000 7f040f1ad640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f04080b4ca0 0x7f0408159d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:19.540 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.537+0000 7f040f1ad640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04080ccfd0 0x7f040815b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:19.540 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.537+0000 7f040f1ad640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04081445d0 0x7f040815b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:19.540 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.537+0000 7f040f1ad640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f040815f080 con 0x7f04080b4ca0 2024-09-16T15:38:19.540 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.537+0000 7f040f1ad640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0408073bc0 con 0x7f04080ccfd0 2024-09-16T15:38:19.540 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.537+0000 7f040f1ad640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f040815f200 con 0x7f04081445d0 2024-09-16T15:38:19.540 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.537+0000 7f040cf49640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f04080b4ca0 0x7f0408159d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:19.540 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.538+0000 7f040cf49640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f04080b4ca0 0x7f0408159d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46050/0 (socket says 172.21.15.98:46050) 2024-09-16T15:38:19.540 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.538+0000 7f040cf49640 1 -- 172.21.15.98:0/3389518478 learned_addr learned my addr 172.21.15.98:0/3389518478 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:19.540 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.538+0000 7f040d74a640 1 --2- 172.21.15.98:0/3389518478 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04081445d0 0x7f040815b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:19.540 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.538+0000 7f0407fff640 1 --2- 172.21.15.98:0/3389518478 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04080ccfd0 0x7f040815b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:19.540 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.538+0000 7f040cf49640 1 -- 172.21.15.98:0/3389518478 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04081445d0 msgr2=0x7f040815b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:19.541 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.538+0000 7f040cf49640 1 --2- 172.21.15.98:0/3389518478 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04081445d0 0x7f040815b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:19.541 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.538+0000 7f040cf49640 1 -- 172.21.15.98:0/3389518478 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04080ccfd0 msgr2=0x7f040815b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:19.541 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.538+0000 7f040cf49640 1 --2- 172.21.15.98:0/3389518478 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04080ccfd0 0x7f040815b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:19.541 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.538+0000 7f040cf49640 1 -- 172.21.15.98:0/3389518478 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f040815e100 con 0x7f04080b4ca0 2024-09-16T15:38:19.541 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.538+0000 7f0407fff640 1 --2- 172.21.15.98:0/3389518478 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04080ccfd0 0x7f040815b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T15:38:19.541 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.538+0000 7f040cf49640 1 --2- 172.21.15.98:0/3389518478 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f04080b4ca0 0x7f0408159d60 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f03f800e790 tx=0x7f03f800ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:19.541 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.538+0000 7f04057fa640 1 -- 172.21.15.98:0/3389518478 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03f800eea0 con 0x7f04080b4ca0 2024-09-16T15:38:19.541 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.538+0000 7f04057fa640 1 -- 172.21.15.98:0/3389518478 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f03f800cdb0 con 0x7f04080b4ca0 2024-09-16T15:38:19.541 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.538+0000 7f040f1ad640 1 -- 172.21.15.98:0/3389518478 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f040813d680 con 0x7f04080b4ca0 2024-09-16T15:38:19.541 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.538+0000 7f04057fa640 1 -- 172.21.15.98:0/3389518478 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03f8010690 con 0x7f04080b4ca0 2024-09-16T15:38:19.541 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.538+0000 7f040f1ad640 1 -- 172.21.15.98:0/3389518478 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0408139f60 con 0x7f04080b4ca0 2024-09-16T15:38:19.542 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.539+0000 7f040f1ad640 1 -- 172.21.15.98:0/3389518478 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f040815f6b0 con 0x7f04080b4ca0 2024-09-16T15:38:19.542 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.540+0000 7f04057fa640 1 -- 172.21.15.98:0/3389518478 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7f03f8010830 con 0x7f04080b4ca0 2024-09-16T15:38:19.542 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.540+0000 7f04057fa640 1 --2- 172.21.15.98:0/3389518478 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f03f4078850 0x7f03f407ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:19.542 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.540+0000 7f04057fa640 1 -- 172.21.15.98:0/3389518478 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f03f809af40 con 0x7f04080b4ca0 2024-09-16T15:38:19.542 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.540+0000 7f0407fff640 1 --2- 172.21.15.98:0/3389518478 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f03f4078850 0x7f03f407ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:19.543 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.541+0000 7f0407fff640 1 --2- 172.21.15.98:0/3389518478 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f03f4078850 0x7f03f407ad10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f03fc001eb0 tx=0x7f03fc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:19.545 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.544+0000 7f04057fa640 1 -- 172.21.15.98:0/3389518478 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7f03f8063910 con 0x7f04080b4ca0 2024-09-16T15:38:19.787 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.786+0000 7f040f1ad640 1 -- 172.21.15.98:0/3389518478 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f040815e2d0 con 0x7f04080b4ca0 2024-09-16T15:38:19.789 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.788+0000 7f04057fa640 1 -- 172.21.15.98:0/3389518478 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v11) ==== 90+0+0 (secure 0 0 0) 0x7f03f8063210 con 0x7f04080b4ca0 2024-09-16T15:38:19.791 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.790+0000 7f040f1ad640 1 -- 172.21.15.98:0/3389518478 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f03f4078850 msgr2=0x7f03f407ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:19.791 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.790+0000 7f040f1ad640 1 --2- 172.21.15.98:0/3389518478 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f03f4078850 0x7f03f407ad10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f03fc001eb0 tx=0x7f03fc009040 comp rx=0 tx=0).stop 2024-09-16T15:38:19.791 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.790+0000 7f040f1ad640 1 -- 172.21.15.98:0/3389518478 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f04080b4ca0 msgr2=0x7f0408159d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:19.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.790+0000 7f040f1ad640 1 --2- 172.21.15.98:0/3389518478 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f04080b4ca0 0x7f0408159d60 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f03f800e790 tx=0x7f03f800ec50 comp rx=0 tx=0).stop 2024-09-16T15:38:19.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.790+0000 7f040f1ad640 1 -- 172.21.15.98:0/3389518478 shutdown_connections 2024-09-16T15:38:19.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.790+0000 7f040f1ad640 1 --2- 172.21.15.98:0/3389518478 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f04081445d0 0x7f040815b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:19.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.790+0000 7f040f1ad640 1 --2- 172.21.15.98:0/3389518478 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f03f4078850 0x7f03f407ad10 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:19.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.790+0000 7f040f1ad640 1 --2- 172.21.15.98:0/3389518478 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04080ccfd0 0x7f040815b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:19.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.790+0000 7f040f1ad640 1 --2- 172.21.15.98:0/3389518478 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f04080b4ca0 0x7f0408159d60 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:19.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.790+0000 7f040f1ad640 1 -- 172.21.15.98:0/3389518478 >> 172.21.15.98:0/3389518478 conn(0x7f04080b1950 msgr2=0x7f040806e740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:19.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.790+0000 7f040f1ad640 1 -- 172.21.15.98:0/3389518478 shutdown_connections 2024-09-16T15:38:19.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.790+0000 7f040f1ad640 1 -- 172.21.15.98:0/3389518478 wait complete. 2024-09-16T15:38:19.802 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-09-16T15:38:19.903 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.902+0000 7fd15402a640 1 -- 172.21.15.98:0/1576097946 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd14c0cf170 msgr2=0x7fd14c0d1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:19.903 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.902+0000 7fd15402a640 1 --2- 172.21.15.98:0/1576097946 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd14c0cf170 0x7fd14c0d1c40 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd144005fd0 tx=0x7fd14402a4a0 comp rx=0 tx=0).stop 2024-09-16T15:38:19.903 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.902+0000 7fd15402a640 1 -- 172.21.15.98:0/1576097946 shutdown_connections 2024-09-16T15:38:19.903 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.902+0000 7fd15402a640 1 --2- 172.21.15.98:0/1576097946 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd14c0cf170 0x7fd14c0d1c40 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:19.903 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.902+0000 7fd15402a640 1 --2- 172.21.15.98:0/1576097946 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd14c0b73c0 0x7fd14c071bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:19.904 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.902+0000 7fd15402a640 1 -- 172.21.15.98:0/1576097946 >> 172.21.15.98:0/1576097946 conn(0x7fd14c06d230 msgr2=0x7fd14c0688b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:19.904 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.902+0000 7fd15402a640 1 -- 172.21.15.98:0/1576097946 shutdown_connections 2024-09-16T15:38:19.904 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.902+0000 7fd15402a640 1 -- 172.21.15.98:0/1576097946 wait complete. 2024-09-16T15:38:19.904 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.903+0000 7fd15402a640 1 Processor -- start 2024-09-16T15:38:19.904 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.903+0000 7fd15402a640 1 -- start start 2024-09-16T15:38:19.906 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.904+0000 7fd15402a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd14c071260 0x7fd14c1f8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:19.906 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.904+0000 7fd15402a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd14c0b73c0 0x7fd14c1f85c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:19.906 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.904+0000 7fd15402a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd14c0cf170 0x7fd14c1f8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:19.906 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.904+0000 7fd15402a640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd14c0d2180 con 0x7fd14c071260 2024-09-16T15:38:19.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.904+0000 7fd15402a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd14c0b79b0 con 0x7fd14c0b73c0 2024-09-16T15:38:19.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.904+0000 7fd15402a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fd14c0d2300 con 0x7fd14c0cf170 2024-09-16T15:38:19.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.904+0000 7fd151dc6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd14c071260 0x7fd14c1f8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:19.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.904+0000 7fd151dc6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd14c071260 0x7fd14c1f8080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46074/0 (socket says 172.21.15.98:46074) 2024-09-16T15:38:19.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.904+0000 7fd151dc6640 1 -- 172.21.15.98:0/3693211396 learned_addr learned my addr 172.21.15.98:0/3693211396 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:19.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.904+0000 7fd1525c7640 1 --2- 172.21.15.98:0/3693211396 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd14c0cf170 0x7fd14c1f8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:19.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.904+0000 7fd1515c5640 1 --2- 172.21.15.98:0/3693211396 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd14c0b73c0 0x7fd14c1f85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:19.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.904+0000 7fd151dc6640 1 -- 172.21.15.98:0/3693211396 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd14c0cf170 msgr2=0x7fd14c1f8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:19.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.904+0000 7fd151dc6640 1 --2- 172.21.15.98:0/3693211396 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd14c0cf170 0x7fd14c1f8b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:19.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.904+0000 7fd151dc6640 1 -- 172.21.15.98:0/3693211396 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd14c0b73c0 msgr2=0x7fd14c1f85c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:19.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.904+0000 7fd151dc6640 1 --2- 172.21.15.98:0/3693211396 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd14c0b73c0 0x7fd14c1f85c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:19.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.904+0000 7fd151dc6640 1 -- 172.21.15.98:0/3693211396 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd14c0c9370 con 0x7fd14c071260 2024-09-16T15:38:19.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.905+0000 7fd151dc6640 1 --2- 172.21.15.98:0/3693211396 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd14c071260 0x7fd14c1f8080 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd13c00cce0 tx=0x7fd13c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:19.908 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.905+0000 7fd14a7fc640 1 -- 172.21.15.98:0/3693211396 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd13c00f650 con 0x7fd14c071260 2024-09-16T15:38:19.908 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.905+0000 7fd14a7fc640 1 -- 172.21.15.98:0/3693211396 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd13c00f8e0 con 0x7fd14c071260 2024-09-16T15:38:19.908 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.905+0000 7fd15402a640 1 -- 172.21.15.98:0/3693211396 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd14c0c9650 con 0x7fd14c071260 2024-09-16T15:38:19.908 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.905+0000 7fd14a7fc640 1 -- 172.21.15.98:0/3693211396 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd13c00fd30 con 0x7fd14c071260 2024-09-16T15:38:19.908 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.905+0000 7fd15402a640 1 -- 172.21.15.98:0/3693211396 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd14c0c9c10 con 0x7fd14c071260 2024-09-16T15:38:19.909 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.906+0000 7fd15402a640 1 -- 172.21.15.98:0/3693211396 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd14c0c9100 con 0x7fd14c071260 2024-09-16T15:38:19.909 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.907+0000 7fd14a7fc640 1 -- 172.21.15.98:0/3693211396 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7fd13c018400 con 0x7fd14c071260 2024-09-16T15:38:19.909 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.907+0000 7fd14a7fc640 1 --2- 172.21.15.98:0/3693211396 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fd138078850 0x7fd13807ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:19.909 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.907+0000 7fd14a7fc640 1 -- 172.21.15.98:0/3693211396 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7fd13c09b1d0 con 0x7fd14c071260 2024-09-16T15:38:19.909 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.907+0000 7fd1515c5640 1 --2- 172.21.15.98:0/3693211396 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fd138078850 0x7fd13807ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:19.909 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.908+0000 7fd1515c5640 1 --2- 172.21.15.98:0/3693211396 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fd138078850 0x7fd13807ad10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd14c06fd60 tx=0x7fd140009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:19.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:19.911+0000 7fd14a7fc640 1 -- 172.21.15.98:0/3693211396 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7fd13c014030 con 0x7fd14c071260 2024-09-16T15:38:20.160 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.159+0000 7fd15402a640 1 -- 172.21.15.98:0/3693211396 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7fd14c0d2890 con 0x7fd14c071260 2024-09-16T15:38:20.162 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.161+0000 7fd14a7fc640 1 -- 172.21.15.98:0/3693211396 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v12) ==== 90+0+0 (secure 0 0 0) 0x7fd13c063c20 con 0x7fd14c071260 2024-09-16T15:38:20.164 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.163+0000 7fd15402a640 1 -- 172.21.15.98:0/3693211396 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fd138078850 msgr2=0x7fd13807ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:20.164 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.163+0000 7fd15402a640 1 --2- 172.21.15.98:0/3693211396 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fd138078850 0x7fd13807ad10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd14c06fd60 tx=0x7fd140009040 comp rx=0 tx=0).stop 2024-09-16T15:38:20.165 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.163+0000 7fd15402a640 1 -- 172.21.15.98:0/3693211396 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd14c071260 msgr2=0x7fd14c1f8080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:20.165 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.163+0000 7fd15402a640 1 --2- 172.21.15.98:0/3693211396 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd14c071260 0x7fd14c1f8080 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd13c00cce0 tx=0x7fd13c00a620 comp rx=0 tx=0).stop 2024-09-16T15:38:20.165 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.163+0000 7fd15402a640 1 -- 172.21.15.98:0/3693211396 shutdown_connections 2024-09-16T15:38:20.165 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.163+0000 7fd15402a640 1 --2- 172.21.15.98:0/3693211396 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd14c0cf170 0x7fd14c1f8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:20.165 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.163+0000 7fd15402a640 1 --2- 172.21.15.98:0/3693211396 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fd138078850 0x7fd13807ad10 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:20.165 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.163+0000 7fd15402a640 1 --2- 172.21.15.98:0/3693211396 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd14c0b73c0 0x7fd14c1f85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:20.165 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.163+0000 7fd15402a640 1 --2- 172.21.15.98:0/3693211396 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd14c071260 0x7fd14c1f8080 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:20.165 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.163+0000 7fd15402a640 1 -- 172.21.15.98:0/3693211396 >> 172.21.15.98:0/3693211396 conn(0x7fd14c06d230 msgr2=0x7fd14c0688b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:20.165 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.163+0000 7fd15402a640 1 -- 172.21.15.98:0/3693211396 shutdown_connections 2024-09-16T15:38:20.165 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.163+0000 7fd15402a640 1 -- 172.21.15.98:0/3693211396 wait complete. 2024-09-16T15:38:20.175 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-09-16T15:38:20.276 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.275+0000 7f46cc6be640 1 -- 172.21.15.98:0/1872960378 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46c40d29d0 msgr2=0x7f46c40cf270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:20.277 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.275+0000 7f46cc6be640 1 --2- 172.21.15.98:0/1872960378 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46c40d29d0 0x7f46c40cf270 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f46c40b1b50 tx=0x7f46b802a480 comp rx=0 tx=0).stop 2024-09-16T15:38:20.277 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.275+0000 7f46cc6be640 1 -- 172.21.15.98:0/1872960378 shutdown_connections 2024-09-16T15:38:20.277 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.275+0000 7f46cc6be640 1 --2- 172.21.15.98:0/1872960378 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46c40d29d0 0x7f46c40cf270 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:20.277 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.275+0000 7f46cc6be640 1 -- 172.21.15.98:0/1872960378 >> 172.21.15.98:0/1872960378 conn(0x7f46c40d1eb0 msgr2=0x7f46c40d22c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:20.277 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.275+0000 7f46cc6be640 1 -- 172.21.15.98:0/1872960378 shutdown_connections 2024-09-16T15:38:20.277 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.275+0000 7f46cc6be640 1 -- 172.21.15.98:0/1872960378 wait complete. 2024-09-16T15:38:20.277 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.277+0000 7f46cc6be640 1 Processor -- start 2024-09-16T15:38:20.278 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.277+0000 7f46cc6be640 1 -- start start 2024-09-16T15:38:20.280 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.277+0000 7f46cc6be640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f46c40b1e60 0x7f46c40af590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:20.280 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.277+0000 7f46cc6be640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46c40ce780 0x7f46c40afad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:20.280 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.277+0000 7f46cc6be640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46c40d29d0 0x7f46c414daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:20.280 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.277+0000 7f46cc6be640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f46c40b2b50 con 0x7f46c40ce780 2024-09-16T15:38:20.280 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.277+0000 7f46cc6be640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f46c40b29d0 con 0x7f46c40d29d0 2024-09-16T15:38:20.280 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.277+0000 7f46cc6be640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f46c40b2cd0 con 0x7f46c40b1e60 2024-09-16T15:38:20.280 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.277+0000 7f46c9c59640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46c40ce780 0x7f46c40afad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:20.280 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.277+0000 7f46c9c59640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46c40ce780 0x7f46c40afad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46090/0 (socket says 172.21.15.98:46090) 2024-09-16T15:38:20.280 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.277+0000 7f46c9c59640 1 -- 172.21.15.98:0/1310835315 learned_addr learned my addr 172.21.15.98:0/1310835315 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:20.280 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.278+0000 7f46ca45a640 1 --2- 172.21.15.98:0/1310835315 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f46c40b1e60 0x7f46c40af590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:20.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.278+0000 7f46c9c59640 1 -- 172.21.15.98:0/1310835315 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f46c40b1e60 msgr2=0x7f46c40af590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:20.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.278+0000 7f46c9c59640 1 --2- 172.21.15.98:0/1310835315 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f46c40b1e60 0x7f46c40af590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:20.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.278+0000 7f46c9c59640 1 -- 172.21.15.98:0/1310835315 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46c40d29d0 msgr2=0x7f46c414daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:20.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.278+0000 7f46c9c59640 1 --2- 172.21.15.98:0/1310835315 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46c40d29d0 0x7f46c414daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:20.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.278+0000 7f46c9c59640 1 -- 172.21.15.98:0/1310835315 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46c414eb10 con 0x7f46c40ce780 2024-09-16T15:38:20.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.278+0000 7f46c9c59640 1 --2- 172.21.15.98:0/1310835315 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46c40ce780 0x7f46c40afad0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f46b8009780 tx=0x7f46b8033d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:20.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.278+0000 7f46c2ffd640 1 -- 172.21.15.98:0/1310835315 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46b8031d60 con 0x7f46c40ce780 2024-09-16T15:38:20.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.278+0000 7f46c2ffd640 1 -- 172.21.15.98:0/1310835315 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f46b8005020 con 0x7f46c40ce780 2024-09-16T15:38:20.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.278+0000 7f46c2ffd640 1 -- 172.21.15.98:0/1310835315 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46b8005470 con 0x7f46c40ce780 2024-09-16T15:38:20.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.278+0000 7f46cc6be640 1 -- 172.21.15.98:0/1310835315 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46c414edf0 con 0x7f46c40ce780 2024-09-16T15:38:20.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.278+0000 7f46cc6be640 1 -- 172.21.15.98:0/1310835315 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46c40c6d80 con 0x7f46c40ce780 2024-09-16T15:38:20.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.279+0000 7f46cc6be640 1 -- 172.21.15.98:0/1310835315 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46c40b22c0 con 0x7f46c40ce780 2024-09-16T15:38:20.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.279+0000 7f46c2ffd640 1 -- 172.21.15.98:0/1310835315 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7f46b80047a0 con 0x7f46c40ce780 2024-09-16T15:38:20.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.280+0000 7f46c2ffd640 1 --2- 172.21.15.98:0/1310835315 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f46b0078880 0x7f46b007ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:20.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.280+0000 7f46c2ffd640 1 -- 172.21.15.98:0/1310835315 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f46b80bb770 con 0x7f46c40ce780 2024-09-16T15:38:20.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.280+0000 7f46ca45a640 1 --2- 172.21.15.98:0/1310835315 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f46b0078880 0x7f46b007ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:20.283 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.281+0000 7f46ca45a640 1 --2- 172.21.15.98:0/1310835315 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f46b0078880 0x7f46b007ad40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f46c40c8f30 tx=0x7f46bc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:20.285 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.285+0000 7f46c2ffd640 1 -- 172.21.15.98:0/1310835315 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7f46b803f030 con 0x7f46c40ce780 2024-09-16T15:38:20.527 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.527+0000 7f46cc6be640 1 -- 172.21.15.98:0/1310835315 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f46c40b0160 con 0x7f46c40ce780 2024-09-16T15:38:20.529 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.529+0000 7f46c2ffd640 1 -- 172.21.15.98:0/1310835315 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v13) ==== 90+0+0 (secure 0 0 0) 0x7f46b8084130 con 0x7f46c40ce780 2024-09-16T15:38:20.532 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.531+0000 7f46cc6be640 1 -- 172.21.15.98:0/1310835315 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f46b0078880 msgr2=0x7f46b007ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:20.532 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.531+0000 7f46cc6be640 1 --2- 172.21.15.98:0/1310835315 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f46b0078880 0x7f46b007ad40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f46c40c8f30 tx=0x7f46bc009040 comp rx=0 tx=0).stop 2024-09-16T15:38:20.532 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.531+0000 7f46cc6be640 1 -- 172.21.15.98:0/1310835315 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46c40ce780 msgr2=0x7f46c40afad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:20.532 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.531+0000 7f46cc6be640 1 --2- 172.21.15.98:0/1310835315 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46c40ce780 0x7f46c40afad0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f46b8009780 tx=0x7f46b8033d60 comp rx=0 tx=0).stop 2024-09-16T15:38:20.532 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.531+0000 7f46cc6be640 1 -- 172.21.15.98:0/1310835315 shutdown_connections 2024-09-16T15:38:20.532 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.531+0000 7f46cc6be640 1 --2- 172.21.15.98:0/1310835315 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f46b0078880 0x7f46b007ad40 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:20.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.531+0000 7f46cc6be640 1 --2- 172.21.15.98:0/1310835315 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46c40d29d0 0x7f46c414daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:20.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.531+0000 7f46cc6be640 1 --2- 172.21.15.98:0/1310835315 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f46c40ce780 0x7f46c40afad0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:20.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.531+0000 7f46cc6be640 1 --2- 172.21.15.98:0/1310835315 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f46c40b1e60 0x7f46c40af590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:20.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.531+0000 7f46cc6be640 1 -- 172.21.15.98:0/1310835315 >> 172.21.15.98:0/1310835315 conn(0x7f46c40d1eb0 msgr2=0x7f46c40b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:20.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.531+0000 7f46cc6be640 1 -- 172.21.15.98:0/1310835315 shutdown_connections 2024-09-16T15:38:20.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.531+0000 7f46cc6be640 1 -- 172.21.15.98:0/1310835315 wait complete. 2024-09-16T15:38:20.542 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-09-16T15:38:20.644 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.643+0000 7fa3a6d00640 1 -- 172.21.15.98:0/3870685930 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3a0074150 msgr2=0x7fa3a006e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:20.644 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.643+0000 7fa3a6d00640 1 --2- 172.21.15.98:0/3870685930 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3a0074150 0x7fa3a006e760 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa38c009830 tx=0x7fa38c02a3f0 comp rx=0 tx=0).stop 2024-09-16T15:38:20.644 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.643+0000 7fa3a6d00640 1 -- 172.21.15.98:0/3870685930 shutdown_connections 2024-09-16T15:38:20.644 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.643+0000 7fa3a6d00640 1 --2- 172.21.15.98:0/3870685930 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3a0074150 0x7fa3a006e760 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:20.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.643+0000 7fa3a6d00640 1 --2- 172.21.15.98:0/3870685930 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3a00b43f0 0x7fa3a00b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:20.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.643+0000 7fa3a6d00640 1 -- 172.21.15.98:0/3870685930 >> 172.21.15.98:0/3870685930 conn(0x7fa3a00b1950 msgr2=0x7fa3a00b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:20.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.643+0000 7fa3a6d00640 1 -- 172.21.15.98:0/3870685930 shutdown_connections 2024-09-16T15:38:20.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.643+0000 7fa3a6d00640 1 -- 172.21.15.98:0/3870685930 wait complete. 2024-09-16T15:38:20.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.644+0000 7fa3a6d00640 1 Processor -- start 2024-09-16T15:38:20.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.644+0000 7fa3a6d00640 1 -- start start 2024-09-16T15:38:20.647 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.645+0000 7fa3a6d00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3a0074150 0x7fa3a0147890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:20.648 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.645+0000 7fa3a6d00640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3a00746a0 0x7fa3a0148d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:20.648 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.645+0000 7fa3a6d00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3a00b43f0 0x7fa3a0151840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:20.648 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.645+0000 7fa3a6d00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa3a006f3b0 con 0x7fa3a00b43f0 2024-09-16T15:38:20.648 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.645+0000 7fa3a6d00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa3a00704c0 con 0x7fa3a0074150 2024-09-16T15:38:20.648 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.645+0000 7fa3a6d00640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fa3a006f530 con 0x7fa3a00746a0 2024-09-16T15:38:20.648 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.645+0000 7fa3a529d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3a00b43f0 0x7fa3a0151840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:20.648 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.646+0000 7fa3a529d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3a00b43f0 0x7fa3a0151840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46108/0 (socket says 172.21.15.98:46108) 2024-09-16T15:38:20.648 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.646+0000 7fa3a529d640 1 -- 172.21.15.98:0/4169926377 learned_addr learned my addr 172.21.15.98:0/4169926377 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:20.648 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.646+0000 7fa39ffff640 1 --2- 172.21.15.98:0/4169926377 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3a00746a0 0x7fa3a0148d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:20.648 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.646+0000 7fa3a4a9c640 1 --2- 172.21.15.98:0/4169926377 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3a0074150 0x7fa3a0147890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:20.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.646+0000 7fa3a529d640 1 -- 172.21.15.98:0/4169926377 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3a00746a0 msgr2=0x7fa3a0148d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:20.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.646+0000 7fa3a529d640 1 --2- 172.21.15.98:0/4169926377 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3a00746a0 0x7fa3a0148d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:20.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.646+0000 7fa3a529d640 1 -- 172.21.15.98:0/4169926377 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3a0074150 msgr2=0x7fa3a0147890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:20.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.646+0000 7fa3a529d640 1 --2- 172.21.15.98:0/4169926377 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3a0074150 0x7fa3a0147890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:20.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.646+0000 7fa3a529d640 1 -- 172.21.15.98:0/4169926377 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3a0151d80 con 0x7fa3a00b43f0 2024-09-16T15:38:20.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.646+0000 7fa3a529d640 1 --2- 172.21.15.98:0/4169926377 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3a00b43f0 0x7fa3a0151840 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa39800cbf0 tx=0x7fa39800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:20.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.646+0000 7fa39d7fa640 1 -- 172.21.15.98:0/4169926377 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa398016020 con 0x7fa3a00b43f0 2024-09-16T15:38:20.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.646+0000 7fa39d7fa640 1 -- 172.21.15.98:0/4169926377 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa39800ad50 con 0x7fa3a00b43f0 2024-09-16T15:38:20.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.646+0000 7fa3a6d00640 1 -- 172.21.15.98:0/4169926377 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3a0147fa0 con 0x7fa3a00b43f0 2024-09-16T15:38:20.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.646+0000 7fa39d7fa640 1 -- 172.21.15.98:0/4169926377 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa398012680 con 0x7fa3a00b43f0 2024-09-16T15:38:20.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.646+0000 7fa3a6d00640 1 -- 172.21.15.98:0/4169926377 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3a0148560 con 0x7fa3a00b43f0 2024-09-16T15:38:20.650 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.647+0000 7fa3a6d00640 1 -- 172.21.15.98:0/4169926377 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3a00b47d0 con 0x7fa3a00b43f0 2024-09-16T15:38:20.650 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.648+0000 7fa39d7fa640 1 -- 172.21.15.98:0/4169926377 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7fa398019020 con 0x7fa3a00b43f0 2024-09-16T15:38:20.650 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.648+0000 7fa39d7fa640 1 --2- 172.21.15.98:0/4169926377 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fa384078850 0x7fa38407ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:20.650 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.648+0000 7fa39d7fa640 1 -- 172.21.15.98:0/4169926377 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7fa39809a730 con 0x7fa3a00b43f0 2024-09-16T15:38:20.650 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.648+0000 7fa3a4a9c640 1 --2- 172.21.15.98:0/4169926377 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fa384078850 0x7fa38407ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:20.650 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.649+0000 7fa3a4a9c640 1 --2- 172.21.15.98:0/4169926377 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fa384078850 0x7fa38407ad10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa3a0167170 tx=0x7fa39400b390 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:20.653 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.653+0000 7fa39d7fa640 1 -- 172.21.15.98:0/4169926377 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7fa398020030 con 0x7fa3a00b43f0 2024-09-16T15:38:20.902 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.901+0000 7fa3a6d00640 1 -- 172.21.15.98:0/4169926377 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7fa3a00cc330 con 0x7fa3a00b43f0 2024-09-16T15:38:20.906 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.905+0000 7fa39d7fa640 1 -- 172.21.15.98:0/4169926377 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v14) ==== 90+0+0 (secure 0 0 0) 0x7fa3a00cf9d0 con 0x7fa3a00b43f0 2024-09-16T15:38:20.909 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.908+0000 7fa3a6d00640 1 -- 172.21.15.98:0/4169926377 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fa384078850 msgr2=0x7fa38407ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:20.909 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.908+0000 7fa3a6d00640 1 --2- 172.21.15.98:0/4169926377 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fa384078850 0x7fa38407ad10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa3a0167170 tx=0x7fa39400b390 comp rx=0 tx=0).stop 2024-09-16T15:38:20.909 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.908+0000 7fa3a6d00640 1 -- 172.21.15.98:0/4169926377 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3a00b43f0 msgr2=0x7fa3a0151840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:20.909 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.908+0000 7fa3a6d00640 1 --2- 172.21.15.98:0/4169926377 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3a00b43f0 0x7fa3a0151840 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa39800cbf0 tx=0x7fa39800a430 comp rx=0 tx=0).stop 2024-09-16T15:38:20.909 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.908+0000 7fa3a6d00640 1 -- 172.21.15.98:0/4169926377 shutdown_connections 2024-09-16T15:38:20.909 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.908+0000 7fa3a6d00640 1 --2- 172.21.15.98:0/4169926377 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3a00b43f0 0x7fa3a0151840 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:20.909 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.908+0000 7fa3a6d00640 1 --2- 172.21.15.98:0/4169926377 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fa3a00746a0 0x7fa3a0148d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:20.909 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.908+0000 7fa3a6d00640 1 --2- 172.21.15.98:0/4169926377 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fa384078850 0x7fa38407ad10 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:20.910 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.908+0000 7fa3a6d00640 1 --2- 172.21.15.98:0/4169926377 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3a0074150 0x7fa3a0147890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:20.910 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.908+0000 7fa3a6d00640 1 -- 172.21.15.98:0/4169926377 >> 172.21.15.98:0/4169926377 conn(0x7fa3a00b1950 msgr2=0x7fa3a00cef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:20.910 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.908+0000 7fa3a6d00640 1 -- 172.21.15.98:0/4169926377 shutdown_connections 2024-09-16T15:38:20.910 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:20.908+0000 7fa3a6d00640 1 -- 172.21.15.98:0/4169926377 wait complete. 2024-09-16T15:38:20.919 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-09-16T15:38:21.023 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.022+0000 7f8b2a6b0640 1 -- 172.21.15.98:0/4165157348 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b0c004d40 msgr2=0x7f8b0c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:21.023 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.022+0000 7f8b2a6b0640 1 --2- 172.21.15.98:0/4165157348 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b0c004d40 0x7f8b0c0051c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8b240d1a40 tx=0x7f8b0c005830 comp rx=0 tx=0).stop 2024-09-16T15:38:21.023 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.022+0000 7f8b28c4d640 1 -- 172.21.15.98:0/4165157348 reap_dead start 2024-09-16T15:38:21.023 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.022+0000 7f8b2a6b0640 1 -- 172.21.15.98:0/4165157348 shutdown_connections 2024-09-16T15:38:21.023 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.022+0000 7f8b2a6b0640 1 -- 172.21.15.98:0/4165157348 >> 172.21.15.98:0/4165157348 conn(0x7f8b240d3fe0 msgr2=0x7f8b240d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:21.024 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.022+0000 7f8b2a6b0640 1 -- 172.21.15.98:0/4165157348 shutdown_connections 2024-09-16T15:38:21.024 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.022+0000 7f8b2a6b0640 1 -- 172.21.15.98:0/4165157348 wait complete. 2024-09-16T15:38:21.024 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.023+0000 7f8b2a6b0640 1 Processor -- start 2024-09-16T15:38:21.024 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.023+0000 7f8b2a6b0640 1 -- start start 2024-09-16T15:38:21.026 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.024+0000 7f8b2a6b0640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8b0c004d40 0x7f8b240a1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:21.026 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.024+0000 7f8b2a6b0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b24153bd0 0x7f8b241500a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:21.026 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.024+0000 7f8b2a6b0640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b241505e0 0x7f8b24150a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:21.026 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.024+0000 7f8b2a6b0640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8b240d0d50 con 0x7f8b241505e0 2024-09-16T15:38:21.026 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.024+0000 7f8b2a6b0640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8b240d0bd0 con 0x7f8b24153bd0 2024-09-16T15:38:21.026 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.024+0000 7f8b2a6b0640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f8b240cf200 con 0x7f8b0c004d40 2024-09-16T15:38:21.026 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.024+0000 7f8b28c4d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b241505e0 0x7f8b24150a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:21.027 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.024+0000 7f8b28c4d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b241505e0 0x7f8b24150a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46130/0 (socket says 172.21.15.98:46130) 2024-09-16T15:38:21.027 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.024+0000 7f8b28c4d640 1 -- 172.21.15.98:0/1801448838 learned_addr learned my addr 172.21.15.98:0/1801448838 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:21.027 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.024+0000 7f8b23fff640 1 --2- 172.21.15.98:0/1801448838 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8b0c004d40 0x7f8b240a1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:21.027 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.024+0000 7f8b237fe640 1 --2- 172.21.15.98:0/1801448838 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b24153bd0 0x7f8b241500a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:21.027 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.024+0000 7f8b28c4d640 1 -- 172.21.15.98:0/1801448838 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8b0c004d40 msgr2=0x7f8b240a1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:21.027 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.024+0000 7f8b28c4d640 1 --2- 172.21.15.98:0/1801448838 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8b0c004d40 0x7f8b240a1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:21.027 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.024+0000 7f8b28c4d640 1 -- 172.21.15.98:0/1801448838 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b24153bd0 msgr2=0x7f8b241500a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:21.027 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.024+0000 7f8b28c4d640 1 --2- 172.21.15.98:0/1801448838 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b24153bd0 0x7f8b241500a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:21.027 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.024+0000 7f8b28c4d640 1 -- 172.21.15.98:0/1801448838 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b240b4f70 con 0x7f8b241505e0 2024-09-16T15:38:21.027 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.024+0000 7f8b237fe640 1 --2- 172.21.15.98:0/1801448838 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b24153bd0 0x7f8b241500a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T15:38:21.027 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.025+0000 7f8b28c4d640 1 --2- 172.21.15.98:0/1801448838 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b241505e0 0x7f8b24150a40 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c002230 tx=0x7f8b1c034680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:21.027 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.025+0000 7f8b20ff9640 1 -- 172.21.15.98:0/1801448838 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c038040 con 0x7f8b241505e0 2024-09-16T15:38:21.027 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.025+0000 7f8b20ff9640 1 -- 172.21.15.98:0/1801448838 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8b1c02b630 con 0x7f8b241505e0 2024-09-16T15:38:21.027 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.025+0000 7f8b20ff9640 1 -- 172.21.15.98:0/1801448838 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c004d60 con 0x7f8b241505e0 2024-09-16T15:38:21.028 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.025+0000 7f8b2a6b0640 1 -- 172.21.15.98:0/1801448838 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b240b5250 con 0x7f8b241505e0 2024-09-16T15:38:21.028 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.025+0000 7f8b2a6b0640 1 -- 172.21.15.98:0/1801448838 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b240b5810 con 0x7f8b241505e0 2024-09-16T15:38:21.028 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.026+0000 7f8b2a6b0640 1 -- 172.21.15.98:0/1801448838 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b240d0680 con 0x7f8b241505e0 2024-09-16T15:38:21.029 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.026+0000 7f8b20ff9640 1 -- 172.21.15.98:0/1801448838 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7f8b1c044030 con 0x7f8b241505e0 2024-09-16T15:38:21.029 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.027+0000 7f8b20ff9640 1 --2- 172.21.15.98:0/1801448838 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f8b10078850 0x7f8b1007ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:21.029 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.027+0000 7f8b20ff9640 1 -- 172.21.15.98:0/1801448838 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f8b1c0ba180 con 0x7f8b241505e0 2024-09-16T15:38:21.029 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.027+0000 7f8b23fff640 1 --2- 172.21.15.98:0/1801448838 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f8b10078850 0x7f8b1007ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:21.029 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.028+0000 7f8b23fff640 1 --2- 172.21.15.98:0/1801448838 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f8b10078850 0x7f8b1007ad10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8b14003700 tx=0x7f8b1400b260 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:21.032 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.031+0000 7f8b20ff9640 1 -- 172.21.15.98:0/1801448838 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7f8b240d0680 con 0x7f8b241505e0 2024-09-16T15:38:21.277 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.276+0000 7f8b2a6b0640 1 -- 172.21.15.98:0/1801448838 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7f8b240b9790 con 0x7f8b241505e0 2024-09-16T15:38:21.279 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.278+0000 7f8b20ff9640 1 -- 172.21.15.98:0/1801448838 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v15) ==== 97+0+0 (secure 0 0 0) 0x7f8b240b9790 con 0x7f8b241505e0 2024-09-16T15:38:21.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.281+0000 7f8b2a6b0640 1 -- 172.21.15.98:0/1801448838 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f8b10078850 msgr2=0x7f8b1007ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:21.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.281+0000 7f8b2a6b0640 1 --2- 172.21.15.98:0/1801448838 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f8b10078850 0x7f8b1007ad10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8b14003700 tx=0x7f8b1400b260 comp rx=0 tx=0).stop 2024-09-16T15:38:21.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.281+0000 7f8b2a6b0640 1 -- 172.21.15.98:0/1801448838 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b241505e0 msgr2=0x7f8b24150a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:21.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.281+0000 7f8b2a6b0640 1 --2- 172.21.15.98:0/1801448838 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b241505e0 0x7f8b24150a40 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c002230 tx=0x7f8b1c034680 comp rx=0 tx=0).stop 2024-09-16T15:38:21.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.281+0000 7f8b2a6b0640 1 -- 172.21.15.98:0/1801448838 shutdown_connections 2024-09-16T15:38:21.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.281+0000 7f8b2a6b0640 1 --2- 172.21.15.98:0/1801448838 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b241505e0 0x7f8b24150a40 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:21.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.281+0000 7f8b2a6b0640 1 --2- 172.21.15.98:0/1801448838 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f8b10078850 0x7f8b1007ad10 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:21.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.281+0000 7f8b2a6b0640 1 --2- 172.21.15.98:0/1801448838 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b24153bd0 0x7f8b241500a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:21.283 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.281+0000 7f8b2a6b0640 1 --2- 172.21.15.98:0/1801448838 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8b0c004d40 0x7f8b240a1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:21.283 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.281+0000 7f8b2a6b0640 1 -- 172.21.15.98:0/1801448838 >> 172.21.15.98:0/1801448838 conn(0x7f8b240d3fe0 msgr2=0x7f8b2406e3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:21.283 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.281+0000 7f8b2a6b0640 1 -- 172.21.15.98:0/1801448838 shutdown_connections 2024-09-16T15:38:21.283 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.281+0000 7f8b2a6b0640 1 -- 172.21.15.98:0/1801448838 wait complete. 2024-09-16T15:38:21.293 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-09-16T15:38:21.396 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.395+0000 7f3934657640 1 -- 172.21.15.98:0/592698121 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3918004e60 msgr2=0x7f391800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:21.397 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.395+0000 7f3934657640 1 --2- 172.21.15.98:0/592698121 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3918004e60 0x7f391800b9c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f392c0d1a40 tx=0x7f3918005830 comp rx=0 tx=0).stop 2024-09-16T15:38:21.397 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.395+0000 7f3932bf4640 1 -- 172.21.15.98:0/592698121 reap_dead start 2024-09-16T15:38:21.397 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.395+0000 7f3934657640 1 -- 172.21.15.98:0/592698121 shutdown_connections 2024-09-16T15:38:21.397 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.395+0000 7f3934657640 1 -- 172.21.15.98:0/592698121 >> 172.21.15.98:0/592698121 conn(0x7f392c0d3fe0 msgr2=0x7f392c0d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:21.397 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.395+0000 7f3934657640 1 -- 172.21.15.98:0/592698121 shutdown_connections 2024-09-16T15:38:21.397 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.395+0000 7f3934657640 1 -- 172.21.15.98:0/592698121 wait complete. 2024-09-16T15:38:21.399 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.396+0000 7f3934657640 1 Processor -- start 2024-09-16T15:38:21.399 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.396+0000 7f3934657640 1 -- start start 2024-09-16T15:38:21.399 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.397+0000 7f3934657640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3918004e60 0x7f392c0a0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:21.400 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.397+0000 7f3934657640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f392c0cce90 0x7f392c15d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:21.400 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.397+0000 7f3934657640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f392c1f87a0 0x7f392c0c9170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:21.400 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.397+0000 7f3934657640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f392c0cf3d0 con 0x7f3918004e60 2024-09-16T15:38:21.400 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.397+0000 7f3934657640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f392c0d13c0 con 0x7f392c1f87a0 2024-09-16T15:38:21.400 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.397+0000 7f3934657640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f392c0cf550 con 0x7f392c0cce90 2024-09-16T15:38:21.400 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.397+0000 7f39323f3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3918004e60 0x7f392c0a0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:21.400 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.397+0000 7f39323f3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3918004e60 0x7f392c0a0fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46152/0 (socket says 172.21.15.98:46152) 2024-09-16T15:38:21.400 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.397+0000 7f39323f3640 1 -- 172.21.15.98:0/747217313 learned_addr learned my addr 172.21.15.98:0/747217313 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:21.400 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.397+0000 7f3931bf2640 1 --2- 172.21.15.98:0/747217313 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f392c0cce90 0x7f392c15d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:21.400 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.397+0000 7f3932bf4640 1 --2- 172.21.15.98:0/747217313 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f392c1f87a0 0x7f392c0c9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:21.400 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.397+0000 7f39323f3640 1 -- 172.21.15.98:0/747217313 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f392c0cce90 msgr2=0x7f392c15d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:21.400 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.397+0000 7f39323f3640 1 --2- 172.21.15.98:0/747217313 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f392c0cce90 0x7f392c15d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:21.401 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.397+0000 7f39323f3640 1 -- 172.21.15.98:0/747217313 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f392c1f87a0 msgr2=0x7f392c0c9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:21.401 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.397+0000 7f39323f3640 1 --2- 172.21.15.98:0/747217313 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f392c1f87a0 0x7f392c0c9170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:21.401 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.397+0000 7f39323f3640 1 -- 172.21.15.98:0/747217313 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f392c1f8010 con 0x7f3918004e60 2024-09-16T15:38:21.401 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.397+0000 7f39323f3640 1 --2- 172.21.15.98:0/747217313 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3918004e60 0x7f392c0a0fc0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3928003e90 tx=0x7f3928001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:21.401 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.398+0000 7f391effd640 1 -- 172.21.15.98:0/747217313 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3928015070 con 0x7f3918004e60 2024-09-16T15:38:21.401 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.398+0000 7f391effd640 1 -- 172.21.15.98:0/747217313 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3928011840 con 0x7f3918004e60 2024-09-16T15:38:21.401 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.398+0000 7f391effd640 1 -- 172.21.15.98:0/747217313 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3928011c70 con 0x7f3918004e60 2024-09-16T15:38:21.401 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.398+0000 7f3934657640 1 -- 172.21.15.98:0/747217313 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f392c0a1610 con 0x7f3918004e60 2024-09-16T15:38:21.401 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.398+0000 7f3934657640 1 -- 172.21.15.98:0/747217313 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f392c1f8280 con 0x7f3918004e60 2024-09-16T15:38:21.401 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.399+0000 7f3934657640 1 -- 172.21.15.98:0/747217313 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f392c0cfab0 con 0x7f3918004e60 2024-09-16T15:38:21.402 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.399+0000 7f391effd640 1 -- 172.21.15.98:0/747217313 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7f3928018070 con 0x7f3918004e60 2024-09-16T15:38:21.402 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.400+0000 7f391effd640 1 --2- 172.21.15.98:0/747217313 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f3910078850 0x7f391007ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:21.402 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.400+0000 7f391effd640 1 -- 172.21.15.98:0/747217313 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f392809afe0 con 0x7f3918004e60 2024-09-16T15:38:21.402 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.400+0000 7f3931bf2640 1 --2- 172.21.15.98:0/747217313 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f3910078850 0x7f391007ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:21.402 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.400+0000 7f3931bf2640 1 --2- 172.21.15.98:0/747217313 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f3910078850 0x7f391007ad10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f392c0cd830 tx=0x7f392000b260 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:21.405 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.404+0000 7f391effd640 1 -- 172.21.15.98:0/747217313 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7f39280633e0 con 0x7f3918004e60 2024-09-16T15:38:21.651 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.650+0000 7f3934657640 1 -- 172.21.15.98:0/747217313 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7f392c0b66c0 con 0x7f3918004e60 2024-09-16T15:38:21.654 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.653+0000 7f391effd640 1 -- 172.21.15.98:0/747217313 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v16) ==== 90+0+0 (secure 0 0 0) 0x7f3928067e10 con 0x7f3918004e60 2024-09-16T15:38:21.656 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.655+0000 7f3934657640 1 -- 172.21.15.98:0/747217313 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f3910078850 msgr2=0x7f391007ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:21.656 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.655+0000 7f3934657640 1 --2- 172.21.15.98:0/747217313 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f3910078850 0x7f391007ad10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f392c0cd830 tx=0x7f392000b260 comp rx=0 tx=0).stop 2024-09-16T15:38:21.657 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.655+0000 7f3934657640 1 -- 172.21.15.98:0/747217313 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3918004e60 msgr2=0x7f392c0a0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:21.657 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.655+0000 7f3934657640 1 --2- 172.21.15.98:0/747217313 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3918004e60 0x7f392c0a0fc0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3928003e90 tx=0x7f3928001630 comp rx=0 tx=0).stop 2024-09-16T15:38:21.657 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.655+0000 7f3934657640 1 -- 172.21.15.98:0/747217313 shutdown_connections 2024-09-16T15:38:21.657 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.655+0000 7f3934657640 1 --2- 172.21.15.98:0/747217313 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f3910078850 0x7f391007ad10 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:21.657 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.655+0000 7f3934657640 1 --2- 172.21.15.98:0/747217313 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f392c1f87a0 0x7f392c0c9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:21.657 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.655+0000 7f3934657640 1 --2- 172.21.15.98:0/747217313 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f392c0cce90 0x7f392c15d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:21.657 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.655+0000 7f3934657640 1 --2- 172.21.15.98:0/747217313 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3918004e60 0x7f392c0a0fc0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:21.657 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.655+0000 7f3934657640 1 -- 172.21.15.98:0/747217313 >> 172.21.15.98:0/747217313 conn(0x7f392c0d3fe0 msgr2=0x7f392c06e3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:21.657 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.655+0000 7f3934657640 1 -- 172.21.15.98:0/747217313 shutdown_connections 2024-09-16T15:38:21.657 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.655+0000 7f3934657640 1 -- 172.21.15.98:0/747217313 wait complete. 2024-09-16T15:38:21.667 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-16T15:38:21.769 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.768+0000 7fe5d0f05640 1 -- 172.21.15.98:0/4140230475 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe5cc15e0d0 msgr2=0x7fe5cc0d09c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:21.769 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.768+0000 7fe5d0f05640 1 --2- 172.21.15.98:0/4140230475 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe5cc15e0d0 0x7fe5cc0d09c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe5b4009830 tx=0x7fe5b402a510 comp rx=0 tx=0).stop 2024-09-16T15:38:21.769 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.768+0000 7fe5d0f05640 1 -- 172.21.15.98:0/4140230475 shutdown_connections 2024-09-16T15:38:21.769 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.768+0000 7fe5d0f05640 1 --2- 172.21.15.98:0/4140230475 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe5cc0d1610 0x7fe5cc0cecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:21.769 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.768+0000 7fe5d0f05640 1 --2- 172.21.15.98:0/4140230475 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe5cc15e0d0 0x7fe5cc0d09c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:21.769 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.768+0000 7fe5d0f05640 1 -- 172.21.15.98:0/4140230475 >> 172.21.15.98:0/4140230475 conn(0x7fe5cc0d3fe0 msgr2=0x7fe5cc0d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:21.769 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.768+0000 7fe5d0f05640 1 -- 172.21.15.98:0/4140230475 shutdown_connections 2024-09-16T15:38:21.769 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.768+0000 7fe5d0f05640 1 -- 172.21.15.98:0/4140230475 wait complete. 2024-09-16T15:38:21.770 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.769+0000 7fe5d0f05640 1 Processor -- start 2024-09-16T15:38:21.770 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.769+0000 7fe5d0f05640 1 -- start start 2024-09-16T15:38:21.772 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.770+0000 7fe5d0f05640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe5cc0d1610 0x7fe5cc15a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:21.772 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.770+0000 7fe5d0f05640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe5cc0d2050 0x7fe5cc0b80e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:21.772 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.770+0000 7fe5d0f05640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5cc15e0d0 0x7fe5cc0b8620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:21.772 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.770+0000 7fe5d0f05640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe5cc0cf5d0 con 0x7fe5cc15e0d0 2024-09-16T15:38:21.772 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.770+0000 7fe5d0f05640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe5cc0cf450 con 0x7fe5cc0d2050 2024-09-16T15:38:21.772 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.770+0000 7fe5d0f05640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fe5cc0cf750 con 0x7fe5cc0d1610 2024-09-16T15:38:21.772 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.770+0000 7fe5cad9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5cc15e0d0 0x7fe5cc0b8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:21.772 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.770+0000 7fe5cad9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5cc15e0d0 0x7fe5cc0b8620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46156/0 (socket says 172.21.15.98:46156) 2024-09-16T15:38:21.772 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.770+0000 7fe5cad9d640 1 -- 172.21.15.98:0/1578042294 learned_addr learned my addr 172.21.15.98:0/1578042294 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:21.772 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.770+0000 7fe5c9d9b640 1 --2- 172.21.15.98:0/1578042294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe5cc0d2050 0x7fe5cc0b80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:21.773 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.770+0000 7fe5ca59c640 1 --2- 172.21.15.98:0/1578042294 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe5cc0d1610 0x7fe5cc15a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:21.773 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.770+0000 7fe5cad9d640 1 -- 172.21.15.98:0/1578042294 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe5cc0d1610 msgr2=0x7fe5cc15a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:21.773 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.770+0000 7fe5cad9d640 1 --2- 172.21.15.98:0/1578042294 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe5cc0d1610 0x7fe5cc15a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:21.773 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.770+0000 7fe5cad9d640 1 -- 172.21.15.98:0/1578042294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe5cc0d2050 msgr2=0x7fe5cc0b80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:21.773 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.770+0000 7fe5cad9d640 1 --2- 172.21.15.98:0/1578042294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe5cc0d2050 0x7fe5cc0b80e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:21.773 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.770+0000 7fe5cad9d640 1 -- 172.21.15.98:0/1578042294 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5cc1f5550 con 0x7fe5cc15e0d0 2024-09-16T15:38:21.773 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.770+0000 7fe5cad9d640 1 --2- 172.21.15.98:0/1578042294 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5cc15e0d0 0x7fe5cc0b8620 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe5c4009c90 tx=0x7fe5c400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:21.773 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.771+0000 7fe5c2ffd640 1 -- 172.21.15.98:0/1578042294 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c4003b70 con 0x7fe5cc15e0d0 2024-09-16T15:38:21.773 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.771+0000 7fe5c2ffd640 1 -- 172.21.15.98:0/1578042294 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe5c4003d10 con 0x7fe5cc15e0d0 2024-09-16T15:38:21.773 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.771+0000 7fe5d0f05640 1 -- 172.21.15.98:0/1578042294 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5cc09e8b0 con 0x7fe5cc15e0d0 2024-09-16T15:38:21.773 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.771+0000 7fe5c2ffd640 1 -- 172.21.15.98:0/1578042294 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c4004280 con 0x7fe5cc15e0d0 2024-09-16T15:38:21.773 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.771+0000 7fe5d0f05640 1 -- 172.21.15.98:0/1578042294 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5cc09f150 con 0x7fe5cc15e0d0 2024-09-16T15:38:21.774 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.772+0000 7fe5d0f05640 1 -- 172.21.15.98:0/1578042294 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5cc0cfc70 con 0x7fe5cc15e0d0 2024-09-16T15:38:21.774 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.772+0000 7fe5c2ffd640 1 -- 172.21.15.98:0/1578042294 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7fe5c4004420 con 0x7fe5cc15e0d0 2024-09-16T15:38:21.775 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.773+0000 7fe5c2ffd640 1 --2- 172.21.15.98:0/1578042294 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fe5ac078850 0x7fe5ac07ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:21.775 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.773+0000 7fe5c2ffd640 1 -- 172.21.15.98:0/1578042294 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7fe5c409b280 con 0x7fe5cc15e0d0 2024-09-16T15:38:21.775 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.773+0000 7fe5ca59c640 1 --2- 172.21.15.98:0/1578042294 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fe5ac078850 0x7fe5ac07ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:21.775 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.773+0000 7fe5ca59c640 1 --2- 172.21.15.98:0/1578042294 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fe5ac078850 0x7fe5ac07ad10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe5b4034000 tx=0x7fe5b4004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:21.778 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.777+0000 7fe5c2ffd640 1 -- 172.21.15.98:0/1578042294 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7fe5c4063cd0 con 0x7fe5cc15e0d0 2024-09-16T15:38:21.955 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.954+0000 7fe5d0f05640 1 -- 172.21.15.98:0/1578042294 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fe5cc09ea80 con 0x7fe5cc15e0d0 2024-09-16T15:38:21.955 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.954+0000 7fe5c2ffd640 1 -- 172.21.15.98:0/1578042294 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v30) ==== 84+0+65 (secure 0 0 0) 0x7fe5c40635d0 con 0x7fe5cc15e0d0 2024-09-16T15:38:21.956 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:38:21.956 INFO:teuthology.orchestra.run.smithi098.stdout:[ 2024-09-16T15:38:21.956 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:21.956 INFO:teuthology.orchestra.run.smithi098.stdout: "poolnum": 1, 2024-09-16T15:38:21.956 INFO:teuthology.orchestra.run.smithi098.stdout: "poolname": ".mgr" 2024-09-16T15:38:21.956 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:21.956 INFO:teuthology.orchestra.run.smithi098.stdout:] 2024-09-16T15:38:21.958 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.956+0000 7fe5d0f05640 1 -- 172.21.15.98:0/1578042294 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fe5ac078850 msgr2=0x7fe5ac07ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:21.958 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.956+0000 7fe5d0f05640 1 --2- 172.21.15.98:0/1578042294 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fe5ac078850 0x7fe5ac07ad10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe5b4034000 tx=0x7fe5b4004730 comp rx=0 tx=0).stop 2024-09-16T15:38:21.958 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.956+0000 7fe5d0f05640 1 -- 172.21.15.98:0/1578042294 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5cc15e0d0 msgr2=0x7fe5cc0b8620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:21.958 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.956+0000 7fe5d0f05640 1 --2- 172.21.15.98:0/1578042294 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5cc15e0d0 0x7fe5cc0b8620 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe5c4009c90 tx=0x7fe5c400c6a0 comp rx=0 tx=0).stop 2024-09-16T15:38:21.958 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.956+0000 7fe5d0f05640 1 -- 172.21.15.98:0/1578042294 shutdown_connections 2024-09-16T15:38:21.958 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.956+0000 7fe5d0f05640 1 --2- 172.21.15.98:0/1578042294 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5cc15e0d0 0x7fe5cc0b8620 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:21.958 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.956+0000 7fe5d0f05640 1 --2- 172.21.15.98:0/1578042294 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fe5ac078850 0x7fe5ac07ad10 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:21.958 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.956+0000 7fe5d0f05640 1 --2- 172.21.15.98:0/1578042294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe5cc0d2050 0x7fe5cc0b80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:21.958 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.956+0000 7fe5d0f05640 1 --2- 172.21.15.98:0/1578042294 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe5cc0d1610 0x7fe5cc15a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:21.958 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.956+0000 7fe5d0f05640 1 -- 172.21.15.98:0/1578042294 >> 172.21.15.98:0/1578042294 conn(0x7fe5cc0d3fe0 msgr2=0x7fe5cc0d09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:21.958 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.957+0000 7fe5d0f05640 1 -- 172.21.15.98:0/1578042294 shutdown_connections 2024-09-16T15:38:21.958 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:21.957+0000 7fe5d0f05640 1 -- 172.21.15.98:0/1578042294 wait complete. 2024-09-16T15:38:21.968 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-16T15:38:21.969 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-16T15:38:22.074 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:22.073+0000 7f4352975640 1 -- 172.21.15.98:0/3008239633 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f434c073790 msgr2=0x7f434c073b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:22.075 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:22.073+0000 7f4352975640 1 --2- 172.21.15.98:0/3008239633 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f434c073790 0x7f434c073b70 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f434c0af080 tx=0x7f433c02a560 comp rx=0 tx=0).stop 2024-09-16T15:38:22.075 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:22.073+0000 7f4352975640 1 -- 172.21.15.98:0/3008239633 shutdown_connections 2024-09-16T15:38:22.075 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:22.073+0000 7f4352975640 1 --2- 172.21.15.98:0/3008239633 >> v2:172.21.15.135:3300/0 conn(0x7f434c0add40 0x7f434c0ae170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:22.075 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:22.073+0000 7f4352975640 1 --2- 172.21.15.98:0/3008239633 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f434c0af2c0 0x7f434c0af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:22.075 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:22.073+0000 7f4352975640 1 --2- 172.21.15.98:0/3008239633 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f434c073790 0x7f434c073b70 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:22.075 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:22.073+0000 7f4352975640 1 -- 172.21.15.98:0/3008239633 >> 172.21.15.98:0/3008239633 conn(0x7f434c0b2960 msgr2=0x7f434c0b2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:22.075 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:22.073+0000 7f4352975640 1 -- 172.21.15.98:0/3008239633 shutdown_connections 2024-09-16T15:38:22.075 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:22.073+0000 7f4352975640 1 -- 172.21.15.98:0/3008239633 wait complete. 2024-09-16T15:38:22.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:22.074+0000 7f4352975640 1 Processor -- start 2024-09-16T15:38:22.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:22.075+0000 7f4352975640 1 -- start start 2024-09-16T15:38:22.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:22.075+0000 7f4352975640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f434c073790 0x7f434c14dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:22.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:22.075+0000 7f4352975640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f434c0add40 0x7f434c157c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:22.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:22.075+0000 7f4352975640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f434c0af2c0 0x7f434c14bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:22.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:22.075+0000 7f4352975640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f434c0ae830 con 0x7f434c0af2c0 2024-09-16T15:38:22.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:22.075+0000 7f4352975640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f434c0ae6b0 con 0x7f434c0add40 2024-09-16T15:38:22.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:22.075+0000 7f4352975640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f434c0ae9b0 con 0x7f434c073790 2024-09-16T15:38:22.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:22.076+0000 7f4350f12640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f434c0af2c0 0x7f434c14bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:22.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:22.076+0000 7f4350f12640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f434c0af2c0 0x7f434c14bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46166/0 (socket says 172.21.15.98:46166) 2024-09-16T15:38:22.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:22.076+0000 7f4350f12640 1 -- 172.21.15.98:0/1238626246 learned_addr learned my addr 172.21.15.98:0/1238626246 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:22.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:22.076+0000 7f434b7fe640 1 --2- 172.21.15.98:0/1238626246 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f434c0add40 0x7f434c157c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:22.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:22.076+0000 7f434bfff640 1 --2- 172.21.15.98:0/1238626246 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f434c073790 0x7f434c14dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:22.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:22.076+0000 7f4350f12640 1 -- 172.21.15.98:0/1238626246 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f434c073790 msgr2=0x7f434c14dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:22.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:22.076+0000 7f4350f12640 1 --2- 172.21.15.98:0/1238626246 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f434c073790 0x7f434c14dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:22.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:22.076+0000 7f4350f12640 1 -- 172.21.15.98:0/1238626246 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f434c0add40 msgr2=0x7f434c157c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:22.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:22.076+0000 7f4350f12640 1 --2- 172.21.15.98:0/1238626246 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f434c0add40 0x7f434c157c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:22.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:22.076+0000 7f4350f12640 1 -- 172.21.15.98:0/1238626246 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f434c158190 con 0x7f434c0af2c0 2024-09-16T15:38:22.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:22.076+0000 7f4350f12640 1 --2- 172.21.15.98:0/1238626246 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f434c0af2c0 0x7f434c14bdf0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f434400cad0 tx=0x7f434400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:22.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:22.076+0000 7f4348ff9640 1 -- 172.21.15.98:0/1238626246 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f434400ae20 con 0x7f434c0af2c0 2024-09-16T15:38:22.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:22.076+0000 7f4348ff9640 1 -- 172.21.15.98:0/1238626246 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4344004b20 con 0x7f434c0af2c0 2024-09-16T15:38:22.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:22.076+0000 7f4352975640 1 -- 172.21.15.98:0/1238626246 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f434c14d050 con 0x7f434c0af2c0 2024-09-16T15:38:22.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:22.076+0000 7f4348ff9640 1 -- 172.21.15.98:0/1238626246 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4344005020 con 0x7f434c0af2c0 2024-09-16T15:38:22.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:22.076+0000 7f4352975640 1 -- 172.21.15.98:0/1238626246 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f434c149430 con 0x7f434c0af2c0 2024-09-16T15:38:22.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:22.077+0000 7f4352975640 1 -- 172.21.15.98:0/1238626246 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f434c0ae170 con 0x7f434c0af2c0 2024-09-16T15:38:22.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:22.078+0000 7f4348ff9640 1 -- 172.21.15.98:0/1238626246 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7f43440051c0 con 0x7f434c0af2c0 2024-09-16T15:38:22.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:22.078+0000 7f4348ff9640 1 --2- 172.21.15.98:0/1238626246 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f4338078850 0x7f433807ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:22.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:22.079+0000 7f4348ff9640 1 -- 172.21.15.98:0/1238626246 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f434409acc0 con 0x7f434c0af2c0 2024-09-16T15:38:22.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:22.079+0000 7f434bfff640 1 --2- 172.21.15.98:0/1238626246 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f4338078850 0x7f433807ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:22.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:22.079+0000 7f434bfff640 1 --2- 172.21.15.98:0/1238626246 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f4338078850 0x7f433807ad10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f433c033000 tx=0x7f433c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:22.083 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:22.083+0000 7f4348ff9640 1 -- 172.21.15.98:0/1238626246 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7f4344014030 con 0x7f434c0af2c0 2024-09-16T15:38:22.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:22.258+0000 7f4352975640 1 -- 172.21.15.98:0/1238626246 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f434c0b5f40 con 0x7f434c0af2c0 2024-09-16T15:38:23.055 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:23.054+0000 7f4348ff9640 1 -- 172.21.15.98:0/1238626246 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v31) ==== 138+0+0 (secure 0 0 0) 0x7f43440630c0 con 0x7f434c0af2c0 2024-09-16T15:38:23.055 INFO:teuthology.orchestra.run.smithi098.stderr:pool 'cephfs_metadata' created 2024-09-16T15:38:23.058 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:23.057+0000 7f4352975640 1 -- 172.21.15.98:0/1238626246 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f4338078850 msgr2=0x7f433807ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:23.058 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:23.057+0000 7f4352975640 1 --2- 172.21.15.98:0/1238626246 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f4338078850 0x7f433807ad10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f433c033000 tx=0x7f433c004730 comp rx=0 tx=0).stop 2024-09-16T15:38:23.058 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:23.057+0000 7f4352975640 1 -- 172.21.15.98:0/1238626246 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f434c0af2c0 msgr2=0x7f434c14bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:23.058 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:23.057+0000 7f4352975640 1 --2- 172.21.15.98:0/1238626246 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f434c0af2c0 0x7f434c14bdf0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f434400cad0 tx=0x7f434400cf90 comp rx=0 tx=0).stop 2024-09-16T15:38:23.058 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:23.057+0000 7f4352975640 1 -- 172.21.15.98:0/1238626246 shutdown_connections 2024-09-16T15:38:23.058 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:23.057+0000 7f4352975640 1 --2- 172.21.15.98:0/1238626246 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f434c0af2c0 0x7f434c14bdf0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:23.058 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:23.057+0000 7f4352975640 1 --2- 172.21.15.98:0/1238626246 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f4338078850 0x7f433807ad10 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:23.058 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:23.057+0000 7f4352975640 1 --2- 172.21.15.98:0/1238626246 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f434c0add40 0x7f434c157c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:23.058 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:23.057+0000 7f4352975640 1 --2- 172.21.15.98:0/1238626246 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f434c073790 0x7f434c14dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:23.058 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:23.057+0000 7f4352975640 1 -- 172.21.15.98:0/1238626246 >> 172.21.15.98:0/1238626246 conn(0x7f434c0b2960 msgr2=0x7f434c0b2090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:23.058 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:23.057+0000 7f4352975640 1 -- 172.21.15.98:0/1238626246 shutdown_connections 2024-09-16T15:38:23.058 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:23.057+0000 7f4352975640 1 -- 172.21.15.98:0/1238626246 wait complete. 2024-09-16T15:38:23.073 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-16T15:38:23.186 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:23.185+0000 7f0b762ef640 1 -- 172.21.15.98:0/3425093178 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b700ccb00 msgr2=0x7f0b7015f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:23.186 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:23.185+0000 7f0b762ef640 1 --2- 172.21.15.98:0/3425093178 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b700ccb00 0x7f0b7015f9f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0b70074ff0 tx=0x7f0b6802a980 comp rx=0 tx=0).stop 2024-09-16T15:38:23.187 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:23.185+0000 7f0b762ef640 1 -- 172.21.15.98:0/3425093178 shutdown_connections 2024-09-16T15:38:23.187 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:23.185+0000 7f0b762ef640 1 --2- 172.21.15.98:0/3425093178 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b700ccb00 0x7f0b7015f9f0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:23.187 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:23.185+0000 7f0b762ef640 1 --2- 172.21.15.98:0/3425093178 >> v2:172.21.15.135:3300/0 conn(0x7f0b7006efa0 0x7f0b700cc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:23.187 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:23.185+0000 7f0b762ef640 1 --2- 172.21.15.98:0/3425093178 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b70145750 0x7f0b70073440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:23.187 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:23.185+0000 7f0b762ef640 1 -- 172.21.15.98:0/3425093178 >> 172.21.15.98:0/3425093178 conn(0x7f0b700b1840 msgr2=0x7f0b700b1c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:23.187 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:23.185+0000 7f0b762ef640 1 -- 172.21.15.98:0/3425093178 shutdown_connections 2024-09-16T15:38:23.187 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:23.185+0000 7f0b762ef640 1 -- 172.21.15.98:0/3425093178 wait complete. 2024-09-16T15:38:23.187 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:23.186+0000 7f0b762ef640 1 Processor -- start 2024-09-16T15:38:23.187 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:23.187+0000 7f0b762ef640 1 -- start start 2024-09-16T15:38:23.189 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:23.187+0000 7f0b762ef640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b7006efa0 0x7f0b7015f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:23.189 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:23.187+0000 7f0b762ef640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b700ccb00 0x7f0b700ade40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:23.189 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:23.187+0000 7f0b762ef640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b70145750 0x7f0b700ae380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:23.189 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:23.187+0000 7f0b762ef640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0b701600b0 con 0x7f0b7006efa0 2024-09-16T15:38:23.190 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:23.187+0000 7f0b762ef640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0b7015ff30 con 0x7f0b700ccb00 2024-09-16T15:38:23.190 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:23.187+0000 7f0b762ef640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f0b70160230 con 0x7f0b70145750 2024-09-16T15:38:23.190 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:23.187+0000 7f0b6ffff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b7006efa0 0x7f0b7015f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:23.190 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:23.187+0000 7f0b6ffff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b7006efa0 0x7f0b7015f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46170/0 (socket says 172.21.15.98:46170) 2024-09-16T15:38:23.190 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:23.187+0000 7f0b6ffff640 1 -- 172.21.15.98:0/2276739140 learned_addr learned my addr 172.21.15.98:0/2276739140 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:23.190 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:23.188+0000 7f0b6f7fe640 1 --2- 172.21.15.98:0/2276739140 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b700ccb00 0x7f0b700ade40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:23.190 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:23.188+0000 7f0b7488c640 1 --2- 172.21.15.98:0/2276739140 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b70145750 0x7f0b700ae380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:23.190 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:23.188+0000 7f0b6ffff640 1 -- 172.21.15.98:0/2276739140 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b70145750 msgr2=0x7f0b700ae380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:23.190 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:23.188+0000 7f0b6ffff640 1 --2- 172.21.15.98:0/2276739140 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b70145750 0x7f0b700ae380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:23.190 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:23.188+0000 7f0b6ffff640 1 -- 172.21.15.98:0/2276739140 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b700ccb00 msgr2=0x7f0b700ade40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:23.190 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:23.188+0000 7f0b6ffff640 1 --2- 172.21.15.98:0/2276739140 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b700ccb00 0x7f0b700ade40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:23.190 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:23.188+0000 7f0b6ffff640 1 -- 172.21.15.98:0/2276739140 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b701f27c0 con 0x7f0b7006efa0 2024-09-16T15:38:23.190 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:23.188+0000 7f0b6ffff640 1 --2- 172.21.15.98:0/2276739140 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b7006efa0 0x7f0b7015f720 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0b6000e7c0 tx=0x7f0b6000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:23.190 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:23.188+0000 7f0b6cff9640 1 -- 172.21.15.98:0/2276739140 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b6000cc60 con 0x7f0b7006efa0 2024-09-16T15:38:23.190 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:23.188+0000 7f0b6cff9640 1 -- 172.21.15.98:0/2276739140 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0b6000ce20 con 0x7f0b7006efa0 2024-09-16T15:38:23.191 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:23.188+0000 7f0b762ef640 1 -- 172.21.15.98:0/2276739140 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b701f2a60 con 0x7f0b7006efa0 2024-09-16T15:38:23.191 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:23.188+0000 7f0b6cff9640 1 -- 172.21.15.98:0/2276739140 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b60005280 con 0x7f0b7006efa0 2024-09-16T15:38:23.191 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:23.188+0000 7f0b762ef640 1 -- 172.21.15.98:0/2276739140 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b701f3020 con 0x7f0b7006efa0 2024-09-16T15:38:23.191 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:23.189+0000 7f0b762ef640 1 -- 172.21.15.98:0/2276739140 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b70160710 con 0x7f0b7006efa0 2024-09-16T15:38:23.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:23.190+0000 7f0b6cff9640 1 -- 172.21.15.98:0/2276739140 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7f0b60005420 con 0x7f0b7006efa0 2024-09-16T15:38:23.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:23.190+0000 7f0b6cff9640 1 --2- 172.21.15.98:0/2276739140 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f0b5c078850 0x7f0b5c07ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:23.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:23.190+0000 7f0b6cff9640 1 -- 172.21.15.98:0/2276739140 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5227+0+0 (secure 0 0 0) 0x7f0b6009b080 con 0x7f0b7006efa0 2024-09-16T15:38:23.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:23.190+0000 7f0b6f7fe640 1 --2- 172.21.15.98:0/2276739140 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f0b5c078850 0x7f0b5c07ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:23.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:23.191+0000 7f0b6f7fe640 1 --2- 172.21.15.98:0/2276739140 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f0b5c078850 0x7f0b5c07ad10 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0b70144ed0 tx=0x7f0b64005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:23.195 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:23.195+0000 7f0b6cff9640 1 -- 172.21.15.98:0/2276739140 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7f0b600638e0 con 0x7f0b7006efa0 2024-09-16T15:38:23.376 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:23.375+0000 7f0b762ef640 1 -- 172.21.15.98:0/2276739140 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f0b700b0460 con 0x7f0b7006efa0 2024-09-16T15:38:24.057 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:24.056+0000 7f0b6cff9640 1 -- 172.21.15.98:0/2276739140 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v32) ==== 170+0+0 (secure 0 0 0) 0x7f0b600631e0 con 0x7f0b7006efa0 2024-09-16T15:38:24.057 INFO:teuthology.orchestra.run.smithi098.stderr:pool 'cephfs_data' created 2024-09-16T15:38:24.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:24.059+0000 7f0b762ef640 1 -- 172.21.15.98:0/2276739140 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f0b5c078850 msgr2=0x7f0b5c07ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:24.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:24.059+0000 7f0b762ef640 1 --2- 172.21.15.98:0/2276739140 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f0b5c078850 0x7f0b5c07ad10 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0b70144ed0 tx=0x7f0b64005f90 comp rx=0 tx=0).stop 2024-09-16T15:38:24.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:24.059+0000 7f0b762ef640 1 -- 172.21.15.98:0/2276739140 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b7006efa0 msgr2=0x7f0b7015f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:24.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:24.059+0000 7f0b762ef640 1 --2- 172.21.15.98:0/2276739140 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b7006efa0 0x7f0b7015f720 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0b6000e7c0 tx=0x7f0b6000ec80 comp rx=0 tx=0).stop 2024-09-16T15:38:24.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:24.059+0000 7f0b762ef640 1 -- 172.21.15.98:0/2276739140 shutdown_connections 2024-09-16T15:38:24.061 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:24.059+0000 7f0b762ef640 1 --2- 172.21.15.98:0/2276739140 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0b70145750 0x7f0b700ae380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:24.061 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:24.059+0000 7f0b762ef640 1 --2- 172.21.15.98:0/2276739140 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f0b5c078850 0x7f0b5c07ad10 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:24.061 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:24.059+0000 7f0b762ef640 1 --2- 172.21.15.98:0/2276739140 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b700ccb00 0x7f0b700ade40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:24.061 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:24.059+0000 7f0b762ef640 1 --2- 172.21.15.98:0/2276739140 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b7006efa0 0x7f0b7015f720 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:24.061 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:24.059+0000 7f0b762ef640 1 -- 172.21.15.98:0/2276739140 >> 172.21.15.98:0/2276739140 conn(0x7f0b700b1840 msgr2=0x7f0b7006f480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:24.061 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:24.059+0000 7f0b762ef640 1 -- 172.21.15.98:0/2276739140 shutdown_connections 2024-09-16T15:38:24.061 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:24.059+0000 7f0b762ef640 1 -- 172.21.15.98:0/2276739140 wait complete. 2024-09-16T15:38:24.082 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-16T15:38:24.188 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:24.187+0000 7f67d7aef640 1 -- 172.21.15.98:0/1340231526 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f67d0073740 msgr2=0x7f67d00cceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:24.188 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:24.187+0000 7f67d7aef640 1 --2- 172.21.15.98:0/1340231526 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f67d0073740 0x7f67d00cceb0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f67d00d14b0 tx=0x7f67c802a4f0 comp rx=0 tx=0).stop 2024-09-16T15:38:24.188 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:24.187+0000 7f67d7aef640 1 -- 172.21.15.98:0/1340231526 shutdown_connections 2024-09-16T15:38:24.188 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:24.187+0000 7f67d7aef640 1 --2- 172.21.15.98:0/1340231526 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f67d0073740 0x7f67d00cceb0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:24.189 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:24.187+0000 7f67d7aef640 1 --2- 172.21.15.98:0/1340231526 >> v2:172.21.15.135:3300/0 conn(0x7f67d0152e30 0x7f67d015cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:24.189 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:24.187+0000 7f67d7aef640 1 -- 172.21.15.98:0/1340231526 >> 172.21.15.98:0/1340231526 conn(0x7f67d00b2130 msgr2=0x7f67d00b2540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:24.189 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:24.187+0000 7f67d7aef640 1 -- 172.21.15.98:0/1340231526 shutdown_connections 2024-09-16T15:38:24.189 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:24.187+0000 7f67d7aef640 1 -- 172.21.15.98:0/1340231526 wait complete. 2024-09-16T15:38:24.189 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:24.188+0000 7f67d7aef640 1 Processor -- start 2024-09-16T15:38:24.189 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:24.188+0000 7f67d7aef640 1 -- start start 2024-09-16T15:38:24.191 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:24.189+0000 7f67d7aef640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67d0073740 0x7f67d01595c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:24.191 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:24.189+0000 7f67d7aef640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67d0152e30 0x7f67d00b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:24.191 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:24.189+0000 7f67d7aef640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f67d01f7e90 0x7f67d00b35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:24.191 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:24.189+0000 7f67d7aef640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f67d006d150 con 0x7f67d01f7e90 2024-09-16T15:38:24.191 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:24.189+0000 7f67d7aef640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f67d006cfd0 con 0x7f67d0073740 2024-09-16T15:38:24.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:24.189+0000 7f67d7aef640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f67d006d2d0 con 0x7f67d0152e30 2024-09-16T15:38:24.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:24.189+0000 7f67d608c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f67d01f7e90 0x7f67d00b35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:24.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:24.189+0000 7f67d608c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f67d01f7e90 0x7f67d00b35e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46190/0 (socket says 172.21.15.98:46190) 2024-09-16T15:38:24.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:24.189+0000 7f67d608c640 1 -- 172.21.15.98:0/3666855195 learned_addr learned my addr 172.21.15.98:0/3666855195 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:24.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:24.189+0000 7f67d508a640 1 --2- 172.21.15.98:0/3666855195 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67d0152e30 0x7f67d00b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:24.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:24.189+0000 7f67d588b640 1 --2- 172.21.15.98:0/3666855195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67d0073740 0x7f67d01595c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:24.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:24.190+0000 7f67d608c640 1 -- 172.21.15.98:0/3666855195 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67d0152e30 msgr2=0x7f67d00b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:24.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:24.190+0000 7f67d608c640 1 --2- 172.21.15.98:0/3666855195 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67d0152e30 0x7f67d00b0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:24.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:24.190+0000 7f67d608c640 1 -- 172.21.15.98:0/3666855195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67d0073740 msgr2=0x7f67d01595c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:24.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:24.190+0000 7f67d608c640 1 --2- 172.21.15.98:0/3666855195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67d0073740 0x7f67d01595c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:24.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:24.190+0000 7f67d608c640 1 -- 172.21.15.98:0/3666855195 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67d01f8400 con 0x7f67d01f7e90 2024-09-16T15:38:24.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:24.190+0000 7f67d588b640 1 --2- 172.21.15.98:0/3666855195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67d0073740 0x7f67d01595c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T15:38:24.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:24.190+0000 7f67d508a640 1 --2- 172.21.15.98:0/3666855195 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67d0152e30 0x7f67d00b0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T15:38:24.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:24.190+0000 7f67d608c640 1 --2- 172.21.15.98:0/3666855195 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f67d01f7e90 0x7f67d00b35e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f67c8006010 tx=0x7f67c80039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:24.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:24.190+0000 7f67ce7fc640 1 -- 172.21.15.98:0/3666855195 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67c803f070 con 0x7f67d01f7e90 2024-09-16T15:38:24.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:24.190+0000 7f67ce7fc640 1 -- 172.21.15.98:0/3666855195 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f67c8004890 con 0x7f67d01f7e90 2024-09-16T15:38:24.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:24.190+0000 7f67d7aef640 1 -- 172.21.15.98:0/3666855195 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67d01f86e0 con 0x7f67d01f7e90 2024-09-16T15:38:24.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:24.190+0000 7f67ce7fc640 1 -- 172.21.15.98:0/3666855195 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67c8035030 con 0x7f67d01f7e90 2024-09-16T15:38:24.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:24.190+0000 7f67d7aef640 1 -- 172.21.15.98:0/3666855195 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67d01f8ca0 con 0x7f67d01f7e90 2024-09-16T15:38:24.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:24.191+0000 7f67d7aef640 1 -- 172.21.15.98:0/3666855195 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67d006d850 con 0x7f67d01f7e90 2024-09-16T15:38:24.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:24.192+0000 7f67ce7fc640 1 -- 172.21.15.98:0/3666855195 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7f67c8042070 con 0x7f67d01f7e90 2024-09-16T15:38:24.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:24.192+0000 7f67ce7fc640 1 --2- 172.21.15.98:0/3666855195 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f67bc078880 0x7f67bc07ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:24.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:24.192+0000 7f67ce7fc640 1 -- 172.21.15.98:0/3666855195 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5609+0+0 (secure 0 0 0) 0x7f67c80bbc10 con 0x7f67d01f7e90 2024-09-16T15:38:24.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:24.193+0000 7f67d588b640 1 --2- 172.21.15.98:0/3666855195 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f67bc078880 0x7f67bc07ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:24.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:24.193+0000 7f67d588b640 1 --2- 172.21.15.98:0/3666855195 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f67bc078880 0x7f67bc07ad40 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f67c0009fa0 tx=0x7f67c0009570 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:24.197 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:24.196+0000 7f67ce7fc640 1 -- 172.21.15.98:0/3666855195 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7f67c80842e0 con 0x7f67d01f7e90 2024-09-16T15:38:24.409 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:24.408+0000 7f67d7aef640 1 -- 172.21.15.98:0/3666855195 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f67d006dff0 con 0x7f67d01f7e90 2024-09-16T15:38:25.082 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.081+0000 7f67ce7fc640 1 -- 172.21.15.98:0/3666855195 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v12) ==== 172+0+0 (secure 0 0 0) 0x7f67c8083be0 con 0x7f67d01f7e90 2024-09-16T15:38:25.086 INFO:teuthology.orchestra.run.smithi098.stderr:new fs with metadata pool 4 and data pool 5 2024-09-16T15:38:25.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.093+0000 7f67d7aef640 1 -- 172.21.15.98:0/3666855195 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f67bc078880 msgr2=0x7f67bc07ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:25.096 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.093+0000 7f67d7aef640 1 --2- 172.21.15.98:0/3666855195 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f67bc078880 0x7f67bc07ad40 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f67c0009fa0 tx=0x7f67c0009570 comp rx=0 tx=0).stop 2024-09-16T15:38:25.096 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.093+0000 7f67d7aef640 1 -- 172.21.15.98:0/3666855195 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f67d01f7e90 msgr2=0x7f67d00b35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:25.096 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.093+0000 7f67d7aef640 1 --2- 172.21.15.98:0/3666855195 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f67d01f7e90 0x7f67d00b35e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f67c8006010 tx=0x7f67c80039e0 comp rx=0 tx=0).stop 2024-09-16T15:38:25.097 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.096+0000 7f67d7aef640 1 -- 172.21.15.98:0/3666855195 shutdown_connections 2024-09-16T15:38:25.098 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.096+0000 7f67d7aef640 1 --2- 172.21.15.98:0/3666855195 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f67d01f7e90 0x7f67d00b35e0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:25.098 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.096+0000 7f67d7aef640 1 --2- 172.21.15.98:0/3666855195 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f67d0152e30 0x7f67d00b0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:25.098 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.096+0000 7f67d7aef640 1 --2- 172.21.15.98:0/3666855195 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f67bc078880 0x7f67bc07ad40 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:25.098 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.096+0000 7f67d7aef640 1 --2- 172.21.15.98:0/3666855195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67d0073740 0x7f67d01595c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:25.098 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.096+0000 7f67d7aef640 1 -- 172.21.15.98:0/3666855195 >> 172.21.15.98:0/3666855195 conn(0x7f67d00b2130 msgr2=0x7f67d0073030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:25.098 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.096+0000 7f67d7aef640 1 -- 172.21.15.98:0/3666855195 shutdown_connections 2024-09-16T15:38:25.098 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.096+0000 7f67d7aef640 1 -- 172.21.15.98:0/3666855195 wait complete. 2024-09-16T15:38:25.113 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T15:38:25.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.216+0000 7fe8c749b640 1 -- 172.21.15.98:0/887132667 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe8c00d2050 msgr2=0x7fe8c00d0f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:25.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.216+0000 7fe8c749b640 1 --2- 172.21.15.98:0/887132667 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe8c00d2050 0x7fe8c00d0f00 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe8c008e550 tx=0x7fe8b402a5f0 comp rx=0 tx=0).stop 2024-09-16T15:38:25.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.216+0000 7fe8c749b640 1 -- 172.21.15.98:0/887132667 shutdown_connections 2024-09-16T15:38:25.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.216+0000 7fe8c749b640 1 --2- 172.21.15.98:0/887132667 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe8c00d2050 0x7fe8c00d0f00 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:25.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.216+0000 7fe8c749b640 1 --2- 172.21.15.98:0/887132667 >> v2:172.21.15.135:3300/0 conn(0x7fe8c015e0d0 0x7fe8c00d09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:25.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.216+0000 7fe8c749b640 1 -- 172.21.15.98:0/887132667 >> 172.21.15.98:0/887132667 conn(0x7fe8c00d3fe0 msgr2=0x7fe8c00d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:25.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.216+0000 7fe8c749b640 1 -- 172.21.15.98:0/887132667 shutdown_connections 2024-09-16T15:38:25.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.216+0000 7fe8c749b640 1 -- 172.21.15.98:0/887132667 wait complete. 2024-09-16T15:38:25.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.217+0000 7fe8c749b640 1 Processor -- start 2024-09-16T15:38:25.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.217+0000 7fe8c749b640 1 -- start start 2024-09-16T15:38:25.220 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.218+0000 7fe8c749b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe8c00d1440 0x7fe8c015c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:25.220 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.218+0000 7fe8c749b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe8c00d2050 0x7fe8c00c93d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:25.220 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.218+0000 7fe8c749b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8c015e0d0 0x7fe8c00c7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:25.220 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.218+0000 7fe8c749b640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c015ebc0 con 0x7fe8c00d2050 2024-09-16T15:38:25.220 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.218+0000 7fe8c749b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c00cff60 con 0x7fe8c015e0d0 2024-09-16T15:38:25.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.218+0000 7fe8c749b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fe8c015ed40 con 0x7fe8c00d1440 2024-09-16T15:38:25.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.218+0000 7fe8c4a36640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe8c00d2050 0x7fe8c00c93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:25.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.218+0000 7fe8c4a36640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe8c00d2050 0x7fe8c00c93d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40612/0 (socket says 172.21.15.98:40612) 2024-09-16T15:38:25.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.218+0000 7fe8c4a36640 1 -- 172.21.15.98:0/3984451754 learned_addr learned my addr 172.21.15.98:0/3984451754 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:25.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.218+0000 7fe8c5a38640 1 --2- 172.21.15.98:0/3984451754 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8c015e0d0 0x7fe8c00c7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:25.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.218+0000 7fe8c5237640 1 --2- 172.21.15.98:0/3984451754 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe8c00d1440 0x7fe8c015c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:25.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.219+0000 7fe8c4a36640 1 -- 172.21.15.98:0/3984451754 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe8c00d1440 msgr2=0x7fe8c015c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:25.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.219+0000 7fe8c4a36640 1 --2- 172.21.15.98:0/3984451754 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe8c00d1440 0x7fe8c015c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:25.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.219+0000 7fe8c4a36640 1 -- 172.21.15.98:0/3984451754 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8c015e0d0 msgr2=0x7fe8c00c7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:25.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.219+0000 7fe8c4a36640 1 --2- 172.21.15.98:0/3984451754 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8c015e0d0 0x7fe8c00c7af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:25.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.219+0000 7fe8c4a36640 1 -- 172.21.15.98:0/3984451754 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8c01f4930 con 0x7fe8c00d2050 2024-09-16T15:38:25.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.219+0000 7fe8c4a36640 1 --2- 172.21.15.98:0/3984451754 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe8c00d2050 0x7fe8c00c93d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe8b40099c0 tx=0x7fe8b40039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:25.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.219+0000 7fe8bdffb640 1 -- 172.21.15.98:0/3984451754 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8b403f070 con 0x7fe8c00d2050 2024-09-16T15:38:25.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.219+0000 7fe8bdffb640 1 -- 172.21.15.98:0/3984451754 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe8b4004890 con 0x7fe8c00d2050 2024-09-16T15:38:25.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.219+0000 7fe8bdffb640 1 -- 172.21.15.98:0/3984451754 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8b4035030 con 0x7fe8c00d2050 2024-09-16T15:38:25.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.219+0000 7fe8c749b640 1 -- 172.21.15.98:0/3984451754 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8c00c8660 con 0x7fe8c00d2050 2024-09-16T15:38:25.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.219+0000 7fe8c749b640 1 -- 172.21.15.98:0/3984451754 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8c00c8c20 con 0x7fe8c00d2050 2024-09-16T15:38:25.223 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.220+0000 7fe8c749b640 1 -- 172.21.15.98:0/3984451754 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8c015f260 con 0x7fe8c00d2050 2024-09-16T15:38:25.223 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.221+0000 7fe8bdffb640 1 -- 172.21.15.98:0/3984451754 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7fe8b4042070 con 0x7fe8c00d2050 2024-09-16T15:38:25.223 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.221+0000 7fe8bdffb640 1 --2- 172.21.15.98:0/3984451754 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fe8ac078850 0x7fe8ac07ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:25.223 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.222+0000 7fe8bdffb640 1 -- 172.21.15.98:0/3984451754 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fe8b40bb750 con 0x7fe8c00d2050 2024-09-16T15:38:25.223 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.222+0000 7fe8c5237640 1 --2- 172.21.15.98:0/3984451754 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fe8ac078850 0x7fe8ac07ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:25.224 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.222+0000 7fe8c5237640 1 --2- 172.21.15.98:0/3984451754 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fe8ac078850 0x7fe8ac07ad10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe8c00d2750 tx=0x7fe8b0009660 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:25.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.226+0000 7fe8bdffb640 1 -- 172.21.15.98:0/3984451754 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7fe8b40836f0 con 0x7fe8c00d2050 2024-09-16T15:38:25.402 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.401+0000 7fe8c749b640 1 -- 172.21.15.98:0/3984451754 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe8c00761d0 con 0x7fe8c00d2050 2024-09-16T15:38:25.402 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.402+0000 7fe8bdffb640 1 -- 172.21.15.98:0/3984451754 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16694 (secure 0 0 0) 0x7fe8b4088120 con 0x7fe8c00d2050 2024-09-16T15:38:25.403 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:38:25.403 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":33,"fsid":"52a38a45-21d2-4cb0-bb3a-4fb8be3a08df","created":"2024-09-16T15:37:20.387654+0000","modified":"2024-09-16T15:38:24.409477+0000","last_up_change":"2024-09-16T15:37:33.417470+0000","last_in_change":"2024-09-16T15:37:23.430578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T15:37:34.725090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-16T15:38:22.261968+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-16T15:38:23.379099+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a2d61df4-2577-47e6-a4ac-c36bbb85ab8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1967099790},{"type":"v1","addr":"172.21.15.98:6825","nonce":1967099790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1967099790},{"type":"v1","addr":"172.21.15.98:6827","nonce":1967099790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":1967099790},{"type":"v1","addr":"172.21.15.98:6831","nonce":1967099790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1967099790},{"type":"v1","addr":"172.21.15.98:6829","nonce":1967099790}]},"public_addr":"172.21.15.98:6825/1967099790","cluster_addr":"172.21.15.98:6827/1967099790","heartbeat_back_addr":"172.21.15.98:6831/1967099790","heartbeat_front_addr":"172.21.15.98:6829/1967099790","state":["exists","up"]},{"osd":1,"uuid":"bb3a68a5-c22f-442b-b292-7c272fe01ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":3571460482},{"type":"v1","addr":"172.21.15.98:6809","nonce":3571460482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":3571460482},{"type":"v1","addr":"172.21.15.98:6811","nonce":3571460482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":3571460482},{"type":"v1","addr":"172.21.15.98:6815","nonce":3571460482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":3571460482},{"type":"v1","addr":"172.21.15.98:6813","nonce":3571460482}]},"public_addr":"172.21.15.98:6809/3571460482","cluster_addr":"172.21.15.98:6811/3571460482","heartbeat_back_addr":"172.21.15.98:6815/3571460482","heartbeat_front_addr":"172.21.15.98:6813/3571460482","state":["exists","up"]},{"osd":2,"uuid":"c8429195-a480-409b-8e5f-8dc4c6abc0a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":2573210695},{"type":"v1","addr":"172.21.15.98:6801","nonce":2573210695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":2573210695},{"type":"v1","addr":"172.21.15.98:6803","nonce":2573210695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":2573210695},{"type":"v1","addr":"172.21.15.98:6807","nonce":2573210695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":2573210695},{"type":"v1","addr":"172.21.15.98:6805","nonce":2573210695}]},"public_addr":"172.21.15.98:6801/2573210695","cluster_addr":"172.21.15.98:6803/2573210695","heartbeat_back_addr":"172.21.15.98:6807/2573210695","heartbeat_front_addr":"172.21.15.98:6805/2573210695","state":["exists","up"]},{"osd":3,"uuid":"0e800d7b-096f-4f65-b3cc-c7cda3870de4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":3951374837},{"type":"v1","addr":"172.21.15.98:6817","nonce":3951374837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":3951374837},{"type":"v1","addr":"172.21.15.98:6819","nonce":3951374837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":3951374837},{"type":"v1","addr":"172.21.15.98:6823","nonce":3951374837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":3951374837},{"type":"v1","addr":"172.21.15.98:6821","nonce":3951374837}]},"public_addr":"172.21.15.98:6817/3951374837","cluster_addr":"172.21.15.98:6819/3951374837","heartbeat_back_addr":"172.21.15.98:6823/3951374837","heartbeat_front_addr":"172.21.15.98:6821/3951374837","state":["exists","up"]},{"osd":4,"uuid":"c7822e9b-8e29-48d9-b92a-e8f9c7bc5247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":724302036},{"type":"v1","addr":"172.21.15.135:6811","nonce":724302036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":724302036},{"type":"v1","addr":"172.21.15.135:6813","nonce":724302036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":724302036},{"type":"v1","addr":"172.21.15.135:6817","nonce":724302036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":724302036},{"type":"v1","addr":"172.21.15.135:6815","nonce":724302036}]},"public_addr":"172.21.15.135:6811/724302036","cluster_addr":"172.21.15.135:6813/724302036","heartbeat_back_addr":"172.21.15.135:6817/724302036","heartbeat_front_addr":"172.21.15.135:6815/724302036","state":["exists","up"]},{"osd":5,"uuid":"35805e02-484a-4404-a78f-aa44f4daa41f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3083482635},{"type":"v1","addr":"172.21.15.135:6803","nonce":3083482635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3083482635},{"type":"v1","addr":"172.21.15.135:6805","nonce":3083482635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3083482635},{"type":"v1","addr":"172.21.15.135:6809","nonce":3083482635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3083482635},{"type":"v1","addr":"172.21.15.135:6807","nonce":3083482635}]},"public_addr":"172.21.15.135:6803/3083482635","cluster_addr":"172.21.15.135:6805/3083482635","heartbeat_back_addr":"172.21.15.135:6809/3083482635","heartbeat_front_addr":"172.21.15.135:6807/3083482635","state":["exists","up"]},{"osd":6,"uuid":"6327ba84-aaeb-41fa-9717-188988ff2c4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3376376340},{"type":"v1","addr":"172.21.15.135:6819","nonce":3376376340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3376376340},{"type":"v1","addr":"172.21.15.135:6821","nonce":3376376340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":3376376340},{"type":"v1","addr":"172.21.15.135:6825","nonce":3376376340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3376376340},{"type":"v1","addr":"172.21.15.135:6823","nonce":3376376340}]},"public_addr":"172.21.15.135:6819/3376376340","cluster_addr":"172.21.15.135:6821/3376376340","heartbeat_back_addr":"172.21.15.135:6825/3376376340","heartbeat_front_addr":"172.21.15.135:6823/3376376340","state":["exists","up"]},{"osd":7,"uuid":"392d0958-dff9-4248-b3d8-a1201c10f354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2559837727},{"type":"v1","addr":"172.21.15.135:6827","nonce":2559837727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2559837727},{"type":"v1","addr":"172.21.15.135:6829","nonce":2559837727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":2559837727},{"type":"v1","addr":"172.21.15.135:6833","nonce":2559837727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2559837727},{"type":"v1","addr":"172.21.15.135:6831","nonce":2559837727}]},"public_addr":"172.21.15.135:6827/2559837727","cluster_addr":"172.21.15.135:6829/2559837727","heartbeat_back_addr":"172.21.15.135:6833/2559837727","heartbeat_front_addr":"172.21.15.135:6831/2559837727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.939904+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.717296+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.785817+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:30.211718+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.973359+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:30.250109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.699327+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:30.173063+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T15:38:25.405 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.404+0000 7fe8c749b640 1 -- 172.21.15.98:0/3984451754 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fe8ac078850 msgr2=0x7fe8ac07ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:25.405 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.404+0000 7fe8c749b640 1 --2- 172.21.15.98:0/3984451754 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fe8ac078850 0x7fe8ac07ad10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe8c00d2750 tx=0x7fe8b0009660 comp rx=0 tx=0).stop 2024-09-16T15:38:25.405 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.404+0000 7fe8c749b640 1 -- 172.21.15.98:0/3984451754 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe8c00d2050 msgr2=0x7fe8c00c93d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:25.405 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.404+0000 7fe8c749b640 1 --2- 172.21.15.98:0/3984451754 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe8c00d2050 0x7fe8c00c93d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe8b40099c0 tx=0x7fe8b40039e0 comp rx=0 tx=0).stop 2024-09-16T15:38:25.406 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.404+0000 7fe8c749b640 1 -- 172.21.15.98:0/3984451754 shutdown_connections 2024-09-16T15:38:25.406 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.404+0000 7fe8c749b640 1 --2- 172.21.15.98:0/3984451754 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fe8ac078850 0x7fe8ac07ad10 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:25.406 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.404+0000 7fe8c749b640 1 --2- 172.21.15.98:0/3984451754 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8c015e0d0 0x7fe8c00c7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:25.406 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.404+0000 7fe8c749b640 1 --2- 172.21.15.98:0/3984451754 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe8c00d2050 0x7fe8c00c93d0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:25.406 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.404+0000 7fe8c749b640 1 --2- 172.21.15.98:0/3984451754 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe8c00d1440 0x7fe8c015c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:25.406 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.404+0000 7fe8c749b640 1 -- 172.21.15.98:0/3984451754 >> 172.21.15.98:0/3984451754 conn(0x7fe8c00d3fe0 msgr2=0x7fe8c00b52a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:25.406 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.404+0000 7fe8c749b640 1 -- 172.21.15.98:0/3984451754 shutdown_connections 2024-09-16T15:38:25.406 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.404+0000 7fe8c749b640 1 -- 172.21.15.98:0/3984451754 wait complete. 2024-09-16T15:38:25.416 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T15:38:25.518 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.516+0000 7fe1d1a6e640 1 -- 172.21.15.98:0/4122399642 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1cc15e0d0 msgr2=0x7fe1cc0d09c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:25.518 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.516+0000 7fe1d1a6e640 1 --2- 172.21.15.98:0/4122399642 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1cc15e0d0 0x7fe1cc0d09c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc005fd0 tx=0x7fe1bc02a5d0 comp rx=0 tx=0).stop 2024-09-16T15:38:25.518 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.516+0000 7fe1d1a6e640 1 -- 172.21.15.98:0/4122399642 shutdown_connections 2024-09-16T15:38:25.518 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.516+0000 7fe1d1a6e640 1 --2- 172.21.15.98:0/4122399642 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe1cc0d1610 0x7fe1cc0cecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:25.518 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.516+0000 7fe1d1a6e640 1 --2- 172.21.15.98:0/4122399642 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1cc15e0d0 0x7fe1cc0d09c0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:25.518 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.516+0000 7fe1d1a6e640 1 -- 172.21.15.98:0/4122399642 >> 172.21.15.98:0/4122399642 conn(0x7fe1cc0d3fe0 msgr2=0x7fe1cc0d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:25.518 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.516+0000 7fe1d1a6e640 1 -- 172.21.15.98:0/4122399642 shutdown_connections 2024-09-16T15:38:25.519 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.516+0000 7fe1d1a6e640 1 -- 172.21.15.98:0/4122399642 wait complete. 2024-09-16T15:38:25.521 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.517+0000 7fe1d1a6e640 1 Processor -- start 2024-09-16T15:38:25.521 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.518+0000 7fe1d1a6e640 1 -- start start 2024-09-16T15:38:25.521 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.518+0000 7fe1d1a6e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1cc0d1610 0x7fe1cc1f5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:25.521 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.518+0000 7fe1d1a6e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe1cc0d2050 0x7fe1cc09fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:25.521 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.518+0000 7fe1d1a6e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1cc15e0d0 0x7fe1cc15c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:25.521 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.518+0000 7fe1d1a6e640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe1cc0cf5d0 con 0x7fe1cc15e0d0 2024-09-16T15:38:25.521 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.518+0000 7fe1d1a6e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe1cc0cf450 con 0x7fe1cc0d1610 2024-09-16T15:38:25.522 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.518+0000 7fe1d1a6e640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fe1cc0cf750 con 0x7fe1cc0d2050 2024-09-16T15:38:25.522 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.519+0000 7fe1cbfff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1cc15e0d0 0x7fe1cc15c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:25.522 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.519+0000 7fe1cbfff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1cc15e0d0 0x7fe1cc15c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40632/0 (socket says 172.21.15.98:40632) 2024-09-16T15:38:25.522 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.519+0000 7fe1cbfff640 1 -- 172.21.15.98:0/807496368 learned_addr learned my addr 172.21.15.98:0/807496368 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:25.522 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.519+0000 7fe1caffd640 1 --2- 172.21.15.98:0/807496368 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe1cc0d2050 0x7fe1cc09fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:25.522 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.519+0000 7fe1cbfff640 1 -- 172.21.15.98:0/807496368 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe1cc0d2050 msgr2=0x7fe1cc09fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:25.522 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.519+0000 7fe1cb7fe640 1 --2- 172.21.15.98:0/807496368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1cc0d1610 0x7fe1cc1f5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:25.522 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.519+0000 7fe1cbfff640 1 --2- 172.21.15.98:0/807496368 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe1cc0d2050 0x7fe1cc09fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:25.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.519+0000 7fe1cbfff640 1 -- 172.21.15.98:0/807496368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1cc0d1610 msgr2=0x7fe1cc1f5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:25.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.519+0000 7fe1cbfff640 1 --2- 172.21.15.98:0/807496368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1cc0d1610 0x7fe1cc1f5250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:25.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.519+0000 7fe1cbfff640 1 -- 172.21.15.98:0/807496368 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1cc0ce1b0 con 0x7fe1cc15e0d0 2024-09-16T15:38:25.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.519+0000 7fe1caffd640 1 --2- 172.21.15.98:0/807496368 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe1cc0d2050 0x7fe1cc09fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T15:38:25.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.519+0000 7fe1cb7fe640 1 --2- 172.21.15.98:0/807496368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1cc0d1610 0x7fe1cc1f5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T15:38:25.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.519+0000 7fe1cbfff640 1 --2- 172.21.15.98:0/807496368 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1cc15e0d0 0x7fe1cc15c0d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe1c400cab0 tx=0x7fe1c400cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:25.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.519+0000 7fe1b3fff640 1 -- 172.21.15.98:0/807496368 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c400ae20 con 0x7fe1cc15e0d0 2024-09-16T15:38:25.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.519+0000 7fe1b3fff640 1 -- 172.21.15.98:0/807496368 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe1c400f450 con 0x7fe1cc15e0d0 2024-09-16T15:38:25.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.519+0000 7fe1d1a6e640 1 -- 172.21.15.98:0/807496368 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1cc0ce490 con 0x7fe1cc15e0d0 2024-09-16T15:38:25.524 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.519+0000 7fe1b3fff640 1 -- 172.21.15.98:0/807496368 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c400f8c0 con 0x7fe1cc15e0d0 2024-09-16T15:38:25.524 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.519+0000 7fe1d1a6e640 1 -- 172.21.15.98:0/807496368 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1cc0cb390 con 0x7fe1cc15e0d0 2024-09-16T15:38:25.524 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.520+0000 7fe1d1a6e640 1 -- 172.21.15.98:0/807496368 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1cc0cfc70 con 0x7fe1cc15e0d0 2024-09-16T15:38:25.524 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.521+0000 7fe1b3fff640 1 -- 172.21.15.98:0/807496368 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7fe1c400fa60 con 0x7fe1cc15e0d0 2024-09-16T15:38:25.525 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.521+0000 7fe1b3fff640 1 --2- 172.21.15.98:0/807496368 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fe1b8078850 0x7fe1b807ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:25.525 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.521+0000 7fe1b3fff640 1 -- 172.21.15.98:0/807496368 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fe1c409b470 con 0x7fe1cc15e0d0 2024-09-16T15:38:25.525 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.522+0000 7fe1cb7fe640 1 --2- 172.21.15.98:0/807496368 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fe1b8078850 0x7fe1b807ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:25.525 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.522+0000 7fe1cb7fe640 1 --2- 172.21.15.98:0/807496368 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fe1b8078850 0x7fe1b807ad10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc033000 tx=0x7fe1bc004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:25.526 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.526+0000 7fe1b3fff640 1 -- 172.21.15.98:0/807496368 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7fe1c4014030 con 0x7fe1cc15e0d0 2024-09-16T15:38:25.704 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.703+0000 7fe1d1a6e640 1 -- 172.21.15.98:0/807496368 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe1cc0d2970 con 0x7fe1cc15e0d0 2024-09-16T15:38:25.705 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.704+0000 7fe1b3fff640 1 -- 172.21.15.98:0/807496368 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16694 (secure 0 0 0) 0x7fe1c406c020 con 0x7fe1cc15e0d0 2024-09-16T15:38:25.705 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:38:25.705 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":33,"fsid":"52a38a45-21d2-4cb0-bb3a-4fb8be3a08df","created":"2024-09-16T15:37:20.387654+0000","modified":"2024-09-16T15:38:24.409477+0000","last_up_change":"2024-09-16T15:37:33.417470+0000","last_in_change":"2024-09-16T15:37:23.430578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T15:37:34.725090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-16T15:38:22.261968+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-16T15:38:23.379099+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a2d61df4-2577-47e6-a4ac-c36bbb85ab8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1967099790},{"type":"v1","addr":"172.21.15.98:6825","nonce":1967099790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1967099790},{"type":"v1","addr":"172.21.15.98:6827","nonce":1967099790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":1967099790},{"type":"v1","addr":"172.21.15.98:6831","nonce":1967099790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1967099790},{"type":"v1","addr":"172.21.15.98:6829","nonce":1967099790}]},"public_addr":"172.21.15.98:6825/1967099790","cluster_addr":"172.21.15.98:6827/1967099790","heartbeat_back_addr":"172.21.15.98:6831/1967099790","heartbeat_front_addr":"172.21.15.98:6829/1967099790","state":["exists","up"]},{"osd":1,"uuid":"bb3a68a5-c22f-442b-b292-7c272fe01ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":3571460482},{"type":"v1","addr":"172.21.15.98:6809","nonce":3571460482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":3571460482},{"type":"v1","addr":"172.21.15.98:6811","nonce":3571460482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":3571460482},{"type":"v1","addr":"172.21.15.98:6815","nonce":3571460482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":3571460482},{"type":"v1","addr":"172.21.15.98:6813","nonce":3571460482}]},"public_addr":"172.21.15.98:6809/3571460482","cluster_addr":"172.21.15.98:6811/3571460482","heartbeat_back_addr":"172.21.15.98:6815/3571460482","heartbeat_front_addr":"172.21.15.98:6813/3571460482","state":["exists","up"]},{"osd":2,"uuid":"c8429195-a480-409b-8e5f-8dc4c6abc0a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":2573210695},{"type":"v1","addr":"172.21.15.98:6801","nonce":2573210695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":2573210695},{"type":"v1","addr":"172.21.15.98:6803","nonce":2573210695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":2573210695},{"type":"v1","addr":"172.21.15.98:6807","nonce":2573210695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":2573210695},{"type":"v1","addr":"172.21.15.98:6805","nonce":2573210695}]},"public_addr":"172.21.15.98:6801/2573210695","cluster_addr":"172.21.15.98:6803/2573210695","heartbeat_back_addr":"172.21.15.98:6807/2573210695","heartbeat_front_addr":"172.21.15.98:6805/2573210695","state":["exists","up"]},{"osd":3,"uuid":"0e800d7b-096f-4f65-b3cc-c7cda3870de4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":3951374837},{"type":"v1","addr":"172.21.15.98:6817","nonce":3951374837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":3951374837},{"type":"v1","addr":"172.21.15.98:6819","nonce":3951374837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":3951374837},{"type":"v1","addr":"172.21.15.98:6823","nonce":3951374837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":3951374837},{"type":"v1","addr":"172.21.15.98:6821","nonce":3951374837}]},"public_addr":"172.21.15.98:6817/3951374837","cluster_addr":"172.21.15.98:6819/3951374837","heartbeat_back_addr":"172.21.15.98:6823/3951374837","heartbeat_front_addr":"172.21.15.98:6821/3951374837","state":["exists","up"]},{"osd":4,"uuid":"c7822e9b-8e29-48d9-b92a-e8f9c7bc5247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":724302036},{"type":"v1","addr":"172.21.15.135:6811","nonce":724302036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":724302036},{"type":"v1","addr":"172.21.15.135:6813","nonce":724302036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":724302036},{"type":"v1","addr":"172.21.15.135:6817","nonce":724302036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":724302036},{"type":"v1","addr":"172.21.15.135:6815","nonce":724302036}]},"public_addr":"172.21.15.135:6811/724302036","cluster_addr":"172.21.15.135:6813/724302036","heartbeat_back_addr":"172.21.15.135:6817/724302036","heartbeat_front_addr":"172.21.15.135:6815/724302036","state":["exists","up"]},{"osd":5,"uuid":"35805e02-484a-4404-a78f-aa44f4daa41f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3083482635},{"type":"v1","addr":"172.21.15.135:6803","nonce":3083482635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3083482635},{"type":"v1","addr":"172.21.15.135:6805","nonce":3083482635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3083482635},{"type":"v1","addr":"172.21.15.135:6809","nonce":3083482635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3083482635},{"type":"v1","addr":"172.21.15.135:6807","nonce":3083482635}]},"public_addr":"172.21.15.135:6803/3083482635","cluster_addr":"172.21.15.135:6805/3083482635","heartbeat_back_addr":"172.21.15.135:6809/3083482635","heartbeat_front_addr":"172.21.15.135:6807/3083482635","state":["exists","up"]},{"osd":6,"uuid":"6327ba84-aaeb-41fa-9717-188988ff2c4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3376376340},{"type":"v1","addr":"172.21.15.135:6819","nonce":3376376340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3376376340},{"type":"v1","addr":"172.21.15.135:6821","nonce":3376376340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":3376376340},{"type":"v1","addr":"172.21.15.135:6825","nonce":3376376340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3376376340},{"type":"v1","addr":"172.21.15.135:6823","nonce":3376376340}]},"public_addr":"172.21.15.135:6819/3376376340","cluster_addr":"172.21.15.135:6821/3376376340","heartbeat_back_addr":"172.21.15.135:6825/3376376340","heartbeat_front_addr":"172.21.15.135:6823/3376376340","state":["exists","up"]},{"osd":7,"uuid":"392d0958-dff9-4248-b3d8-a1201c10f354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2559837727},{"type":"v1","addr":"172.21.15.135:6827","nonce":2559837727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2559837727},{"type":"v1","addr":"172.21.15.135:6829","nonce":2559837727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":2559837727},{"type":"v1","addr":"172.21.15.135:6833","nonce":2559837727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2559837727},{"type":"v1","addr":"172.21.15.135:6831","nonce":2559837727}]},"public_addr":"172.21.15.135:6827/2559837727","cluster_addr":"172.21.15.135:6829/2559837727","heartbeat_back_addr":"172.21.15.135:6833/2559837727","heartbeat_front_addr":"172.21.15.135:6831/2559837727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.939904+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.717296+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.785817+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:30.211718+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.973359+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:30.250109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.699327+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:30.173063+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T15:38:25.707 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.706+0000 7fe1d1a6e640 1 -- 172.21.15.98:0/807496368 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fe1b8078850 msgr2=0x7fe1b807ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:25.707 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.706+0000 7fe1d1a6e640 1 --2- 172.21.15.98:0/807496368 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fe1b8078850 0x7fe1b807ad10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc033000 tx=0x7fe1bc004730 comp rx=0 tx=0).stop 2024-09-16T15:38:25.708 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.706+0000 7fe1d1a6e640 1 -- 172.21.15.98:0/807496368 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1cc15e0d0 msgr2=0x7fe1cc15c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:25.708 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.706+0000 7fe1d1a6e640 1 --2- 172.21.15.98:0/807496368 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1cc15e0d0 0x7fe1cc15c0d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe1c400cab0 tx=0x7fe1c400cf70 comp rx=0 tx=0).stop 2024-09-16T15:38:25.708 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.706+0000 7fe1d1a6e640 1 -- 172.21.15.98:0/807496368 shutdown_connections 2024-09-16T15:38:25.708 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.706+0000 7fe1d1a6e640 1 --2- 172.21.15.98:0/807496368 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1cc15e0d0 0x7fe1cc15c0d0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:25.708 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.706+0000 7fe1d1a6e640 1 --2- 172.21.15.98:0/807496368 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe1cc0d2050 0x7fe1cc09fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:25.708 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.706+0000 7fe1d1a6e640 1 --2- 172.21.15.98:0/807496368 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fe1b8078850 0x7fe1b807ad10 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:25.708 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.706+0000 7fe1d1a6e640 1 --2- 172.21.15.98:0/807496368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1cc0d1610 0x7fe1cc1f5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:25.708 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.706+0000 7fe1d1a6e640 1 -- 172.21.15.98:0/807496368 >> 172.21.15.98:0/807496368 conn(0x7fe1cc0d3fe0 msgr2=0x7fe1cc0b8e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:25.708 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.706+0000 7fe1d1a6e640 1 -- 172.21.15.98:0/807496368 shutdown_connections 2024-09-16T15:38:25.708 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.706+0000 7fe1d1a6e640 1 -- 172.21.15.98:0/807496368 wait complete. 2024-09-16T15:38:25.718 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-16T15:38:25.822 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.820+0000 7f4e40917640 1 -- 172.21.15.98:0/779583265 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4e3c06efa0 msgr2=0x7f4e3c0cdbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:25.822 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.820+0000 7f4e40917640 1 --2- 172.21.15.98:0/779583265 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4e3c06efa0 0x7f4e3c0cdbb0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c0af780 tx=0x7f4e3402a980 comp rx=0 tx=0).stop 2024-09-16T15:38:25.822 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.820+0000 7f4e40917640 1 -- 172.21.15.98:0/779583265 shutdown_connections 2024-09-16T15:38:25.822 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.820+0000 7f4e40917640 1 --2- 172.21.15.98:0/779583265 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4e3c06efa0 0x7f4e3c0cdbb0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:25.822 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.820+0000 7f4e40917640 1 --2- 172.21.15.98:0/779583265 >> v2:172.21.15.135:3300/0 conn(0x7f4e3c0cccd0 0x7f4e3c073440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:25.822 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.820+0000 7f4e40917640 1 -- 172.21.15.98:0/779583265 >> 172.21.15.98:0/779583265 conn(0x7f4e3c0b1840 msgr2=0x7f4e3c0b1c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:25.822 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.820+0000 7f4e40917640 1 -- 172.21.15.98:0/779583265 shutdown_connections 2024-09-16T15:38:25.822 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.821+0000 7f4e40917640 1 -- 172.21.15.98:0/779583265 wait complete. 2024-09-16T15:38:25.823 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.822+0000 7f4e40917640 1 Processor -- start 2024-09-16T15:38:25.823 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.822+0000 7f4e40917640 1 -- start start 2024-09-16T15:38:25.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.823+0000 7f4e40917640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4e3c06efa0 0x7f4e3c13bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:25.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.823+0000 7f4e40917640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4e3c0cccd0 0x7f4e3c0b3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:25.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.823+0000 7f4e40917640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e3c145750 0x7f4e3c0c54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:25.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.823+0000 7f4e40917640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4e3c0ce480 con 0x7f4e3c06efa0 2024-09-16T15:38:25.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.823+0000 7f4e40917640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4e3c0ce300 con 0x7f4e3c145750 2024-09-16T15:38:25.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.823+0000 7f4e40917640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f4e3c0ce600 con 0x7f4e3c0cccd0 2024-09-16T15:38:25.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.823+0000 7f4e3a59c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4e3c06efa0 0x7f4e3c13bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:25.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.823+0000 7f4e3a59c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4e3c06efa0 0x7f4e3c13bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40664/0 (socket says 172.21.15.98:40664) 2024-09-16T15:38:25.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.823+0000 7f4e3a59c640 1 -- 172.21.15.98:0/2947583773 learned_addr learned my addr 172.21.15.98:0/2947583773 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:25.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.823+0000 7f4e31d9b640 1 --2- 172.21.15.98:0/2947583773 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4e3c0cccd0 0x7f4e3c0b3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:25.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.823+0000 7f4e3ad9d640 1 --2- 172.21.15.98:0/2947583773 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e3c145750 0x7f4e3c0c54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:25.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.823+0000 7f4e3a59c640 1 -- 172.21.15.98:0/2947583773 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4e3c0cccd0 msgr2=0x7f4e3c0b3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:25.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.823+0000 7f4e3a59c640 1 --2- 172.21.15.98:0/2947583773 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4e3c0cccd0 0x7f4e3c0b3650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:25.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.823+0000 7f4e3a59c640 1 -- 172.21.15.98:0/2947583773 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e3c145750 msgr2=0x7f4e3c0c54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:25.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.823+0000 7f4e3a59c640 1 --2- 172.21.15.98:0/2947583773 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e3c145750 0x7f4e3c0c54a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:25.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.823+0000 7f4e3a59c640 1 -- 172.21.15.98:0/2947583773 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e3c0b40a0 con 0x7f4e3c06efa0 2024-09-16T15:38:25.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.823+0000 7f4e3a59c640 1 --2- 172.21.15.98:0/2947583773 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4e3c06efa0 0x7f4e3c13bcd0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c00b3f0 tx=0x7f4e2c00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:25.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.823+0000 7f4e337fe640 1 -- 172.21.15.98:0/2947583773 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e2c015020 con 0x7f4e3c06efa0 2024-09-16T15:38:25.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.823+0000 7f4e337fe640 1 -- 172.21.15.98:0/2947583773 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4e2c011920 con 0x7f4e3c06efa0 2024-09-16T15:38:25.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.823+0000 7f4e40917640 1 -- 172.21.15.98:0/2947583773 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e3c0b4380 con 0x7f4e3c06efa0 2024-09-16T15:38:25.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.824+0000 7f4e337fe640 1 -- 172.21.15.98:0/2947583773 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e2c011d70 con 0x7f4e3c06efa0 2024-09-16T15:38:25.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.824+0000 7f4e40917640 1 -- 172.21.15.98:0/2947583773 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e3c13ddc0 con 0x7f4e3c06efa0 2024-09-16T15:38:25.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.824+0000 7f4e40917640 1 -- 172.21.15.98:0/2947583773 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e3c0cdbb0 con 0x7f4e3c06efa0 2024-09-16T15:38:25.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.825+0000 7f4e337fe640 1 -- 172.21.15.98:0/2947583773 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7f4e2c018020 con 0x7f4e3c06efa0 2024-09-16T15:38:25.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.825+0000 7f4e337fe640 1 --2- 172.21.15.98:0/2947583773 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f4e1c078850 0x7f4e1c07ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:25.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.826+0000 7f4e337fe640 1 -- 172.21.15.98:0/2947583773 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f4e2c09a400 con 0x7f4e3c06efa0 2024-09-16T15:38:25.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.826+0000 7f4e31d9b640 1 --2- 172.21.15.98:0/2947583773 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f4e1c078850 0x7f4e1c07ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:25.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.826+0000 7f4e31d9b640 1 --2- 172.21.15.98:0/2947583773 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f4e1c078850 0x7f4e1c07ad10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c1f80c0 tx=0x7f4e2400b390 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:25.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:25.830+0000 7f4e337fe640 1 -- 172.21.15.98:0/2947583773 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7f4e2c01f030 con 0x7f4e3c06efa0 2024-09-16T15:38:26.046 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:26.045+0000 7f4e40917640 1 -- 172.21.15.98:0/2947583773 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f4e3c06aaf0 con 0x7f4e3c06efa0 2024-09-16T15:38:26.185 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:26.184+0000 7f4e337fe640 1 -- 172.21.15.98:0/2947583773 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v14) ==== 118+0+0 (secure 0 0 0) 0x7f4e2c0624b0 con 0x7f4e3c06efa0 2024-09-16T15:38:26.187 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:26.186+0000 7f4e40917640 1 -- 172.21.15.98:0/2947583773 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f4e1c078850 msgr2=0x7f4e1c07ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:26.188 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:26.186+0000 7f4e40917640 1 --2- 172.21.15.98:0/2947583773 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f4e1c078850 0x7f4e1c07ad10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c1f80c0 tx=0x7f4e2400b390 comp rx=0 tx=0).stop 2024-09-16T15:38:26.188 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:26.186+0000 7f4e40917640 1 -- 172.21.15.98:0/2947583773 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4e3c06efa0 msgr2=0x7f4e3c13bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:26.188 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:26.186+0000 7f4e40917640 1 --2- 172.21.15.98:0/2947583773 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4e3c06efa0 0x7f4e3c13bcd0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c00b3f0 tx=0x7f4e2c00b8b0 comp rx=0 tx=0).stop 2024-09-16T15:38:26.188 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:26.186+0000 7f4e40917640 1 -- 172.21.15.98:0/2947583773 shutdown_connections 2024-09-16T15:38:26.188 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:26.186+0000 7f4e40917640 1 --2- 172.21.15.98:0/2947583773 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f4e1c078850 0x7f4e1c07ad10 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:26.188 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:26.186+0000 7f4e40917640 1 --2- 172.21.15.98:0/2947583773 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e3c145750 0x7f4e3c0c54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:26.188 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:26.186+0000 7f4e40917640 1 --2- 172.21.15.98:0/2947583773 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f4e3c0cccd0 0x7f4e3c0b3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:26.188 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:26.186+0000 7f4e40917640 1 --2- 172.21.15.98:0/2947583773 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4e3c06efa0 0x7f4e3c13bcd0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:26.188 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:26.186+0000 7f4e40917640 1 -- 172.21.15.98:0/2947583773 >> 172.21.15.98:0/2947583773 conn(0x7f4e3c0b1840 msgr2=0x7f4e3c0b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:26.188 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:26.186+0000 7f4e40917640 1 -- 172.21.15.98:0/2947583773 shutdown_connections 2024-09-16T15:38:26.188 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:26.186+0000 7f4e40917640 1 -- 172.21.15.98:0/2947583773 wait complete. 2024-09-16T15:38:26.198 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-16T15:38:26.198 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-16T15:38:26.302 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:26.301+0000 7f5ab38ed640 1 -- 172.21.15.98:0/787596728 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5aac161590 msgr2=0x7f5aac0b6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:26.302 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:26.301+0000 7f5ab38ed640 1 --2- 172.21.15.98:0/787596728 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5aac161590 0x7f5aac0b6e00 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c005fd0 tx=0x7f5a9c02a8b0 comp rx=0 tx=0).stop 2024-09-16T15:38:26.302 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:26.301+0000 7f5ab38ed640 1 -- 172.21.15.98:0/787596728 shutdown_connections 2024-09-16T15:38:26.302 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:26.301+0000 7f5ab38ed640 1 --2- 172.21.15.98:0/787596728 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5aac0b5630 0x7f5aac0cf5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:26.302 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:26.301+0000 7f5ab38ed640 1 --2- 172.21.15.98:0/787596728 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5aac161590 0x7f5aac0b6e00 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:26.302 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:26.301+0000 7f5ab38ed640 1 -- 172.21.15.98:0/787596728 >> 172.21.15.98:0/787596728 conn(0x7f5aac0d3fb0 msgr2=0x7f5aac0d43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:26.302 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:26.301+0000 7f5ab38ed640 1 -- 172.21.15.98:0/787596728 shutdown_connections 2024-09-16T15:38:26.302 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:26.301+0000 7f5ab38ed640 1 -- 172.21.15.98:0/787596728 wait complete. 2024-09-16T15:38:26.303 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:26.302+0000 7f5ab38ed640 1 Processor -- start 2024-09-16T15:38:26.303 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:26.302+0000 7f5ab38ed640 1 -- start start 2024-09-16T15:38:26.305 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:26.303+0000 7f5ab38ed640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5aac0b5630 0x7f5aac1563e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:26.305 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:26.303+0000 7f5ab38ed640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5aac0b7340 0x7f5aac0cb110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:26.305 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:26.303+0000 7f5ab38ed640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5aac161590 0x7f5aac0cb650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:26.305 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:26.303+0000 7f5ab38ed640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5aac0cfe80 con 0x7f5aac0b7340 2024-09-16T15:38:26.305 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:26.303+0000 7f5ab38ed640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5aac0cfd00 con 0x7f5aac161590 2024-09-16T15:38:26.305 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:26.303+0000 7f5ab38ed640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f5aac162430 con 0x7f5aac0b5630 2024-09-16T15:38:26.305 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:26.303+0000 7f5ab0e88640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5aac0b7340 0x7f5aac0cb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:26.305 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:26.303+0000 7f5ab0e88640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5aac0b7340 0x7f5aac0cb110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40678/0 (socket says 172.21.15.98:40678) 2024-09-16T15:38:26.305 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:26.303+0000 7f5ab0e88640 1 -- 172.21.15.98:0/4003211732 learned_addr learned my addr 172.21.15.98:0/4003211732 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:26.305 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:26.303+0000 7f5ab1689640 1 --2- 172.21.15.98:0/4003211732 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5aac0b5630 0x7f5aac1563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:26.305 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:26.303+0000 7f5ab1e8a640 1 --2- 172.21.15.98:0/4003211732 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5aac161590 0x7f5aac0cb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:26.305 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:26.303+0000 7f5ab0e88640 1 -- 172.21.15.98:0/4003211732 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5aac0b5630 msgr2=0x7f5aac1563e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:26.306 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:26.303+0000 7f5ab0e88640 1 --2- 172.21.15.98:0/4003211732 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5aac0b5630 0x7f5aac1563e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:26.306 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:26.303+0000 7f5ab0e88640 1 -- 172.21.15.98:0/4003211732 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5aac161590 msgr2=0x7f5aac0cb650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:26.306 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:26.303+0000 7f5ab0e88640 1 --2- 172.21.15.98:0/4003211732 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5aac161590 0x7f5aac0cb650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:26.306 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:26.303+0000 7f5ab0e88640 1 -- 172.21.15.98:0/4003211732 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5aac15be50 con 0x7f5aac0b7340 2024-09-16T15:38:26.306 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:26.303+0000 7f5ab0e88640 1 --2- 172.21.15.98:0/4003211732 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5aac0b7340 0x7f5aac0cb110 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5aa000e9c0 tx=0x7f5aa000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:26.306 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:26.303+0000 7f5aa9ffb640 1 -- 172.21.15.98:0/4003211732 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aa000cd80 con 0x7f5aac0b7340 2024-09-16T15:38:26.306 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:26.304+0000 7f5aa9ffb640 1 -- 172.21.15.98:0/4003211732 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5aa0004020 con 0x7f5aac0b7340 2024-09-16T15:38:26.306 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:26.304+0000 7f5aa9ffb640 1 -- 172.21.15.98:0/4003211732 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aa0004450 con 0x7f5aac0b7340 2024-09-16T15:38:26.306 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:26.304+0000 7f5ab38ed640 1 -- 172.21.15.98:0/4003211732 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5aac15c130 con 0x7f5aac0b7340 2024-09-16T15:38:26.306 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:26.304+0000 7f5ab38ed640 1 -- 172.21.15.98:0/4003211732 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5aac15c6f0 con 0x7f5aac0b7340 2024-09-16T15:38:26.307 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:26.305+0000 7f5ab38ed640 1 -- 172.21.15.98:0/4003211732 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5aac15cbd0 con 0x7f5aac0b7340 2024-09-16T15:38:26.307 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:26.305+0000 7f5aa9ffb640 1 -- 172.21.15.98:0/4003211732 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7f5aa00035f0 con 0x7f5aac0b7340 2024-09-16T15:38:26.307 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:26.306+0000 7f5aa9ffb640 1 --2- 172.21.15.98:0/4003211732 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f5a98078850 0x7f5a9807ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:26.307 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:26.306+0000 7f5aa9ffb640 1 -- 172.21.15.98:0/4003211732 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f5aa009b270 con 0x7f5aac0b7340 2024-09-16T15:38:26.307 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:26.306+0000 7f5ab1689640 1 --2- 172.21.15.98:0/4003211732 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f5a98078850 0x7f5a9807ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:26.307 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:26.307+0000 7f5ab1689640 1 --2- 172.21.15.98:0/4003211732 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f5a98078850 0x7f5a9807ad10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c034000 tx=0x7f5a9c004ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:26.311 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:26.310+0000 7f5aa9ffb640 1 -- 172.21.15.98:0/4003211732 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7f5aac15cbd0 con 0x7f5aac0b7340 2024-09-16T15:38:26.524 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:26.523+0000 7f5ab38ed640 1 -- 172.21.15.98:0/4003211732 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f5aac1628b0 con 0x7f5aac0b7340 2024-09-16T15:38:27.189 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.188+0000 7f5aa9ffb640 1 -- 172.21.15.98:0/4003211732 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v15) ==== 122+0+0 (secure 0 0 0) 0x7f5aa0063290 con 0x7f5aac0b7340 2024-09-16T15:38:27.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.191+0000 7f5ab38ed640 1 -- 172.21.15.98:0/4003211732 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f5a98078850 msgr2=0x7f5a9807ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:27.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.191+0000 7f5ab38ed640 1 --2- 172.21.15.98:0/4003211732 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f5a98078850 0x7f5a9807ad10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c034000 tx=0x7f5a9c004ab0 comp rx=0 tx=0).stop 2024-09-16T15:38:27.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.191+0000 7f5ab38ed640 1 -- 172.21.15.98:0/4003211732 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5aac0b7340 msgr2=0x7f5aac0cb110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:27.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.191+0000 7f5ab38ed640 1 --2- 172.21.15.98:0/4003211732 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5aac0b7340 0x7f5aac0cb110 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5aa000e9c0 tx=0x7f5aa000ee80 comp rx=0 tx=0).stop 2024-09-16T15:38:27.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.191+0000 7f5ab38ed640 1 -- 172.21.15.98:0/4003211732 shutdown_connections 2024-09-16T15:38:27.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.191+0000 7f5ab38ed640 1 --2- 172.21.15.98:0/4003211732 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f5a98078850 0x7f5a9807ad10 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:27.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.191+0000 7f5ab38ed640 1 --2- 172.21.15.98:0/4003211732 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5aac161590 0x7f5aac0cb650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:27.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.191+0000 7f5ab38ed640 1 --2- 172.21.15.98:0/4003211732 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5aac0b7340 0x7f5aac0cb110 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:27.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.191+0000 7f5ab38ed640 1 --2- 172.21.15.98:0/4003211732 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5aac0b5630 0x7f5aac1563e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:27.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.191+0000 7f5ab38ed640 1 -- 172.21.15.98:0/4003211732 >> 172.21.15.98:0/4003211732 conn(0x7f5aac0d3fb0 msgr2=0x7f5aac0b7820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:27.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.191+0000 7f5ab38ed640 1 -- 172.21.15.98:0/4003211732 shutdown_connections 2024-09-16T15:38:27.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.191+0000 7f5ab38ed640 1 -- 172.21.15.98:0/4003211732 wait complete. 2024-09-16T15:38:27.204 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-16T15:38:27.204 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T15:38:27.308 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.307+0000 7f0eeadb4640 1 -- 172.21.15.98:0/1728302394 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ee4074150 msgr2=0x7f0ee4072ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:27.309 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.307+0000 7f0eeadb4640 1 --2- 172.21.15.98:0/1728302394 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ee4074150 0x7f0ee4072ba0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f0ed0005fd0 tx=0x7f0ed002a510 comp rx=0 tx=0).stop 2024-09-16T15:38:27.309 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.307+0000 7f0eeadb4640 1 -- 172.21.15.98:0/1728302394 shutdown_connections 2024-09-16T15:38:27.309 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.307+0000 7f0eeadb4640 1 --2- 172.21.15.98:0/1728302394 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ee4074150 0x7f0ee4072ba0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:27.309 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.307+0000 7f0eeadb4640 1 --2- 172.21.15.98:0/1728302394 >> v2:172.21.15.135:3300/0 conn(0x7f0ee40746a0 0x7f0ee40730e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:27.309 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.307+0000 7f0eeadb4640 1 -- 172.21.15.98:0/1728302394 >> 172.21.15.98:0/1728302394 conn(0x7f0ee40b1950 msgr2=0x7f0ee40b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:27.309 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.307+0000 7f0eeadb4640 1 -- 172.21.15.98:0/1728302394 shutdown_connections 2024-09-16T15:38:27.309 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.307+0000 7f0eeadb4640 1 -- 172.21.15.98:0/1728302394 wait complete. 2024-09-16T15:38:27.309 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.308+0000 7f0eeadb4640 1 Processor -- start 2024-09-16T15:38:27.310 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.308+0000 7f0eeadb4640 1 -- start start 2024-09-16T15:38:27.311 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.309+0000 7f0eeadb4640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ee4074150 0x7f0ee41f5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:27.312 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.309+0000 7f0eeadb4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ee40746a0 0x7f0ee41505d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:27.312 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.309+0000 7f0eeadb4640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ee40b43f0 0x7f0ee40af8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:27.312 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.309+0000 7f0eeadb4640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0ee40737a0 con 0x7f0ee40b43f0 2024-09-16T15:38:27.312 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.309+0000 7f0eeadb4640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0ee4073620 con 0x7f0ee40746a0 2024-09-16T15:38:27.312 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.309+0000 7f0eeadb4640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f0ee4073920 con 0x7f0ee4074150 2024-09-16T15:38:27.312 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.309+0000 7f0ee9351640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ee40b43f0 0x7f0ee40af8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:27.312 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.310+0000 7f0ee9351640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ee40b43f0 0x7f0ee40af8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40706/0 (socket says 172.21.15.98:40706) 2024-09-16T15:38:27.312 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.310+0000 7f0ee9351640 1 -- 172.21.15.98:0/768501575 learned_addr learned my addr 172.21.15.98:0/768501575 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:27.313 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.310+0000 7f0ee3fff640 1 --2- 172.21.15.98:0/768501575 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ee40746a0 0x7f0ee41505d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:27.313 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.310+0000 7f0ee8b50640 1 --2- 172.21.15.98:0/768501575 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ee4074150 0x7f0ee41f5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:27.313 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.310+0000 7f0ee9351640 1 -- 172.21.15.98:0/768501575 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ee4074150 msgr2=0x7f0ee41f5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:27.313 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.310+0000 7f0ee9351640 1 --2- 172.21.15.98:0/768501575 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ee4074150 0x7f0ee41f5e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:27.313 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.310+0000 7f0ee9351640 1 -- 172.21.15.98:0/768501575 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ee40746a0 msgr2=0x7f0ee41505d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:27.313 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.310+0000 7f0ee9351640 1 --2- 172.21.15.98:0/768501575 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ee40746a0 0x7f0ee41505d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:27.313 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.310+0000 7f0ee9351640 1 -- 172.21.15.98:0/768501575 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ee409d9f0 con 0x7f0ee40b43f0 2024-09-16T15:38:27.313 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.310+0000 7f0ee9351640 1 --2- 172.21.15.98:0/768501575 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ee40b43f0 0x7f0ee40af8c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f0edc00eb10 tx=0x7f0edc00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:27.313 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.310+0000 7f0ee17fa640 1 -- 172.21.15.98:0/768501575 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0edc004b20 con 0x7f0ee40b43f0 2024-09-16T15:38:27.313 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.310+0000 7f0ee17fa640 1 -- 172.21.15.98:0/768501575 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0edc004ce0 con 0x7f0ee40b43f0 2024-09-16T15:38:27.313 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.310+0000 7f0eeadb4640 1 -- 172.21.15.98:0/768501575 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ee41f64c0 con 0x7f0ee40b43f0 2024-09-16T15:38:27.313 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.310+0000 7f0ee17fa640 1 -- 172.21.15.98:0/768501575 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0edc005280 con 0x7f0ee40b43f0 2024-09-16T15:38:27.313 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.310+0000 7f0eeadb4640 1 -- 172.21.15.98:0/768501575 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ee41f6a80 con 0x7f0ee40b43f0 2024-09-16T15:38:27.314 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.311+0000 7f0eeadb4640 1 -- 172.21.15.98:0/768501575 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ee41f6cc0 con 0x7f0ee40b43f0 2024-09-16T15:38:27.314 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.312+0000 7f0ee17fa640 1 -- 172.21.15.98:0/768501575 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7f0edc005420 con 0x7f0ee40b43f0 2024-09-16T15:38:27.314 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.312+0000 7f0ee17fa640 1 --2- 172.21.15.98:0/768501575 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f0ec8078880 0x7f0ec807ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:27.315 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.312+0000 7f0ee17fa640 1 -- 172.21.15.98:0/768501575 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f0edc09b3f0 con 0x7f0ee40b43f0 2024-09-16T15:38:27.315 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.313+0000 7f0ee8b50640 1 --2- 172.21.15.98:0/768501575 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f0ec8078880 0x7f0ec807ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:27.315 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.313+0000 7f0ee8b50640 1 --2- 172.21.15.98:0/768501575 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f0ec8078880 0x7f0ec807ad40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0ed8001720 tx=0x7f0ed8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:27.317 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.317+0000 7f0ee17fa640 1 -- 172.21.15.98:0/768501575 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7f0ee41f6cc0 con 0x7f0ee40b43f0 2024-09-16T15:38:27.527 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.526+0000 7f0eeadb4640 1 -- 172.21.15.98:0/768501575 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0ee4073df0 con 0x7f0ee40b43f0 2024-09-16T15:38:27.527 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.526+0000 7f0ee17fa640 1 -- 172.21.15.98:0/768501575 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5229 (secure 0 0 0) 0x7f0edc0634a0 con 0x7f0ee40b43f0 2024-09-16T15:38:27.528 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:38:27.528 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":15,"btime":"2024-09-16T15:38:27:185206+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4804,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/1917138590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":1917138590},{"type":"v1","addr":"172.21.15.135:6836","nonce":1917138590}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4807,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2813663234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2813663234},{"type":"v1","addr":"172.21.15.135:6837","nonce":2813663234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4848,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6834/2449820374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":2449820374},{"type":"v1","addr":"172.21.15.98:6834","nonce":2449820374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T15:38:24.409442+0000","modified":"2024-09-16T15:38:26.524070+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4851},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4851":{"gid":4851,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.98:6835/1806390493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6833","nonce":1806390493},{"type":"v1","addr":"172.21.15.98:6835","nonce":1806390493}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4851,"qdb_cluster":[4851]},"id":2}]} 2024-09-16T15:38:27.528 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 15 2024-09-16T15:38:27.530 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.528+0000 7f0eeadb4640 1 -- 172.21.15.98:0/768501575 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f0ec8078880 msgr2=0x7f0ec807ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:27.530 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.528+0000 7f0eeadb4640 1 --2- 172.21.15.98:0/768501575 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f0ec8078880 0x7f0ec807ad40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0ed8001720 tx=0x7f0ed8009040 comp rx=0 tx=0).stop 2024-09-16T15:38:27.530 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.528+0000 7f0eeadb4640 1 -- 172.21.15.98:0/768501575 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ee40b43f0 msgr2=0x7f0ee40af8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:27.530 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.528+0000 7f0eeadb4640 1 --2- 172.21.15.98:0/768501575 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ee40b43f0 0x7f0ee40af8c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f0edc00eb10 tx=0x7f0edc00c2d0 comp rx=0 tx=0).stop 2024-09-16T15:38:27.530 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.529+0000 7f0eeadb4640 1 -- 172.21.15.98:0/768501575 shutdown_connections 2024-09-16T15:38:27.530 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.529+0000 7f0eeadb4640 1 --2- 172.21.15.98:0/768501575 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ee40b43f0 0x7f0ee40af8c0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:27.530 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.529+0000 7f0eeadb4640 1 --2- 172.21.15.98:0/768501575 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f0ec8078880 0x7f0ec807ad40 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:27.530 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.529+0000 7f0eeadb4640 1 --2- 172.21.15.98:0/768501575 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ee40746a0 0x7f0ee41505d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:27.530 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.529+0000 7f0eeadb4640 1 --2- 172.21.15.98:0/768501575 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f0ee4074150 0x7f0ee41f5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:27.530 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.529+0000 7f0eeadb4640 1 -- 172.21.15.98:0/768501575 >> 172.21.15.98:0/768501575 conn(0x7f0ee40b1950 msgr2=0x7f0ee40cce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:27.530 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.529+0000 7f0eeadb4640 1 -- 172.21.15.98:0/768501575 shutdown_connections 2024-09-16T15:38:27.531 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.529+0000 7f0eeadb4640 1 -- 172.21.15.98:0/768501575 wait complete. 2024-09-16T15:38:27.541 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T15:38:27.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.640+0000 7fc82546b640 1 -- 172.21.15.98:0/1807391526 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc8200cf170 msgr2=0x7fc820071bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:27.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.640+0000 7fc82546b640 1 --2- 172.21.15.98:0/1807391526 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc8200cf170 0x7fc820071bf0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc808009860 tx=0x7fc80802a510 comp rx=0 tx=0).stop 2024-09-16T15:38:27.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.640+0000 7fc82546b640 1 -- 172.21.15.98:0/1807391526 shutdown_connections 2024-09-16T15:38:27.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.640+0000 7fc82546b640 1 --2- 172.21.15.98:0/1807391526 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc8200cf170 0x7fc820071bf0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:27.642 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.640+0000 7fc82546b640 1 -- 172.21.15.98:0/1807391526 >> 172.21.15.98:0/1807391526 conn(0x7fc82006d230 msgr2=0x7fc8200688b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:27.642 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.640+0000 7fc82546b640 1 -- 172.21.15.98:0/1807391526 shutdown_connections 2024-09-16T15:38:27.642 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.640+0000 7fc82546b640 1 -- 172.21.15.98:0/1807391526 wait complete. 2024-09-16T15:38:27.642 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.641+0000 7fc82546b640 1 Processor -- start 2024-09-16T15:38:27.642 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.641+0000 7fc82546b640 1 -- start start 2024-09-16T15:38:27.644 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.642+0000 7fc82546b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc820071260 0x7fc8201f2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:27.644 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.642+0000 7fc82546b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc8200b73c0 0x7fc8200b4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:27.644 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.642+0000 7fc82546b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8200cf170 0x7fc8200c9b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:27.644 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.642+0000 7fc82546b640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc8200d2350 con 0x7fc8200b73c0 2024-09-16T15:38:27.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.642+0000 7fc82546b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc8200b79b0 con 0x7fc8200cf170 2024-09-16T15:38:27.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.642+0000 7fc82546b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fc8200d24d0 con 0x7fc820071260 2024-09-16T15:38:27.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.642+0000 7fc81e7fc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc8200b73c0 0x7fc8200b4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:27.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.642+0000 7fc81e7fc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc8200b73c0 0x7fc8200b4620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40720/0 (socket says 172.21.15.98:40720) 2024-09-16T15:38:27.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.642+0000 7fc81e7fc640 1 -- 172.21.15.98:0/69968012 learned_addr learned my addr 172.21.15.98:0/69968012 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:27.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.642+0000 7fc81effd640 1 --2- 172.21.15.98:0/69968012 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc820071260 0x7fc8201f2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:27.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.642+0000 7fc81f7fe640 1 --2- 172.21.15.98:0/69968012 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8200cf170 0x7fc8200c9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:27.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.643+0000 7fc81e7fc640 1 -- 172.21.15.98:0/69968012 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc820071260 msgr2=0x7fc8201f2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:27.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.643+0000 7fc81e7fc640 1 --2- 172.21.15.98:0/69968012 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc820071260 0x7fc8201f2080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:27.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.643+0000 7fc81e7fc640 1 -- 172.21.15.98:0/69968012 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8200cf170 msgr2=0x7fc8200c9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:27.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.643+0000 7fc81e7fc640 1 --2- 172.21.15.98:0/69968012 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8200cf170 0x7fc8200c9b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:27.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.643+0000 7fc81e7fc640 1 -- 172.21.15.98:0/69968012 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8200c7830 con 0x7fc8200b73c0 2024-09-16T15:38:27.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.643+0000 7fc81f7fe640 1 --2- 172.21.15.98:0/69968012 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8200cf170 0x7fc8200c9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T15:38:27.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.643+0000 7fc81e7fc640 1 --2- 172.21.15.98:0/69968012 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc8200b73c0 0x7fc8200b4620 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc808009980 tx=0x7fc808033ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:27.646 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.643+0000 7fc8177fe640 1 -- 172.21.15.98:0/69968012 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc808031b50 con 0x7fc8200b73c0 2024-09-16T15:38:27.646 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.643+0000 7fc8177fe640 1 -- 172.21.15.98:0/69968012 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc808031de0 con 0x7fc8200b73c0 2024-09-16T15:38:27.646 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.643+0000 7fc8177fe640 1 -- 172.21.15.98:0/69968012 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8080332d0 con 0x7fc8200b73c0 2024-09-16T15:38:27.646 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.643+0000 7fc82546b640 1 -- 172.21.15.98:0/69968012 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8200c7b10 con 0x7fc8200b73c0 2024-09-16T15:38:27.646 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.643+0000 7fc82546b640 1 -- 172.21.15.98:0/69968012 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8200c80d0 con 0x7fc8200b73c0 2024-09-16T15:38:27.647 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.644+0000 7fc82546b640 1 -- 172.21.15.98:0/69968012 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8200c75c0 con 0x7fc8200b73c0 2024-09-16T15:38:27.647 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.645+0000 7fc8177fe640 1 -- 172.21.15.98:0/69968012 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7fc808033470 con 0x7fc8200b73c0 2024-09-16T15:38:27.647 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.645+0000 7fc8177fe640 1 --2- 172.21.15.98:0/69968012 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fc800078850 0x7fc80007ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:27.647 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.645+0000 7fc8177fe640 1 -- 172.21.15.98:0/69968012 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fc8080bba10 con 0x7fc8200b73c0 2024-09-16T15:38:27.647 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.645+0000 7fc81effd640 1 --2- 172.21.15.98:0/69968012 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fc800078850 0x7fc80007ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:27.647 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.646+0000 7fc81effd640 1 --2- 172.21.15.98:0/69968012 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fc800078850 0x7fc80007ad10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc810001860 tx=0x7fc8100017d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:27.650 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.649+0000 7fc8177fe640 1 -- 172.21.15.98:0/69968012 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7fc80803f030 con 0x7fc8200b73c0 2024-09-16T15:38:27.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.826+0000 7fc82546b640 1 -- 172.21.15.98:0/69968012 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc8200c85f0 con 0x7fc8200b73c0 2024-09-16T15:38:27.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.827+0000 7fc8177fe640 1 -- 172.21.15.98:0/69968012 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16681 (secure 0 0 0) 0x7fc808084080 con 0x7fc8200b73c0 2024-09-16T15:38:27.828 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:38:27.829 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":34,"fsid":"52a38a45-21d2-4cb0-bb3a-4fb8be3a08df","created":"2024-09-16T15:37:20.387654+0000","modified":"2024-09-16T15:38:26.079177+0000","last_up_change":"2024-09-16T15:37:33.417470+0000","last_in_change":"2024-09-16T15:37:23.430578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T15:37:34.725090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-16T15:38:22.261968+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-16T15:38:23.379099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a2d61df4-2577-47e6-a4ac-c36bbb85ab8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1967099790},{"type":"v1","addr":"172.21.15.98:6825","nonce":1967099790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1967099790},{"type":"v1","addr":"172.21.15.98:6827","nonce":1967099790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":1967099790},{"type":"v1","addr":"172.21.15.98:6831","nonce":1967099790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1967099790},{"type":"v1","addr":"172.21.15.98:6829","nonce":1967099790}]},"public_addr":"172.21.15.98:6825/1967099790","cluster_addr":"172.21.15.98:6827/1967099790","heartbeat_back_addr":"172.21.15.98:6831/1967099790","heartbeat_front_addr":"172.21.15.98:6829/1967099790","state":["exists","up"]},{"osd":1,"uuid":"bb3a68a5-c22f-442b-b292-7c272fe01ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":3571460482},{"type":"v1","addr":"172.21.15.98:6809","nonce":3571460482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":3571460482},{"type":"v1","addr":"172.21.15.98:6811","nonce":3571460482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":3571460482},{"type":"v1","addr":"172.21.15.98:6815","nonce":3571460482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":3571460482},{"type":"v1","addr":"172.21.15.98:6813","nonce":3571460482}]},"public_addr":"172.21.15.98:6809/3571460482","cluster_addr":"172.21.15.98:6811/3571460482","heartbeat_back_addr":"172.21.15.98:6815/3571460482","heartbeat_front_addr":"172.21.15.98:6813/3571460482","state":["exists","up"]},{"osd":2,"uuid":"c8429195-a480-409b-8e5f-8dc4c6abc0a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":2573210695},{"type":"v1","addr":"172.21.15.98:6801","nonce":2573210695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":2573210695},{"type":"v1","addr":"172.21.15.98:6803","nonce":2573210695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":2573210695},{"type":"v1","addr":"172.21.15.98:6807","nonce":2573210695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":2573210695},{"type":"v1","addr":"172.21.15.98:6805","nonce":2573210695}]},"public_addr":"172.21.15.98:6801/2573210695","cluster_addr":"172.21.15.98:6803/2573210695","heartbeat_back_addr":"172.21.15.98:6807/2573210695","heartbeat_front_addr":"172.21.15.98:6805/2573210695","state":["exists","up"]},{"osd":3,"uuid":"0e800d7b-096f-4f65-b3cc-c7cda3870de4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":3951374837},{"type":"v1","addr":"172.21.15.98:6817","nonce":3951374837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":3951374837},{"type":"v1","addr":"172.21.15.98:6819","nonce":3951374837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":3951374837},{"type":"v1","addr":"172.21.15.98:6823","nonce":3951374837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":3951374837},{"type":"v1","addr":"172.21.15.98:6821","nonce":3951374837}]},"public_addr":"172.21.15.98:6817/3951374837","cluster_addr":"172.21.15.98:6819/3951374837","heartbeat_back_addr":"172.21.15.98:6823/3951374837","heartbeat_front_addr":"172.21.15.98:6821/3951374837","state":["exists","up"]},{"osd":4,"uuid":"c7822e9b-8e29-48d9-b92a-e8f9c7bc5247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":724302036},{"type":"v1","addr":"172.21.15.135:6811","nonce":724302036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":724302036},{"type":"v1","addr":"172.21.15.135:6813","nonce":724302036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":724302036},{"type":"v1","addr":"172.21.15.135:6817","nonce":724302036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":724302036},{"type":"v1","addr":"172.21.15.135:6815","nonce":724302036}]},"public_addr":"172.21.15.135:6811/724302036","cluster_addr":"172.21.15.135:6813/724302036","heartbeat_back_addr":"172.21.15.135:6817/724302036","heartbeat_front_addr":"172.21.15.135:6815/724302036","state":["exists","up"]},{"osd":5,"uuid":"35805e02-484a-4404-a78f-aa44f4daa41f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3083482635},{"type":"v1","addr":"172.21.15.135:6803","nonce":3083482635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3083482635},{"type":"v1","addr":"172.21.15.135:6805","nonce":3083482635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3083482635},{"type":"v1","addr":"172.21.15.135:6809","nonce":3083482635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3083482635},{"type":"v1","addr":"172.21.15.135:6807","nonce":3083482635}]},"public_addr":"172.21.15.135:6803/3083482635","cluster_addr":"172.21.15.135:6805/3083482635","heartbeat_back_addr":"172.21.15.135:6809/3083482635","heartbeat_front_addr":"172.21.15.135:6807/3083482635","state":["exists","up"]},{"osd":6,"uuid":"6327ba84-aaeb-41fa-9717-188988ff2c4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3376376340},{"type":"v1","addr":"172.21.15.135:6819","nonce":3376376340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3376376340},{"type":"v1","addr":"172.21.15.135:6821","nonce":3376376340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":3376376340},{"type":"v1","addr":"172.21.15.135:6825","nonce":3376376340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3376376340},{"type":"v1","addr":"172.21.15.135:6823","nonce":3376376340}]},"public_addr":"172.21.15.135:6819/3376376340","cluster_addr":"172.21.15.135:6821/3376376340","heartbeat_back_addr":"172.21.15.135:6825/3376376340","heartbeat_front_addr":"172.21.15.135:6823/3376376340","state":["exists","up"]},{"osd":7,"uuid":"392d0958-dff9-4248-b3d8-a1201c10f354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2559837727},{"type":"v1","addr":"172.21.15.135:6827","nonce":2559837727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2559837727},{"type":"v1","addr":"172.21.15.135:6829","nonce":2559837727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":2559837727},{"type":"v1","addr":"172.21.15.135:6833","nonce":2559837727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2559837727},{"type":"v1","addr":"172.21.15.135:6831","nonce":2559837727}]},"public_addr":"172.21.15.135:6827/2559837727","cluster_addr":"172.21.15.135:6829/2559837727","heartbeat_back_addr":"172.21.15.135:6833/2559837727","heartbeat_front_addr":"172.21.15.135:6831/2559837727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.939904+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.717296+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.785817+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:30.211718+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.973359+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:30.250109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.699327+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:30.173063+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T15:38:27.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.829+0000 7fc82546b640 1 -- 172.21.15.98:0/69968012 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fc800078850 msgr2=0x7fc80007ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:27.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.829+0000 7fc82546b640 1 --2- 172.21.15.98:0/69968012 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fc800078850 0x7fc80007ad10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc810001860 tx=0x7fc8100017d0 comp rx=0 tx=0).stop 2024-09-16T15:38:27.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.829+0000 7fc82546b640 1 -- 172.21.15.98:0/69968012 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc8200b73c0 msgr2=0x7fc8200b4620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:27.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.829+0000 7fc82546b640 1 --2- 172.21.15.98:0/69968012 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc8200b73c0 0x7fc8200b4620 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc808009980 tx=0x7fc808033ba0 comp rx=0 tx=0).stop 2024-09-16T15:38:27.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.830+0000 7fc82546b640 1 -- 172.21.15.98:0/69968012 shutdown_connections 2024-09-16T15:38:27.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.830+0000 7fc82546b640 1 --2- 172.21.15.98:0/69968012 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fc800078850 0x7fc80007ad10 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:27.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.830+0000 7fc82546b640 1 --2- 172.21.15.98:0/69968012 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8200cf170 0x7fc8200c9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:27.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.830+0000 7fc82546b640 1 --2- 172.21.15.98:0/69968012 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc8200b73c0 0x7fc8200b4620 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:27.832 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.830+0000 7fc82546b640 1 --2- 172.21.15.98:0/69968012 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc820071260 0x7fc8201f2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:27.832 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.830+0000 7fc82546b640 1 -- 172.21.15.98:0/69968012 >> 172.21.15.98:0/69968012 conn(0x7fc82006d230 msgr2=0x7fc82015ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:27.832 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.830+0000 7fc82546b640 1 -- 172.21.15.98:0/69968012 shutdown_connections 2024-09-16T15:38:27.832 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.830+0000 7fc82546b640 1 -- 172.21.15.98:0/69968012 wait complete. 2024-09-16T15:38:27.841 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-16T15:38:27.842 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T15:38:27.949 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.948+0000 7fb8df153640 1 -- 172.21.15.98:0/1258685718 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb8c4004080 msgr2=0x7fb8c4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:27.950 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.948+0000 7fb8df153640 1 --2- 172.21.15.98:0/1258685718 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb8c4004080 0x7fb8c4004800 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb8d80cea00 tx=0x7fb8c4005830 comp rx=0 tx=0).stop 2024-09-16T15:38:27.950 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.948+0000 7fb8dd6f0640 1 -- 172.21.15.98:0/1258685718 reap_dead start 2024-09-16T15:38:27.950 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.948+0000 7fb8df153640 1 -- 172.21.15.98:0/1258685718 shutdown_connections 2024-09-16T15:38:27.950 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.948+0000 7fb8df153640 1 -- 172.21.15.98:0/1258685718 >> 172.21.15.98:0/1258685718 conn(0x7fb8d806d230 msgr2=0x7fb8d80688b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:27.950 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.948+0000 7fb8df153640 1 -- 172.21.15.98:0/1258685718 shutdown_connections 2024-09-16T15:38:27.950 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.948+0000 7fb8df153640 1 -- 172.21.15.98:0/1258685718 wait complete. 2024-09-16T15:38:27.950 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.949+0000 7fb8df153640 1 Processor -- start 2024-09-16T15:38:27.951 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.949+0000 7fb8df153640 1 -- start start 2024-09-16T15:38:27.953 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.950+0000 7fb8df153640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb8c4004080 0x7fb8d81517a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:27.953 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.950+0000 7fb8df153640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb8d81f5650 0x7fb8d80b4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:27.953 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.950+0000 7fb8df153640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8d80b3580 0x7fb8d80b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:27.953 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.950+0000 7fb8df153640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb8d8071bf0 con 0x7fb8d81f5650 2024-09-16T15:38:27.953 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.950+0000 7fb8df153640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb8d80b79b0 con 0x7fb8d80b3580 2024-09-16T15:38:27.953 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.950+0000 7fb8df153640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fb8d8071d70 con 0x7fb8c4004080 2024-09-16T15:38:27.953 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.951+0000 7fb8d7fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb8d81f5650 0x7fb8d80b4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:27.953 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.951+0000 7fb8d7fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb8d81f5650 0x7fb8d80b4440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40736/0 (socket says 172.21.15.98:40736) 2024-09-16T15:38:27.953 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.951+0000 7fb8d7fff640 1 -- 172.21.15.98:0/3728184974 learned_addr learned my addr 172.21.15.98:0/3728184974 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:27.953 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.951+0000 7fb8dceef640 1 --2- 172.21.15.98:0/3728184974 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb8c4004080 0x7fb8d81517a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:27.953 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.951+0000 7fb8dd6f0640 1 --2- 172.21.15.98:0/3728184974 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8d80b3580 0x7fb8d80b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:27.954 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.951+0000 7fb8d7fff640 1 -- 172.21.15.98:0/3728184974 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb8c4004080 msgr2=0x7fb8d81517a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:27.954 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.951+0000 7fb8d7fff640 1 --2- 172.21.15.98:0/3728184974 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb8c4004080 0x7fb8d81517a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:27.954 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.951+0000 7fb8d7fff640 1 -- 172.21.15.98:0/3728184974 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8d80b3580 msgr2=0x7fb8d80b3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:27.954 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.951+0000 7fb8d7fff640 1 --2- 172.21.15.98:0/3728184974 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8d80b3580 0x7fb8d80b3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:27.954 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.951+0000 7fb8d7fff640 1 -- 172.21.15.98:0/3728184974 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8d81f5e30 con 0x7fb8d81f5650 2024-09-16T15:38:27.954 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.951+0000 7fb8d7fff640 1 --2- 172.21.15.98:0/3728184974 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb8d81f5650 0x7fb8d80b4440 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb8c800bbe0 tx=0x7fb8c8032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:27.954 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.951+0000 7fb8d57fa640 1 -- 172.21.15.98:0/3728184974 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c8041070 con 0x7fb8d81f5650 2024-09-16T15:38:27.954 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.951+0000 7fb8d57fa640 1 -- 172.21.15.98:0/3728184974 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb8c8032d60 con 0x7fb8d81f5650 2024-09-16T15:38:27.954 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.951+0000 7fb8df153640 1 -- 172.21.15.98:0/3728184974 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8d81f6110 con 0x7fb8d81f5650 2024-09-16T15:38:27.954 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.951+0000 7fb8d57fa640 1 -- 172.21.15.98:0/3728184974 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c8045660 con 0x7fb8d81f5650 2024-09-16T15:38:27.955 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.952+0000 7fb8df153640 1 -- 172.21.15.98:0/3728184974 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8d80c9370 con 0x7fb8d81f5650 2024-09-16T15:38:27.956 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.953+0000 7fb8df153640 1 -- 172.21.15.98:0/3728184974 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8d80d1830 con 0x7fb8d81f5650 2024-09-16T15:38:27.956 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.953+0000 7fb8d57fa640 1 -- 172.21.15.98:0/3728184974 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7fb8c804c060 con 0x7fb8d81f5650 2024-09-16T15:38:27.956 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.953+0000 7fb8d57fa640 1 --2- 172.21.15.98:0/3728184974 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fb8b8078850 0x7fb8b807ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:27.956 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.954+0000 7fb8d57fa640 1 -- 172.21.15.98:0/3728184974 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fb8c80bae70 con 0x7fb8d81f5650 2024-09-16T15:38:27.956 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.954+0000 7fb8dceef640 1 --2- 172.21.15.98:0/3728184974 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fb8b8078850 0x7fb8b807ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:27.956 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.954+0000 7fb8dceef640 1 --2- 172.21.15.98:0/3728184974 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fb8b8078850 0x7fb8b807ad10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb8c0000fb0 tx=0x7fb8c0001cb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:27.959 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:27.958+0000 7fb8d57fa640 1 -- 172.21.15.98:0/3728184974 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7fb8c8082e90 con 0x7fb8d81f5650 2024-09-16T15:38:28.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.131+0000 7fb8df153640 1 -- 172.21.15.98:0/3728184974 --> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb8d80c9100 con 0x7fb8b8078850 2024-09-16T15:38:28.136 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.136+0000 7fb8d57fa640 1 -- 172.21.15.98:0/3728184974 <== mgr.4100 v2:172.21.15.135:6800/699234772 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+239626 (secure 0 0 0) 0x7fb8d80c9100 con 0x7fb8b8078850 2024-09-16T15:38:28.139 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:38:28.140 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2024-09-16T15:38:28.142 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.138+0000 7fb8df153640 1 -- 172.21.15.98:0/3728184974 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fb8b8078850 msgr2=0x7fb8b807ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:28.142 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.138+0000 7fb8df153640 1 --2- 172.21.15.98:0/3728184974 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fb8b8078850 0x7fb8b807ad10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb8c0000fb0 tx=0x7fb8c0001cb0 comp rx=0 tx=0).stop 2024-09-16T15:38:28.142 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.138+0000 7fb8df153640 1 -- 172.21.15.98:0/3728184974 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb8d81f5650 msgr2=0x7fb8d80b4440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:28.142 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.138+0000 7fb8df153640 1 --2- 172.21.15.98:0/3728184974 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb8d81f5650 0x7fb8d80b4440 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb8c800bbe0 tx=0x7fb8c8032670 comp rx=0 tx=0).stop 2024-09-16T15:38:28.142 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.139+0000 7fb8df153640 1 -- 172.21.15.98:0/3728184974 shutdown_connections 2024-09-16T15:38:28.142 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.139+0000 7fb8df153640 1 --2- 172.21.15.98:0/3728184974 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fb8b8078850 0x7fb8b807ad10 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:28.142 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.139+0000 7fb8df153640 1 --2- 172.21.15.98:0/3728184974 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8d80b3580 0x7fb8d80b3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:28.142 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.139+0000 7fb8df153640 1 --2- 172.21.15.98:0/3728184974 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb8d81f5650 0x7fb8d80b4440 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:28.143 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.139+0000 7fb8df153640 1 --2- 172.21.15.98:0/3728184974 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb8c4004080 0x7fb8d81517a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:28.143 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.139+0000 7fb8df153640 1 -- 172.21.15.98:0/3728184974 >> 172.21.15.98:0/3728184974 conn(0x7fb8d806d230 msgr2=0x7fb8d81528c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:28.143 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.139+0000 7fb8df153640 1 -- 172.21.15.98:0/3728184974 shutdown_connections 2024-09-16T15:38:28.143 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.139+0000 7fb8df153640 1 -- 172.21.15.98:0/3728184974 wait complete. 2024-09-16T15:38:28.150 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2024-09-16T15:38:26.718484+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":56,"acting":56,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":8,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":220036,"kb_used_data":3768,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754684,"statfs":{"total":773094113280,"available":772868796416,"internally_reserved":0,"allocated":3858432,"data_stored":2158148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000849"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.063408+0000","last_change":"2024-09-16T15:38:23.063408+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.063408+0000","last_undegraded":"2024-09-16T15:38:23.063408+0000","last_fullsized":"2024-09-16T15:38:23.063408+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.060791+0000","last_change":"2024-09-16T15:38:23.060791+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.060791+0000","last_undegraded":"2024-09-16T15:38:23.060791+0000","last_fullsized":"2024-09-16T15:38:23.060791+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.064477+0000","last_change":"2024-09-16T15:38:23.064477+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.064477+0000","last_undegraded":"2024-09-16T15:38:23.064477+0000","last_fullsized":"2024-09-16T15:38:23.064477+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.060892+0000","last_change":"2024-09-16T15:38:23.060892+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.060892+0000","last_undegraded":"2024-09-16T15:38:23.060892+0000","last_fullsized":"2024-09-16T15:38:23.060892+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.300474+0000","last_change":"2024-09-16T15:38:23.300474+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.300474+0000","last_undegraded":"2024-09-16T15:38:23.300474+0000","last_fullsized":"2024-09-16T15:38:23.300474+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.300424+0000","last_change":"2024-09-16T15:38:23.300424+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.300424+0000","last_undegraded":"2024-09-16T15:38:23.300424+0000","last_fullsized":"2024-09-16T15:38:23.300424+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.064486+0000","last_change":"2024-09-16T15:38:23.064486+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.064486+0000","last_undegraded":"2024-09-16T15:38:23.064486+0000","last_fullsized":"2024-09-16T15:38:23.064486+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.299993+0000","last_change":"2024-09-16T15:38:23.299993+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.299993+0000","last_undegraded":"2024-09-16T15:38:23.299993+0000","last_fullsized":"2024-09-16T15:38:23.299993+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.066530+0000","last_change":"2024-09-16T15:38:23.066530+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.066530+0000","last_undegraded":"2024-09-16T15:38:23.066530+0000","last_fullsized":"2024-09-16T15:38:23.066530+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.066906+0000","last_change":"2024-09-16T15:38:23.066906+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.066906+0000","last_undegraded":"2024-09-16T15:38:23.066906+0000","last_fullsized":"2024-09-16T15:38:23.066906+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.064066+0000","last_change":"2024-09-16T15:38:23.064066+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.064066+0000","last_undegraded":"2024-09-16T15:38:23.064066+0000","last_fullsized":"2024-09-16T15:38:23.064066+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:23.050302+0000","last_change":"2024-09-16T15:38:23.050302+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.050302+0000","last_undegraded":"2024-09-16T15:38:23.050302+0000","last_fullsized":"2024-09-16T15:38:23.050302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.300000+0000","last_change":"2024-09-16T15:38:23.300000+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.300000+0000","last_undegraded":"2024-09-16T15:38:23.300000+0000","last_fullsized":"2024-09-16T15:38:23.300000+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.060721+0000","last_change":"2024-09-16T15:38:23.060721+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.060721+0000","last_undegraded":"2024-09-16T15:38:23.060721+0000","last_fullsized":"2024-09-16T15:38:23.060721+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.060776+0000","last_change":"2024-09-16T15:38:23.060776+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.060776+0000","last_undegraded":"2024-09-16T15:38:23.060776+0000","last_fullsized":"2024-09-16T15:38:23.060776+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.064497+0000","last_change":"2024-09-16T15:38:23.064497+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.064497+0000","last_undegraded":"2024-09-16T15:38:23.064497+0000","last_fullsized":"2024-09-16T15:38:23.064497+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.064522+0000","last_change":"2024-09-16T15:38:23.064522+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.064522+0000","last_undegraded":"2024-09-16T15:38:23.064522+0000","last_fullsized":"2024-09-16T15:38:23.064522+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.299985+0000","last_change":"2024-09-16T15:38:23.299985+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.299985+0000","last_undegraded":"2024-09-16T15:38:23.299985+0000","last_fullsized":"2024-09-16T15:38:23.299985+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.063716+0000","last_change":"2024-09-16T15:38:23.063716+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.063716+0000","last_undegraded":"2024-09-16T15:38:23.063716+0000","last_fullsized":"2024-09-16T15:38:23.063716+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.058527+0000","last_change":"2024-09-16T15:38:23.058527+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.058527+0000","last_undegraded":"2024-09-16T15:38:23.058527+0000","last_fullsized":"2024-09-16T15:38:23.058527+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.066530+0000","last_change":"2024-09-16T15:38:23.066530+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.066530+0000","last_undegraded":"2024-09-16T15:38:23.066530+0000","last_fullsized":"2024-09-16T15:38:23.066530+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.299990+0000","last_change":"2024-09-16T15:38:23.299990+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.299990+0000","last_undegraded":"2024-09-16T15:38:23.299990+0000","last_fullsized":"2024-09-16T15:38:23.299990+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.062871+0000","last_change":"2024-09-16T15:38:23.062871+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.062871+0000","last_undegraded":"2024-09-16T15:38:23.062871+0000","last_fullsized":"2024-09-16T15:38:23.062871+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.062781+0000","last_change":"2024-09-16T15:38:23.062781+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.062781+0000","last_undegraded":"2024-09-16T15:38:23.062781+0000","last_fullsized":"2024-09-16T15:38:23.062781+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:23.050302+0000","last_change":"2024-09-16T15:38:23.050302+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.050302+0000","last_undegraded":"2024-09-16T15:38:23.050302+0000","last_fullsized":"2024-09-16T15:38:23.050302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.066482+0000","last_change":"2024-09-16T15:38:23.066482+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.066482+0000","last_undegraded":"2024-09-16T15:38:23.066482+0000","last_fullsized":"2024-09-16T15:38:23.066482+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:23.050302+0000","last_change":"2024-09-16T15:38:23.050302+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.050302+0000","last_undegraded":"2024-09-16T15:38:23.050302+0000","last_fullsized":"2024-09-16T15:38:23.050302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:23.050302+0000","last_change":"2024-09-16T15:38:23.050302+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.050302+0000","last_undegraded":"2024-09-16T15:38:23.050302+0000","last_fullsized":"2024-09-16T15:38:23.050302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:23.050302+0000","last_change":"2024-09-16T15:38:23.050302+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.050302+0000","last_undegraded":"2024-09-16T15:38:23.050302+0000","last_fullsized":"2024-09-16T15:38:23.050302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.299981+0000","last_change":"2024-09-16T15:38:23.299981+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.299981+0000","last_undegraded":"2024-09-16T15:38:23.299981+0000","last_fullsized":"2024-09-16T15:38:23.299981+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.060778+0000","last_change":"2024-09-16T15:38:23.060778+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.060778+0000","last_undegraded":"2024-09-16T15:38:23.060778+0000","last_fullsized":"2024-09-16T15:38:23.060778+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.063322+0000","last_change":"2024-09-16T15:38:23.063322+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.063322+0000","last_undegraded":"2024-09-16T15:38:23.063322+0000","last_fullsized":"2024-09-16T15:38:23.063322+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":125,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T15:38:23.063511+0000","last_change":"2024-09-16T15:37:37.258601+0000","last_active":"2024-09-16T15:38:23.063511+0000","last_peered":"2024-09-16T15:38:23.063511+0000","last_clean":"2024-09-16T15:38:23.063511+0000","last_became_active":"2024-09-16T15:37:37.257584+0000","last_became_peered":"2024-09-16T15:37:37.257584+0000","last_unstale":"2024-09-16T15:38:23.063511+0000","last_undegraded":"2024-09-16T15:38:23.063511+0000","last_fullsized":"2024-09-16T15:38:23.063511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:35.447043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:35.447043+0000","last_clean_scrub_stamp":"2024-09-16T15:37:35.447043+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:43:17.464894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":54,"acting":54,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":339968,"data_stored":125085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509454,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":933888,"data_stored":715453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":327680,"data_stored":119268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509455,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":339968,"data_stored":125085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":339968,"data_stored":125085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509455,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27936,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343904,"statfs":{"total":96636764160,"available":96608157696,"internally_reserved":0,"allocated":921600,"data_stored":709636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509453,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":327680,"data_stored":119268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574861,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27360,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":327680,"data_stored":119268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T15:38:28.154 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T15:38:28.293 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.291+0000 7f29a9ac5640 1 -- 172.21.15.98:0/3219775482 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f29a415f5a0 msgr2=0x7f29a40b2440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:28.293 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.291+0000 7f29a9ac5640 1 --2- 172.21.15.98:0/3219775482 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f29a415f5a0 0x7f29a40b2440 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f29a40cfbb0 tx=0x7f299402a980 comp rx=0 tx=0).stop 2024-09-16T15:38:28.293 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.291+0000 7f29a9ac5640 1 -- 172.21.15.98:0/3219775482 shutdown_connections 2024-09-16T15:38:28.293 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.291+0000 7f29a9ac5640 1 --2- 172.21.15.98:0/3219775482 >> v2:172.21.15.135:3300/0 conn(0x7f29a40ccf00 0x7f29a40acd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:28.293 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.291+0000 7f29a9ac5640 1 --2- 172.21.15.98:0/3219775482 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f29a415f5a0 0x7f29a40b2440 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:28.293 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.291+0000 7f29a9ac5640 1 -- 172.21.15.98:0/3219775482 >> 172.21.15.98:0/3219775482 conn(0x7f29a40b1950 msgr2=0x7f29a40b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:28.293 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.291+0000 7f29a9ac5640 1 -- 172.21.15.98:0/3219775482 shutdown_connections 2024-09-16T15:38:28.293 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.291+0000 7f29a9ac5640 1 -- 172.21.15.98:0/3219775482 wait complete. 2024-09-16T15:38:28.293 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.292+0000 7f29a9ac5640 1 Processor -- start 2024-09-16T15:38:28.294 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.292+0000 7f29a9ac5640 1 -- start start 2024-09-16T15:38:28.295 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.293+0000 7f29a9ac5640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f29a40ad270 0x7f29a4143b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:28.295 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.293+0000 7f29a9ac5640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f29a40ccf00 0x7f29a4150fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:28.295 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.293+0000 7f29a9ac5640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f29a415f5a0 0x7f29a4152e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:28.296 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.293+0000 7f29a9ac5640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f29a406f160 con 0x7f29a40ad270 2024-09-16T15:38:28.296 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.293+0000 7f29a9ac5640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f29a406f2e0 con 0x7f29a40ccf00 2024-09-16T15:38:28.296 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.293+0000 7f29a9ac5640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f29a406f460 con 0x7f29a415f5a0 2024-09-16T15:38:28.296 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.293+0000 7f29a37fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f29a40ad270 0x7f29a4143b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:28.296 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.293+0000 7f29a37fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f29a40ad270 0x7f29a4143b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40750/0 (socket says 172.21.15.98:40750) 2024-09-16T15:38:28.296 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.293+0000 7f29a37fe640 1 -- 172.21.15.98:0/2492412180 learned_addr learned my addr 172.21.15.98:0/2492412180 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:28.296 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.293+0000 7f29a37fe640 1 -- 172.21.15.98:0/2492412180 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f29a415f5a0 msgr2=0x7f29a4152e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:28.296 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.293+0000 7f29a37fe640 1 --2- 172.21.15.98:0/2492412180 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f29a415f5a0 0x7f29a4152e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:28.296 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.293+0000 7f29a37fe640 1 -- 172.21.15.98:0/2492412180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f29a40ccf00 msgr2=0x7f29a4150fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:28.296 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.293+0000 7f29a37fe640 1 --2- 172.21.15.98:0/2492412180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f29a40ccf00 0x7f29a4150fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:28.296 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.293+0000 7f29a37fe640 1 -- 172.21.15.98:0/2492412180 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29a4151720 con 0x7f29a40ad270 2024-09-16T15:38:28.296 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.294+0000 7f29a37fe640 1 --2- 172.21.15.98:0/2492412180 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f29a40ad270 0x7f29a4143b80 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f2994000f80 tx=0x7f2994003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:28.296 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.294+0000 7f298bfff640 1 -- 172.21.15.98:0/2492412180 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2994034040 con 0x7f29a40ad270 2024-09-16T15:38:28.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.294+0000 7f298bfff640 1 -- 172.21.15.98:0/2492412180 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2994004640 con 0x7f29a40ad270 2024-09-16T15:38:28.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.294+0000 7f29a9ac5640 1 -- 172.21.15.98:0/2492412180 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29a4151a00 con 0x7f29a40ad270 2024-09-16T15:38:28.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.294+0000 7f298bfff640 1 -- 172.21.15.98:0/2492412180 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2994045480 con 0x7f29a40ad270 2024-09-16T15:38:28.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.294+0000 7f29a9ac5640 1 -- 172.21.15.98:0/2492412180 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29a4151fc0 con 0x7f29a40ad270 2024-09-16T15:38:28.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.295+0000 7f29a9ac5640 1 -- 172.21.15.98:0/2492412180 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29a406fa10 con 0x7f29a40ad270 2024-09-16T15:38:28.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.295+0000 7f298bfff640 1 -- 172.21.15.98:0/2492412180 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7f2994037020 con 0x7f29a40ad270 2024-09-16T15:38:28.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.296+0000 7f298bfff640 1 --2- 172.21.15.98:0/2492412180 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f2990078850 0x7f299007ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:28.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.296+0000 7f298bfff640 1 -- 172.21.15.98:0/2492412180 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f29940bc260 con 0x7f29a40ad270 2024-09-16T15:38:28.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.296+0000 7f29a2ffd640 1 --2- 172.21.15.98:0/2492412180 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f2990078850 0x7f299007ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:28.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.297+0000 7f29a2ffd640 1 --2- 172.21.15.98:0/2492412180 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f2990078850 0x7f299007ad10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f29a4153b50 tx=0x7f2998006c90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:28.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.300+0000 7f298bfff640 1 -- 172.21.15.98:0/2492412180 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7f2994044e90 con 0x7f29a40ad270 2024-09-16T15:38:28.472 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.471+0000 7f29a9ac5640 1 -- 172.21.15.98:0/2492412180 --> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f29a406aaf0 con 0x7f2990078850 2024-09-16T15:38:28.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.476+0000 7f298bfff640 1 -- 172.21.15.98:0/2492412180 <== mgr.4100 v2:172.21.15.135:6800/699234772 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+239626 (secure 0 0 0) 0x7f29a406aaf0 con 0x7f2990078850 2024-09-16T15:38:28.479 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:38:28.480 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2024-09-16T15:38:28.481 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.479+0000 7f29a9ac5640 1 -- 172.21.15.98:0/2492412180 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f2990078850 msgr2=0x7f299007ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:28.481 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.479+0000 7f29a9ac5640 1 --2- 172.21.15.98:0/2492412180 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f2990078850 0x7f299007ad10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f29a4153b50 tx=0x7f2998006c90 comp rx=0 tx=0).stop 2024-09-16T15:38:28.481 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.479+0000 7f29a9ac5640 1 -- 172.21.15.98:0/2492412180 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f29a40ad270 msgr2=0x7f29a4143b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:28.482 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.479+0000 7f29a9ac5640 1 --2- 172.21.15.98:0/2492412180 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f29a40ad270 0x7f29a4143b80 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f2994000f80 tx=0x7f2994003f90 comp rx=0 tx=0).stop 2024-09-16T15:38:28.482 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.479+0000 7f29a9ac5640 1 -- 172.21.15.98:0/2492412180 shutdown_connections 2024-09-16T15:38:28.482 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.479+0000 7f29a9ac5640 1 --2- 172.21.15.98:0/2492412180 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f29a415f5a0 0x7f29a4152e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:28.482 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.479+0000 7f29a9ac5640 1 --2- 172.21.15.98:0/2492412180 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f2990078850 0x7f299007ad10 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:28.482 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.479+0000 7f29a9ac5640 1 --2- 172.21.15.98:0/2492412180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f29a40ccf00 0x7f29a4150fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:28.482 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.479+0000 7f29a9ac5640 1 --2- 172.21.15.98:0/2492412180 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f29a40ad270 0x7f29a4143b80 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:28.482 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.479+0000 7f29a9ac5640 1 -- 172.21.15.98:0/2492412180 >> 172.21.15.98:0/2492412180 conn(0x7f29a40b1950 msgr2=0x7f29a409c740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:28.482 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.479+0000 7f29a9ac5640 1 -- 172.21.15.98:0/2492412180 shutdown_connections 2024-09-16T15:38:28.482 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.479+0000 7f29a9ac5640 1 -- 172.21.15.98:0/2492412180 wait complete. 2024-09-16T15:38:28.490 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2024-09-16T15:38:26.718484+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":56,"acting":56,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":8,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":220036,"kb_used_data":3768,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754684,"statfs":{"total":773094113280,"available":772868796416,"internally_reserved":0,"allocated":3858432,"data_stored":2158148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000849"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.063408+0000","last_change":"2024-09-16T15:38:23.063408+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.063408+0000","last_undegraded":"2024-09-16T15:38:23.063408+0000","last_fullsized":"2024-09-16T15:38:23.063408+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.060791+0000","last_change":"2024-09-16T15:38:23.060791+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.060791+0000","last_undegraded":"2024-09-16T15:38:23.060791+0000","last_fullsized":"2024-09-16T15:38:23.060791+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.064477+0000","last_change":"2024-09-16T15:38:23.064477+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.064477+0000","last_undegraded":"2024-09-16T15:38:23.064477+0000","last_fullsized":"2024-09-16T15:38:23.064477+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.060892+0000","last_change":"2024-09-16T15:38:23.060892+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.060892+0000","last_undegraded":"2024-09-16T15:38:23.060892+0000","last_fullsized":"2024-09-16T15:38:23.060892+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.300474+0000","last_change":"2024-09-16T15:38:23.300474+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.300474+0000","last_undegraded":"2024-09-16T15:38:23.300474+0000","last_fullsized":"2024-09-16T15:38:23.300474+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.300424+0000","last_change":"2024-09-16T15:38:23.300424+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.300424+0000","last_undegraded":"2024-09-16T15:38:23.300424+0000","last_fullsized":"2024-09-16T15:38:23.300424+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.064486+0000","last_change":"2024-09-16T15:38:23.064486+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.064486+0000","last_undegraded":"2024-09-16T15:38:23.064486+0000","last_fullsized":"2024-09-16T15:38:23.064486+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.299993+0000","last_change":"2024-09-16T15:38:23.299993+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.299993+0000","last_undegraded":"2024-09-16T15:38:23.299993+0000","last_fullsized":"2024-09-16T15:38:23.299993+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.066530+0000","last_change":"2024-09-16T15:38:23.066530+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.066530+0000","last_undegraded":"2024-09-16T15:38:23.066530+0000","last_fullsized":"2024-09-16T15:38:23.066530+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.066906+0000","last_change":"2024-09-16T15:38:23.066906+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.066906+0000","last_undegraded":"2024-09-16T15:38:23.066906+0000","last_fullsized":"2024-09-16T15:38:23.066906+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.064066+0000","last_change":"2024-09-16T15:38:23.064066+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.064066+0000","last_undegraded":"2024-09-16T15:38:23.064066+0000","last_fullsized":"2024-09-16T15:38:23.064066+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:23.050302+0000","last_change":"2024-09-16T15:38:23.050302+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.050302+0000","last_undegraded":"2024-09-16T15:38:23.050302+0000","last_fullsized":"2024-09-16T15:38:23.050302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.300000+0000","last_change":"2024-09-16T15:38:23.300000+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.300000+0000","last_undegraded":"2024-09-16T15:38:23.300000+0000","last_fullsized":"2024-09-16T15:38:23.300000+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.060721+0000","last_change":"2024-09-16T15:38:23.060721+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.060721+0000","last_undegraded":"2024-09-16T15:38:23.060721+0000","last_fullsized":"2024-09-16T15:38:23.060721+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.060776+0000","last_change":"2024-09-16T15:38:23.060776+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.060776+0000","last_undegraded":"2024-09-16T15:38:23.060776+0000","last_fullsized":"2024-09-16T15:38:23.060776+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.064497+0000","last_change":"2024-09-16T15:38:23.064497+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.064497+0000","last_undegraded":"2024-09-16T15:38:23.064497+0000","last_fullsized":"2024-09-16T15:38:23.064497+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.064522+0000","last_change":"2024-09-16T15:38:23.064522+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.064522+0000","last_undegraded":"2024-09-16T15:38:23.064522+0000","last_fullsized":"2024-09-16T15:38:23.064522+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.299985+0000","last_change":"2024-09-16T15:38:23.299985+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.299985+0000","last_undegraded":"2024-09-16T15:38:23.299985+0000","last_fullsized":"2024-09-16T15:38:23.299985+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.063716+0000","last_change":"2024-09-16T15:38:23.063716+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.063716+0000","last_undegraded":"2024-09-16T15:38:23.063716+0000","last_fullsized":"2024-09-16T15:38:23.063716+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.058527+0000","last_change":"2024-09-16T15:38:23.058527+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.058527+0000","last_undegraded":"2024-09-16T15:38:23.058527+0000","last_fullsized":"2024-09-16T15:38:23.058527+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.066530+0000","last_change":"2024-09-16T15:38:23.066530+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.066530+0000","last_undegraded":"2024-09-16T15:38:23.066530+0000","last_fullsized":"2024-09-16T15:38:23.066530+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.299990+0000","last_change":"2024-09-16T15:38:23.299990+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.299990+0000","last_undegraded":"2024-09-16T15:38:23.299990+0000","last_fullsized":"2024-09-16T15:38:23.299990+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.062871+0000","last_change":"2024-09-16T15:38:23.062871+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.062871+0000","last_undegraded":"2024-09-16T15:38:23.062871+0000","last_fullsized":"2024-09-16T15:38:23.062871+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.062781+0000","last_change":"2024-09-16T15:38:23.062781+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.062781+0000","last_undegraded":"2024-09-16T15:38:23.062781+0000","last_fullsized":"2024-09-16T15:38:23.062781+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:23.050302+0000","last_change":"2024-09-16T15:38:23.050302+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.050302+0000","last_undegraded":"2024-09-16T15:38:23.050302+0000","last_fullsized":"2024-09-16T15:38:23.050302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.066482+0000","last_change":"2024-09-16T15:38:23.066482+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.066482+0000","last_undegraded":"2024-09-16T15:38:23.066482+0000","last_fullsized":"2024-09-16T15:38:23.066482+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:23.050302+0000","last_change":"2024-09-16T15:38:23.050302+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.050302+0000","last_undegraded":"2024-09-16T15:38:23.050302+0000","last_fullsized":"2024-09-16T15:38:23.050302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:23.050302+0000","last_change":"2024-09-16T15:38:23.050302+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.050302+0000","last_undegraded":"2024-09-16T15:38:23.050302+0000","last_fullsized":"2024-09-16T15:38:23.050302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:23.050302+0000","last_change":"2024-09-16T15:38:23.050302+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.050302+0000","last_undegraded":"2024-09-16T15:38:23.050302+0000","last_fullsized":"2024-09-16T15:38:23.050302+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.299981+0000","last_change":"2024-09-16T15:38:23.299981+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.299981+0000","last_undegraded":"2024-09-16T15:38:23.299981+0000","last_fullsized":"2024-09-16T15:38:23.299981+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.060778+0000","last_change":"2024-09-16T15:38:23.060778+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.060778+0000","last_undegraded":"2024-09-16T15:38:23.060778+0000","last_fullsized":"2024-09-16T15:38:23.060778+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.063322+0000","last_change":"2024-09-16T15:38:23.063322+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.063322+0000","last_undegraded":"2024-09-16T15:38:23.063322+0000","last_fullsized":"2024-09-16T15:38:23.063322+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":125,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T15:38:23.063511+0000","last_change":"2024-09-16T15:37:37.258601+0000","last_active":"2024-09-16T15:38:23.063511+0000","last_peered":"2024-09-16T15:38:23.063511+0000","last_clean":"2024-09-16T15:38:23.063511+0000","last_became_active":"2024-09-16T15:37:37.257584+0000","last_became_peered":"2024-09-16T15:37:37.257584+0000","last_unstale":"2024-09-16T15:38:23.063511+0000","last_undegraded":"2024-09-16T15:38:23.063511+0000","last_fullsized":"2024-09-16T15:38:23.063511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:35.447043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:35.447043+0000","last_clean_scrub_stamp":"2024-09-16T15:37:35.447043+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:43:17.464894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":54,"acting":54,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":339968,"data_stored":125085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509454,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":933888,"data_stored":715453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":327680,"data_stored":119268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509455,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":339968,"data_stored":125085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":339968,"data_stored":125085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509455,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27936,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343904,"statfs":{"total":96636764160,"available":96608157696,"internally_reserved":0,"allocated":921600,"data_stored":709636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509453,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":327680,"data_stored":119268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574861,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27360,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":327680,"data_stored":119268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T15:38:28.494 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T15:38:28.633 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.632+0000 7fdcce5bc640 1 -- 172.21.15.98:0/2496719373 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdcc81445d0 msgr2=0x7fdcc80cebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:28.633 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.632+0000 7fdcce5bc640 1 --2- 172.21.15.98:0/2496719373 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdcc81445d0 0x7fdcc80cebf0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fdcb8009860 tx=0x7fdcb802a5d0 comp rx=0 tx=0).stop 2024-09-16T15:38:28.633 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.632+0000 7fdcce5bc640 1 -- 172.21.15.98:0/2496719373 shutdown_connections 2024-09-16T15:38:28.633 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.632+0000 7fdcce5bc640 1 --2- 172.21.15.98:0/2496719373 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdcc81445d0 0x7fdcc80cebf0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:28.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.632+0000 7fdcce5bc640 1 -- 172.21.15.98:0/2496719373 >> 172.21.15.98:0/2496719373 conn(0x7fdcc80b1950 msgr2=0x7fdcc80b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:28.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.632+0000 7fdcce5bc640 1 -- 172.21.15.98:0/2496719373 shutdown_connections 2024-09-16T15:38:28.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.632+0000 7fdcce5bc640 1 -- 172.21.15.98:0/2496719373 wait complete. 2024-09-16T15:38:28.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.633+0000 7fdcce5bc640 1 Processor -- start 2024-09-16T15:38:28.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.633+0000 7fdcce5bc640 1 -- start start 2024-09-16T15:38:28.637 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.634+0000 7fdcce5bc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdcc80b4ca0 0x7fdcc813a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:28.637 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.634+0000 7fdcce5bc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdcc80ccfd0 0x7fdcc813cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:28.637 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.634+0000 7fdcce5bc640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdcc81445d0 0x7fdcc81392b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:28.637 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.634+0000 7fdcce5bc640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fdcc8073b30 con 0x7fdcc80b4ca0 2024-09-16T15:38:28.637 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.634+0000 7fdcce5bc640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdcc80739b0 con 0x7fdcc80ccfd0 2024-09-16T15:38:28.637 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.634+0000 7fdcce5bc640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fdcc8073cb0 con 0x7fdcc81445d0 2024-09-16T15:38:28.637 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.634+0000 7fdcc7fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdcc80b4ca0 0x7fdcc813a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:28.637 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.634+0000 7fdcc7fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdcc80b4ca0 0x7fdcc813a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40776/0 (socket says 172.21.15.98:40776) 2024-09-16T15:38:28.637 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.634+0000 7fdcc7fff640 1 -- 172.21.15.98:0/1621426830 learned_addr learned my addr 172.21.15.98:0/1621426830 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:28.637 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.634+0000 7fdcccb59640 1 --2- 172.21.15.98:0/1621426830 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdcc81445d0 0x7fdcc81392b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:28.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.634+0000 7fdcc77fe640 1 --2- 172.21.15.98:0/1621426830 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdcc80ccfd0 0x7fdcc813cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:28.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.635+0000 7fdcc7fff640 1 -- 172.21.15.98:0/1621426830 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdcc81445d0 msgr2=0x7fdcc81392b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:28.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.635+0000 7fdcc7fff640 1 --2- 172.21.15.98:0/1621426830 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdcc81445d0 0x7fdcc81392b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:28.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.635+0000 7fdcc7fff640 1 -- 172.21.15.98:0/1621426830 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdcc80ccfd0 msgr2=0x7fdcc813cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:28.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.635+0000 7fdcc7fff640 1 --2- 172.21.15.98:0/1621426830 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdcc80ccfd0 0x7fdcc813cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:28.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.635+0000 7fdcc7fff640 1 -- 172.21.15.98:0/1621426830 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcc8140550 con 0x7fdcc80b4ca0 2024-09-16T15:38:28.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.635+0000 7fdcccb59640 1 --2- 172.21.15.98:0/1621426830 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdcc81445d0 0x7fdcc81392b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T15:38:28.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.635+0000 7fdcc77fe640 1 --2- 172.21.15.98:0/1621426830 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdcc80ccfd0 0x7fdcc813cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T15:38:28.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.635+0000 7fdcc7fff640 1 --2- 172.21.15.98:0/1621426830 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdcc80b4ca0 0x7fdcc813a520 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fdcb8009780 tx=0x7fdcb8033ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:28.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.635+0000 7fdcc4ff9640 1 -- 172.21.15.98:0/1621426830 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb8031b50 con 0x7fdcc80b4ca0 2024-09-16T15:38:28.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.635+0000 7fdcc4ff9640 1 -- 172.21.15.98:0/1621426830 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdcb8031e00 con 0x7fdcc80b4ca0 2024-09-16T15:38:28.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.635+0000 7fdcc4ff9640 1 -- 172.21.15.98:0/1621426830 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb8005280 con 0x7fdcc80b4ca0 2024-09-16T15:38:28.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.635+0000 7fdcce5bc640 1 -- 172.21.15.98:0/1621426830 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcc809afe0 con 0x7fdcc80b4ca0 2024-09-16T15:38:28.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.635+0000 7fdcce5bc640 1 -- 172.21.15.98:0/1621426830 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcc809b5a0 con 0x7fdcc80b4ca0 2024-09-16T15:38:28.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.636+0000 7fdcce5bc640 1 -- 172.21.15.98:0/1621426830 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcc80b3f00 con 0x7fdcc80b4ca0 2024-09-16T15:38:28.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.637+0000 7fdcc4ff9640 1 -- 172.21.15.98:0/1621426830 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7fdcb8005420 con 0x7fdcc80b4ca0 2024-09-16T15:38:28.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.637+0000 7fdcc4ff9640 1 --2- 172.21.15.98:0/1621426830 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fdcb4078850 0x7fdcb407ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:28.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.637+0000 7fdcc4ff9640 1 -- 172.21.15.98:0/1621426830 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fdcb80bb900 con 0x7fdcc80b4ca0 2024-09-16T15:38:28.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.637+0000 7fdcc77fe640 1 --2- 172.21.15.98:0/1621426830 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fdcb4078850 0x7fdcb407ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:28.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.638+0000 7fdcc77fe640 1 --2- 172.21.15.98:0/1621426830 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fdcb4078850 0x7fdcb407ad10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc007a50 tx=0x7fdcbc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:28.642 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.641+0000 7fdcc4ff9640 1 -- 172.21.15.98:0/1621426830 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7fdcc80b3f00 con 0x7fdcc80b4ca0 2024-09-16T15:38:28.814 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.813+0000 7fdcce5bc640 1 -- 172.21.15.98:0/1621426830 --> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdcc8074610 con 0x7fdcb4078850 2024-09-16T15:38:28.818 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.818+0000 7fdcc4ff9640 1 -- 172.21.15.98:0/1621426830 <== mgr.4100 v2:172.21.15.135:6800/699234772 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+241492 (secure 0 0 0) 0x7fdcc8074610 con 0x7fdcb4078850 2024-09-16T15:38:28.821 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:38:28.822 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2024-09-16T15:38:28.824 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.820+0000 7fdcce5bc640 1 -- 172.21.15.98:0/1621426830 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fdcb4078850 msgr2=0x7fdcb407ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:28.824 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.820+0000 7fdcce5bc640 1 --2- 172.21.15.98:0/1621426830 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fdcb4078850 0x7fdcb407ad10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc007a50 tx=0x7fdcbc009040 comp rx=0 tx=0).stop 2024-09-16T15:38:28.824 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.820+0000 7fdcce5bc640 1 -- 172.21.15.98:0/1621426830 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdcc80b4ca0 msgr2=0x7fdcc813a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:28.824 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.820+0000 7fdcce5bc640 1 --2- 172.21.15.98:0/1621426830 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdcc80b4ca0 0x7fdcc813a520 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fdcb8009780 tx=0x7fdcb8033ba0 comp rx=0 tx=0).stop 2024-09-16T15:38:28.824 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.820+0000 7fdcce5bc640 1 -- 172.21.15.98:0/1621426830 shutdown_connections 2024-09-16T15:38:28.824 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.820+0000 7fdcce5bc640 1 --2- 172.21.15.98:0/1621426830 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fdcc81445d0 0x7fdcc81392b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:28.824 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.820+0000 7fdcce5bc640 1 --2- 172.21.15.98:0/1621426830 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fdcb4078850 0x7fdcb407ad10 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:28.824 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.820+0000 7fdcce5bc640 1 --2- 172.21.15.98:0/1621426830 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdcc80ccfd0 0x7fdcc813cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:28.824 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.820+0000 7fdcce5bc640 1 --2- 172.21.15.98:0/1621426830 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdcc80b4ca0 0x7fdcc813a520 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:28.824 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.820+0000 7fdcce5bc640 1 -- 172.21.15.98:0/1621426830 >> 172.21.15.98:0/1621426830 conn(0x7fdcc80b1950 msgr2=0x7fdcc806f940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:28.824 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.821+0000 7fdcce5bc640 1 -- 172.21.15.98:0/1621426830 shutdown_connections 2024-09-16T15:38:28.824 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.821+0000 7fdcce5bc640 1 -- 172.21.15.98:0/1621426830 wait complete. 2024-09-16T15:38:28.833 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2024-09-16T15:38:28.718881+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591980,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":110,"num_write_kb":1631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80,"ondisk_log_size":80,"up":80,"acting":80,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":23,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220088,"kb_used_data":3828,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754632,"statfs":{"total":773094113280,"available":772868743168,"internally_reserved":0,"allocated":3919872,"data_stored":2184927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1612,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.663879"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:26.083635+0000","last_change":"2024-09-16T15:38:25.081610+0000","last_active":"2024-09-16T15:38:26.083635+0000","last_peered":"2024-09-16T15:38:26.083635+0000","last_clean":"2024-09-16T15:38:26.083635+0000","last_became_active":"2024-09-16T15:38:25.081334+0000","last_became_peered":"2024-09-16T15:38:25.081334+0000","last_unstale":"2024-09-16T15:38:26.083635+0000","last_undegraded":"2024-09-16T15:38:26.083635+0000","last_fullsized":"2024-09-16T15:38:26.083635+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:21:16.692843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:26.084129+0000","last_change":"2024-09-16T15:38:25.091716+0000","last_active":"2024-09-16T15:38:26.084129+0000","last_peered":"2024-09-16T15:38:26.084129+0000","last_clean":"2024-09-16T15:38:26.084129+0000","last_became_active":"2024-09-16T15:38:25.091452+0000","last_became_peered":"2024-09-16T15:38:25.091452+0000","last_unstale":"2024-09-16T15:38:26.084129+0000","last_undegraded":"2024-09-16T15:38:26.084129+0000","last_fullsized":"2024-09-16T15:38:26.084129+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:12:59.070266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:26.083728+0000","last_change":"2024-09-16T15:38:25.086524+0000","last_active":"2024-09-16T15:38:26.083728+0000","last_peered":"2024-09-16T15:38:26.083728+0000","last_clean":"2024-09-16T15:38:26.083728+0000","last_became_active":"2024-09-16T15:38:25.084686+0000","last_became_peered":"2024-09-16T15:38:25.084686+0000","last_unstale":"2024-09-16T15:38:26.083728+0000","last_undegraded":"2024-09-16T15:38:26.083728+0000","last_fullsized":"2024-09-16T15:38:26.083728+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:29:31.900295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:26.084265+0000","last_change":"2024-09-16T15:38:25.098781+0000","last_active":"2024-09-16T15:38:26.084265+0000","last_peered":"2024-09-16T15:38:26.084265+0000","last_clean":"2024-09-16T15:38:26.084265+0000","last_became_active":"2024-09-16T15:38:25.098502+0000","last_became_peered":"2024-09-16T15:38:25.098502+0000","last_unstale":"2024-09-16T15:38:26.084265+0000","last_undegraded":"2024-09-16T15:38:26.084265+0000","last_fullsized":"2024-09-16T15:38:26.084265+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:28:29.645680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.063408+0000","last_change":"2024-09-16T15:38:23.063408+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.063408+0000","last_undegraded":"2024-09-16T15:38:23.063408+0000","last_fullsized":"2024-09-16T15:38:23.063408+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.060791+0000","last_change":"2024-09-16T15:38:23.060791+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.060791+0000","last_undegraded":"2024-09-16T15:38:23.060791+0000","last_fullsized":"2024-09-16T15:38:23.060791+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.064477+0000","last_change":"2024-09-16T15:38:23.064477+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.064477+0000","last_undegraded":"2024-09-16T15:38:23.064477+0000","last_fullsized":"2024-09-16T15:38:23.064477+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.060892+0000","last_change":"2024-09-16T15:38:23.060892+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.060892+0000","last_undegraded":"2024-09-16T15:38:23.060892+0000","last_fullsized":"2024-09-16T15:38:23.060892+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.300474+0000","last_change":"2024-09-16T15:38:23.300474+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.300474+0000","last_undegraded":"2024-09-16T15:38:23.300474+0000","last_fullsized":"2024-09-16T15:38:23.300474+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.300424+0000","last_change":"2024-09-16T15:38:23.300424+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.300424+0000","last_undegraded":"2024-09-16T15:38:23.300424+0000","last_fullsized":"2024-09-16T15:38:23.300424+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.064486+0000","last_change":"2024-09-16T15:38:23.064486+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.064486+0000","last_undegraded":"2024-09-16T15:38:23.064486+0000","last_fullsized":"2024-09-16T15:38:23.064486+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.299993+0000","last_change":"2024-09-16T15:38:23.299993+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.299993+0000","last_undegraded":"2024-09-16T15:38:23.299993+0000","last_fullsized":"2024-09-16T15:38:23.299993+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.066530+0000","last_change":"2024-09-16T15:38:23.066530+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.066530+0000","last_undegraded":"2024-09-16T15:38:23.066530+0000","last_fullsized":"2024-09-16T15:38:23.066530+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.066906+0000","last_change":"2024-09-16T15:38:23.066906+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.066906+0000","last_undegraded":"2024-09-16T15:38:23.066906+0000","last_fullsized":"2024-09-16T15:38:23.066906+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.064066+0000","last_change":"2024-09-16T15:38:23.064066+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.064066+0000","last_undegraded":"2024-09-16T15:38:23.064066+0000","last_fullsized":"2024-09-16T15:38:23.064066+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:26.084231+0000","last_change":"2024-09-16T15:38:24.070463+0000","last_active":"2024-09-16T15:38:26.084231+0000","last_peered":"2024-09-16T15:38:26.084231+0000","last_clean":"2024-09-16T15:38:26.084231+0000","last_became_active":"2024-09-16T15:38:24.070192+0000","last_became_peered":"2024-09-16T15:38:24.070192+0000","last_unstale":"2024-09-16T15:38:26.084231+0000","last_undegraded":"2024-09-16T15:38:26.084231+0000","last_fullsized":"2024-09-16T15:38:26.084231+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:41:52.194650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:26.083546+0000","last_change":"2024-09-16T15:38:25.086423+0000","last_active":"2024-09-16T15:38:26.083546+0000","last_peered":"2024-09-16T15:38:26.083546+0000","last_clean":"2024-09-16T15:38:26.083546+0000","last_became_active":"2024-09-16T15:38:25.086150+0000","last_became_peered":"2024-09-16T15:38:25.086150+0000","last_unstale":"2024-09-16T15:38:26.083546+0000","last_undegraded":"2024-09-16T15:38:26.083546+0000","last_fullsized":"2024-09-16T15:38:26.083546+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:47:05.942838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.300000+0000","last_change":"2024-09-16T15:38:23.300000+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.300000+0000","last_undegraded":"2024-09-16T15:38:23.300000+0000","last_fullsized":"2024-09-16T15:38:23.300000+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.060721+0000","last_change":"2024-09-16T15:38:23.060721+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.060721+0000","last_undegraded":"2024-09-16T15:38:23.060721+0000","last_fullsized":"2024-09-16T15:38:23.060721+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.060776+0000","last_change":"2024-09-16T15:38:23.060776+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.060776+0000","last_undegraded":"2024-09-16T15:38:23.060776+0000","last_fullsized":"2024-09-16T15:38:23.060776+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.064497+0000","last_change":"2024-09-16T15:38:23.064497+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.064497+0000","last_undegraded":"2024-09-16T15:38:23.064497+0000","last_fullsized":"2024-09-16T15:38:23.064497+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.064522+0000","last_change":"2024-09-16T15:38:23.064522+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.064522+0000","last_undegraded":"2024-09-16T15:38:23.064522+0000","last_fullsized":"2024-09-16T15:38:23.064522+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.299985+0000","last_change":"2024-09-16T15:38:23.299985+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.299985+0000","last_undegraded":"2024-09-16T15:38:23.299985+0000","last_fullsized":"2024-09-16T15:38:23.299985+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.063716+0000","last_change":"2024-09-16T15:38:23.063716+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.063716+0000","last_undegraded":"2024-09-16T15:38:23.063716+0000","last_fullsized":"2024-09-16T15:38:23.063716+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.058527+0000","last_change":"2024-09-16T15:38:23.058527+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.058527+0000","last_undegraded":"2024-09-16T15:38:23.058527+0000","last_fullsized":"2024-09-16T15:38:23.058527+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:26.083693+0000","last_change":"2024-09-16T15:38:25.089843+0000","last_active":"2024-09-16T15:38:26.083693+0000","last_peered":"2024-09-16T15:38:26.083693+0000","last_clean":"2024-09-16T15:38:26.083693+0000","last_became_active":"2024-09-16T15:38:25.089381+0000","last_became_peered":"2024-09-16T15:38:25.089381+0000","last_unstale":"2024-09-16T15:38:26.083693+0000","last_undegraded":"2024-09-16T15:38:26.083693+0000","last_fullsized":"2024-09-16T15:38:26.083693+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T23:03:36.157931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.066530+0000","last_change":"2024-09-16T15:38:23.066530+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.066530+0000","last_undegraded":"2024-09-16T15:38:23.066530+0000","last_fullsized":"2024-09-16T15:38:23.066530+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.299990+0000","last_change":"2024-09-16T15:38:23.299990+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.299990+0000","last_undegraded":"2024-09-16T15:38:23.299990+0000","last_fullsized":"2024-09-16T15:38:23.299990+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:26.083674+0000","last_change":"2024-09-16T15:38:25.087283+0000","last_active":"2024-09-16T15:38:26.083674+0000","last_peered":"2024-09-16T15:38:26.083674+0000","last_clean":"2024-09-16T15:38:26.083674+0000","last_became_active":"2024-09-16T15:38:25.087060+0000","last_became_peered":"2024-09-16T15:38:25.087060+0000","last_unstale":"2024-09-16T15:38:26.083674+0000","last_undegraded":"2024-09-16T15:38:26.083674+0000","last_fullsized":"2024-09-16T15:38:26.083674+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:30:36.134629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.062871+0000","last_change":"2024-09-16T15:38:23.062871+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.062871+0000","last_undegraded":"2024-09-16T15:38:23.062871+0000","last_fullsized":"2024-09-16T15:38:23.062871+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.062781+0000","last_change":"2024-09-16T15:38:23.062781+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.062781+0000","last_undegraded":"2024-09-16T15:38:23.062781+0000","last_fullsized":"2024-09-16T15:38:23.062781+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:26.083983+0000","last_change":"2024-09-16T15:38:24.076858+0000","last_active":"2024-09-16T15:38:26.083983+0000","last_peered":"2024-09-16T15:38:26.083983+0000","last_clean":"2024-09-16T15:38:26.083983+0000","last_became_active":"2024-09-16T15:38:24.076591+0000","last_became_peered":"2024-09-16T15:38:24.076591+0000","last_unstale":"2024-09-16T15:38:26.083983+0000","last_undegraded":"2024-09-16T15:38:26.083983+0000","last_fullsized":"2024-09-16T15:38:26.083983+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:47:03.377191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.066482+0000","last_change":"2024-09-16T15:38:23.066482+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.066482+0000","last_undegraded":"2024-09-16T15:38:23.066482+0000","last_fullsized":"2024-09-16T15:38:23.066482+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:26.084357+0000","last_change":"2024-09-16T15:38:24.072331+0000","last_active":"2024-09-16T15:38:26.084357+0000","last_peered":"2024-09-16T15:38:26.084357+0000","last_clean":"2024-09-16T15:38:26.084357+0000","last_became_active":"2024-09-16T15:38:24.071959+0000","last_became_peered":"2024-09-16T15:38:24.071959+0000","last_unstale":"2024-09-16T15:38:26.084357+0000","last_undegraded":"2024-09-16T15:38:26.084357+0000","last_fullsized":"2024-09-16T15:38:26.084357+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:30:09.123984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:26.083749+0000","last_change":"2024-09-16T15:38:24.076097+0000","last_active":"2024-09-16T15:38:26.083749+0000","last_peered":"2024-09-16T15:38:26.083749+0000","last_clean":"2024-09-16T15:38:26.083749+0000","last_became_active":"2024-09-16T15:38:24.075851+0000","last_became_peered":"2024-09-16T15:38:24.075851+0000","last_unstale":"2024-09-16T15:38:26.083749+0000","last_undegraded":"2024-09-16T15:38:26.083749+0000","last_fullsized":"2024-09-16T15:38:26.083749+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T21:07:59.238679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:26.083815+0000","last_change":"2024-09-16T15:38:24.073845+0000","last_active":"2024-09-16T15:38:26.083815+0000","last_peered":"2024-09-16T15:38:26.083815+0000","last_clean":"2024-09-16T15:38:26.083815+0000","last_became_active":"2024-09-16T15:38:24.073602+0000","last_became_peered":"2024-09-16T15:38:24.073602+0000","last_unstale":"2024-09-16T15:38:26.083815+0000","last_undegraded":"2024-09-16T15:38:26.083815+0000","last_fullsized":"2024-09-16T15:38:26.083815+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:33:40.349674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.299981+0000","last_change":"2024-09-16T15:38:23.299981+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.299981+0000","last_undegraded":"2024-09-16T15:38:23.299981+0000","last_fullsized":"2024-09-16T15:38:23.299981+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.060778+0000","last_change":"2024-09-16T15:38:23.060778+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.060778+0000","last_undegraded":"2024-09-16T15:38:23.060778+0000","last_fullsized":"2024-09-16T15:38:23.060778+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.063322+0000","last_change":"2024-09-16T15:38:23.063322+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.063322+0000","last_undegraded":"2024-09-16T15:38:23.063322+0000","last_fullsized":"2024-09-16T15:38:23.063322+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":125,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T15:38:23.063511+0000","last_change":"2024-09-16T15:37:37.258601+0000","last_active":"2024-09-16T15:38:23.063511+0000","last_peered":"2024-09-16T15:38:23.063511+0000","last_clean":"2024-09-16T15:38:23.063511+0000","last_became_active":"2024-09-16T15:37:37.257584+0000","last_became_peered":"2024-09-16T15:37:37.257584+0000","last_unstale":"2024-09-16T15:38:23.063511+0000","last_undegraded":"2024-09-16T15:38:23.063511+0000","last_fullsized":"2024-09-16T15:38:23.063511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:35.447043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:35.447043+0000","last_clean_scrub_stamp":"2024-09-16T15:37:35.447043+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:43:17.464894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":14,"acting":14,"num_store_stats":1},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":1612,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":339968,"data_stored":125085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509454,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":933888,"data_stored":715453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":327680,"data_stored":119268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509455,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":339968,"data_stored":125085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":339968,"data_stored":125085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509455,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27936,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343904,"statfs":{"total":96636764160,"available":96608157696,"internally_reserved":0,"allocated":921600,"data_stored":709636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509453,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":327680,"data_stored":119268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":389120,"data_stored":146047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T15:38:28.836 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3f is not active+clean 2024-09-16T15:38:28.836 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T15:38:24.054567+0000', 'last_change': '2024-09-16T15:38:24.054567+0000', 'last_active': '2024-09-16T15:38:24.054567+0000', 'last_peered': '2024-09-16T15:38:24.054567+0000', 'last_clean': '2024-09-16T15:38:24.054567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:38:24.054567+0000', 'last_undegraded': '2024-09-16T15:38:24.054567+0000', 'last_fullsized': '2024-09-16T15:38:24.054567+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_clean_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T15:38:28.836 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3e is not active+clean 2024-09-16T15:38:28.836 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T15:38:24.054567+0000', 'last_change': '2024-09-16T15:38:24.054567+0000', 'last_active': '2024-09-16T15:38:24.054567+0000', 'last_peered': '2024-09-16T15:38:24.054567+0000', 'last_clean': '2024-09-16T15:38:24.054567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:38:24.054567+0000', 'last_undegraded': '2024-09-16T15:38:24.054567+0000', 'last_fullsized': '2024-09-16T15:38:24.054567+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_clean_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T15:38:28.837 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3d is not active+clean 2024-09-16T15:38:28.837 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T15:38:24.054567+0000', 'last_change': '2024-09-16T15:38:24.054567+0000', 'last_active': '2024-09-16T15:38:24.054567+0000', 'last_peered': '2024-09-16T15:38:24.054567+0000', 'last_clean': '2024-09-16T15:38:24.054567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:38:24.054567+0000', 'last_undegraded': '2024-09-16T15:38:24.054567+0000', 'last_fullsized': '2024-09-16T15:38:24.054567+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_clean_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T15:38:28.837 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3c is not active+clean 2024-09-16T15:38:28.837 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T15:38:24.054567+0000', 'last_change': '2024-09-16T15:38:24.054567+0000', 'last_active': '2024-09-16T15:38:24.054567+0000', 'last_peered': '2024-09-16T15:38:24.054567+0000', 'last_clean': '2024-09-16T15:38:24.054567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:38:24.054567+0000', 'last_undegraded': '2024-09-16T15:38:24.054567+0000', 'last_fullsized': '2024-09-16T15:38:24.054567+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_clean_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T15:38:28.837 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3b is not active+clean 2024-09-16T15:38:28.837 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T15:38:24.054567+0000', 'last_change': '2024-09-16T15:38:24.054567+0000', 'last_active': '2024-09-16T15:38:24.054567+0000', 'last_peered': '2024-09-16T15:38:24.054567+0000', 'last_clean': '2024-09-16T15:38:24.054567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:38:24.054567+0000', 'last_undegraded': '2024-09-16T15:38:24.054567+0000', 'last_fullsized': '2024-09-16T15:38:24.054567+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_clean_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T15:38:28.837 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3a is not active+clean 2024-09-16T15:38:28.837 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T15:38:24.054567+0000', 'last_change': '2024-09-16T15:38:24.054567+0000', 'last_active': '2024-09-16T15:38:24.054567+0000', 'last_peered': '2024-09-16T15:38:24.054567+0000', 'last_clean': '2024-09-16T15:38:24.054567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:38:24.054567+0000', 'last_undegraded': '2024-09-16T15:38:24.054567+0000', 'last_fullsized': '2024-09-16T15:38:24.054567+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_clean_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T15:38:28.838 INFO:tasks.ceph.ceph_manager.ceph:PG 5.39 is not active+clean 2024-09-16T15:38:28.838 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T15:38:24.054567+0000', 'last_change': '2024-09-16T15:38:24.054567+0000', 'last_active': '2024-09-16T15:38:24.054567+0000', 'last_peered': '2024-09-16T15:38:24.054567+0000', 'last_clean': '2024-09-16T15:38:24.054567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:38:24.054567+0000', 'last_undegraded': '2024-09-16T15:38:24.054567+0000', 'last_fullsized': '2024-09-16T15:38:24.054567+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_clean_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T15:38:28.838 INFO:tasks.ceph.ceph_manager.ceph:PG 5.38 is not active+clean 2024-09-16T15:38:28.838 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T15:38:24.054567+0000', 'last_change': '2024-09-16T15:38:24.054567+0000', 'last_active': '2024-09-16T15:38:24.054567+0000', 'last_peered': '2024-09-16T15:38:24.054567+0000', 'last_clean': '2024-09-16T15:38:24.054567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:38:24.054567+0000', 'last_undegraded': '2024-09-16T15:38:24.054567+0000', 'last_fullsized': '2024-09-16T15:38:24.054567+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_clean_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T15:38:28.838 INFO:tasks.ceph.ceph_manager.ceph:PG 5.37 is not active+clean 2024-09-16T15:38:28.838 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T15:38:24.054567+0000', 'last_change': '2024-09-16T15:38:24.054567+0000', 'last_active': '2024-09-16T15:38:24.054567+0000', 'last_peered': '2024-09-16T15:38:24.054567+0000', 'last_clean': '2024-09-16T15:38:24.054567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:38:24.054567+0000', 'last_undegraded': '2024-09-16T15:38:24.054567+0000', 'last_fullsized': '2024-09-16T15:38:24.054567+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_clean_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T15:38:28.838 INFO:tasks.ceph.ceph_manager.ceph:PG 5.36 is not active+clean 2024-09-16T15:38:28.838 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T15:38:24.054567+0000', 'last_change': '2024-09-16T15:38:24.054567+0000', 'last_active': '2024-09-16T15:38:24.054567+0000', 'last_peered': '2024-09-16T15:38:24.054567+0000', 'last_clean': '2024-09-16T15:38:24.054567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:38:24.054567+0000', 'last_undegraded': '2024-09-16T15:38:24.054567+0000', 'last_fullsized': '2024-09-16T15:38:24.054567+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_clean_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T15:38:28.838 INFO:tasks.ceph.ceph_manager.ceph:PG 5.35 is not active+clean 2024-09-16T15:38:28.838 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T15:38:24.054567+0000', 'last_change': '2024-09-16T15:38:24.054567+0000', 'last_active': '2024-09-16T15:38:24.054567+0000', 'last_peered': '2024-09-16T15:38:24.054567+0000', 'last_clean': '2024-09-16T15:38:24.054567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:38:24.054567+0000', 'last_undegraded': '2024-09-16T15:38:24.054567+0000', 'last_fullsized': '2024-09-16T15:38:24.054567+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_clean_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T15:38:28.838 INFO:tasks.ceph.ceph_manager.ceph:PG 5.34 is not active+clean 2024-09-16T15:38:28.839 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T15:38:24.054567+0000', 'last_change': '2024-09-16T15:38:24.054567+0000', 'last_active': '2024-09-16T15:38:24.054567+0000', 'last_peered': '2024-09-16T15:38:24.054567+0000', 'last_clean': '2024-09-16T15:38:24.054567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:38:24.054567+0000', 'last_undegraded': '2024-09-16T15:38:24.054567+0000', 'last_fullsized': '2024-09-16T15:38:24.054567+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_clean_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T15:38:28.839 INFO:tasks.ceph.ceph_manager.ceph:PG 5.32 is not active+clean 2024-09-16T15:38:28.839 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T15:38:24.054567+0000', 'last_change': '2024-09-16T15:38:24.054567+0000', 'last_active': '2024-09-16T15:38:24.054567+0000', 'last_peered': '2024-09-16T15:38:24.054567+0000', 'last_clean': '2024-09-16T15:38:24.054567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:38:24.054567+0000', 'last_undegraded': '2024-09-16T15:38:24.054567+0000', 'last_fullsized': '2024-09-16T15:38:24.054567+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_clean_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T15:38:28.839 INFO:tasks.ceph.ceph_manager.ceph:PG 5.31 is not active+clean 2024-09-16T15:38:28.839 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T15:38:24.054567+0000', 'last_change': '2024-09-16T15:38:24.054567+0000', 'last_active': '2024-09-16T15:38:24.054567+0000', 'last_peered': '2024-09-16T15:38:24.054567+0000', 'last_clean': '2024-09-16T15:38:24.054567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:38:24.054567+0000', 'last_undegraded': '2024-09-16T15:38:24.054567+0000', 'last_fullsized': '2024-09-16T15:38:24.054567+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_clean_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T15:38:28.839 INFO:tasks.ceph.ceph_manager.ceph:PG 5.30 is not active+clean 2024-09-16T15:38:28.839 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T15:38:24.054567+0000', 'last_change': '2024-09-16T15:38:24.054567+0000', 'last_active': '2024-09-16T15:38:24.054567+0000', 'last_peered': '2024-09-16T15:38:24.054567+0000', 'last_clean': '2024-09-16T15:38:24.054567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:38:24.054567+0000', 'last_undegraded': '2024-09-16T15:38:24.054567+0000', 'last_fullsized': '2024-09-16T15:38:24.054567+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_clean_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T15:38:28.839 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2f is not active+clean 2024-09-16T15:38:28.839 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T15:38:24.054567+0000', 'last_change': '2024-09-16T15:38:24.054567+0000', 'last_active': '2024-09-16T15:38:24.054567+0000', 'last_peered': '2024-09-16T15:38:24.054567+0000', 'last_clean': '2024-09-16T15:38:24.054567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:38:24.054567+0000', 'last_undegraded': '2024-09-16T15:38:24.054567+0000', 'last_fullsized': '2024-09-16T15:38:24.054567+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_clean_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T15:38:28.839 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2e is not active+clean 2024-09-16T15:38:28.840 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T15:38:24.054567+0000', 'last_change': '2024-09-16T15:38:24.054567+0000', 'last_active': '2024-09-16T15:38:24.054567+0000', 'last_peered': '2024-09-16T15:38:24.054567+0000', 'last_clean': '2024-09-16T15:38:24.054567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:38:24.054567+0000', 'last_undegraded': '2024-09-16T15:38:24.054567+0000', 'last_fullsized': '2024-09-16T15:38:24.054567+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_clean_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T15:38:28.840 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2d is not active+clean 2024-09-16T15:38:28.840 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T15:38:24.054567+0000', 'last_change': '2024-09-16T15:38:24.054567+0000', 'last_active': '2024-09-16T15:38:24.054567+0000', 'last_peered': '2024-09-16T15:38:24.054567+0000', 'last_clean': '2024-09-16T15:38:24.054567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:38:24.054567+0000', 'last_undegraded': '2024-09-16T15:38:24.054567+0000', 'last_fullsized': '2024-09-16T15:38:24.054567+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_clean_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T15:38:28.840 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2b is not active+clean 2024-09-16T15:38:28.840 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T15:38:24.054567+0000', 'last_change': '2024-09-16T15:38:24.054567+0000', 'last_active': '2024-09-16T15:38:24.054567+0000', 'last_peered': '2024-09-16T15:38:24.054567+0000', 'last_clean': '2024-09-16T15:38:24.054567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:38:24.054567+0000', 'last_undegraded': '2024-09-16T15:38:24.054567+0000', 'last_fullsized': '2024-09-16T15:38:24.054567+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_clean_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T15:38:28.840 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2a is not active+clean 2024-09-16T15:38:28.840 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T15:38:24.054567+0000', 'last_change': '2024-09-16T15:38:24.054567+0000', 'last_active': '2024-09-16T15:38:24.054567+0000', 'last_peered': '2024-09-16T15:38:24.054567+0000', 'last_clean': '2024-09-16T15:38:24.054567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:38:24.054567+0000', 'last_undegraded': '2024-09-16T15:38:24.054567+0000', 'last_fullsized': '2024-09-16T15:38:24.054567+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_clean_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T15:38:28.840 INFO:tasks.ceph.ceph_manager.ceph:PG 5.28 is not active+clean 2024-09-16T15:38:28.840 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T15:38:24.054567+0000', 'last_change': '2024-09-16T15:38:24.054567+0000', 'last_active': '2024-09-16T15:38:24.054567+0000', 'last_peered': '2024-09-16T15:38:24.054567+0000', 'last_clean': '2024-09-16T15:38:24.054567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:38:24.054567+0000', 'last_undegraded': '2024-09-16T15:38:24.054567+0000', 'last_fullsized': '2024-09-16T15:38:24.054567+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_clean_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T15:38:28.840 INFO:tasks.ceph.ceph_manager.ceph:PG 5.27 is not active+clean 2024-09-16T15:38:28.840 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T15:38:24.054567+0000', 'last_change': '2024-09-16T15:38:24.054567+0000', 'last_active': '2024-09-16T15:38:24.054567+0000', 'last_peered': '2024-09-16T15:38:24.054567+0000', 'last_clean': '2024-09-16T15:38:24.054567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:38:24.054567+0000', 'last_undegraded': '2024-09-16T15:38:24.054567+0000', 'last_fullsized': '2024-09-16T15:38:24.054567+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_clean_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T15:38:28.841 INFO:tasks.ceph.ceph_manager.ceph:PG 5.26 is not active+clean 2024-09-16T15:38:28.841 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T15:38:24.054567+0000', 'last_change': '2024-09-16T15:38:24.054567+0000', 'last_active': '2024-09-16T15:38:24.054567+0000', 'last_peered': '2024-09-16T15:38:24.054567+0000', 'last_clean': '2024-09-16T15:38:24.054567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:38:24.054567+0000', 'last_undegraded': '2024-09-16T15:38:24.054567+0000', 'last_fullsized': '2024-09-16T15:38:24.054567+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_clean_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T15:38:28.841 INFO:tasks.ceph.ceph_manager.ceph:PG 5.25 is not active+clean 2024-09-16T15:38:28.841 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T15:38:24.054567+0000', 'last_change': '2024-09-16T15:38:24.054567+0000', 'last_active': '2024-09-16T15:38:24.054567+0000', 'last_peered': '2024-09-16T15:38:24.054567+0000', 'last_clean': '2024-09-16T15:38:24.054567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:38:24.054567+0000', 'last_undegraded': '2024-09-16T15:38:24.054567+0000', 'last_fullsized': '2024-09-16T15:38:24.054567+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_clean_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T15:38:28.841 INFO:tasks.ceph.ceph_manager.ceph:PG 5.24 is not active+clean 2024-09-16T15:38:28.841 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T15:38:24.054567+0000', 'last_change': '2024-09-16T15:38:24.054567+0000', 'last_active': '2024-09-16T15:38:24.054567+0000', 'last_peered': '2024-09-16T15:38:24.054567+0000', 'last_clean': '2024-09-16T15:38:24.054567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:38:24.054567+0000', 'last_undegraded': '2024-09-16T15:38:24.054567+0000', 'last_fullsized': '2024-09-16T15:38:24.054567+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_clean_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T15:38:28.841 INFO:tasks.ceph.ceph_manager.ceph:PG 5.23 is not active+clean 2024-09-16T15:38:28.841 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T15:38:24.054567+0000', 'last_change': '2024-09-16T15:38:24.054567+0000', 'last_active': '2024-09-16T15:38:24.054567+0000', 'last_peered': '2024-09-16T15:38:24.054567+0000', 'last_clean': '2024-09-16T15:38:24.054567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:38:24.054567+0000', 'last_undegraded': '2024-09-16T15:38:24.054567+0000', 'last_fullsized': '2024-09-16T15:38:24.054567+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_clean_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T15:38:28.841 INFO:tasks.ceph.ceph_manager.ceph:PG 5.22 is not active+clean 2024-09-16T15:38:28.841 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T15:38:24.054567+0000', 'last_change': '2024-09-16T15:38:24.054567+0000', 'last_active': '2024-09-16T15:38:24.054567+0000', 'last_peered': '2024-09-16T15:38:24.054567+0000', 'last_clean': '2024-09-16T15:38:24.054567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:38:24.054567+0000', 'last_undegraded': '2024-09-16T15:38:24.054567+0000', 'last_fullsized': '2024-09-16T15:38:24.054567+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_clean_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T15:38:28.841 INFO:tasks.ceph.ceph_manager.ceph:PG 5.21 is not active+clean 2024-09-16T15:38:28.841 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T15:38:24.054567+0000', 'last_change': '2024-09-16T15:38:24.054567+0000', 'last_active': '2024-09-16T15:38:24.054567+0000', 'last_peered': '2024-09-16T15:38:24.054567+0000', 'last_clean': '2024-09-16T15:38:24.054567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:38:24.054567+0000', 'last_undegraded': '2024-09-16T15:38:24.054567+0000', 'last_fullsized': '2024-09-16T15:38:24.054567+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_clean_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T15:38:28.842 INFO:tasks.ceph.ceph_manager.ceph:PG 5.20 is not active+clean 2024-09-16T15:38:28.842 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T15:38:24.054567+0000', 'last_change': '2024-09-16T15:38:24.054567+0000', 'last_active': '2024-09-16T15:38:24.054567+0000', 'last_peered': '2024-09-16T15:38:24.054567+0000', 'last_clean': '2024-09-16T15:38:24.054567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:38:24.054567+0000', 'last_undegraded': '2024-09-16T15:38:24.054567+0000', 'last_fullsized': '2024-09-16T15:38:24.054567+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_clean_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T15:38:28.842 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1f is not active+clean 2024-09-16T15:38:28.842 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-16T15:38:23.063408+0000', 'last_change': '2024-09-16T15:38:23.063408+0000', 'last_active': '2024-09-16T15:38:23.050302+0000', 'last_peered': '2024-09-16T15:38:23.050302+0000', 'last_clean': '2024-09-16T15:38:23.050302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:38:23.063408+0000', 'last_undegraded': '2024-09-16T15:38:23.063408+0000', 'last_fullsized': '2024-09-16T15:38:23.063408+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:38:23.050302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:38:23.050302+0000', 'last_clean_scrub_stamp': '2024-09-16T15:38:23.050302+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-16T15:38:28.842 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1f is not active+clean 2024-09-16T15:38:28.842 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T15:38:24.054567+0000', 'last_change': '2024-09-16T15:38:24.054567+0000', 'last_active': '2024-09-16T15:38:24.054567+0000', 'last_peered': '2024-09-16T15:38:24.054567+0000', 'last_clean': '2024-09-16T15:38:24.054567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:38:24.054567+0000', 'last_undegraded': '2024-09-16T15:38:24.054567+0000', 'last_fullsized': '2024-09-16T15:38:24.054567+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_clean_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T15:38:28.842 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1e is not active+clean 2024-09-16T15:38:28.842 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-16T15:38:23.060791+0000', 'last_change': '2024-09-16T15:38:23.060791+0000', 'last_active': '2024-09-16T15:38:23.050302+0000', 'last_peered': '2024-09-16T15:38:23.050302+0000', 'last_clean': '2024-09-16T15:38:23.050302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:38:23.060791+0000', 'last_undegraded': '2024-09-16T15:38:23.060791+0000', 'last_fullsized': '2024-09-16T15:38:23.060791+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:38:23.050302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:38:23.050302+0000', 'last_clean_scrub_stamp': '2024-09-16T15:38:23.050302+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-16T15:38:28.842 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1c is not active+clean 2024-09-16T15:38:28.842 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T15:38:24.054567+0000', 'last_change': '2024-09-16T15:38:24.054567+0000', 'last_active': '2024-09-16T15:38:24.054567+0000', 'last_peered': '2024-09-16T15:38:24.054567+0000', 'last_clean': '2024-09-16T15:38:24.054567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:38:24.054567+0000', 'last_undegraded': '2024-09-16T15:38:24.054567+0000', 'last_fullsized': '2024-09-16T15:38:24.054567+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_clean_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T15:38:28.842 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1d is not active+clean 2024-09-16T15:38:28.843 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-16T15:38:23.064477+0000', 'last_change': '2024-09-16T15:38:23.064477+0000', 'last_active': '2024-09-16T15:38:23.050302+0000', 'last_peered': '2024-09-16T15:38:23.050302+0000', 'last_clean': '2024-09-16T15:38:23.050302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:38:23.064477+0000', 'last_undegraded': '2024-09-16T15:38:23.064477+0000', 'last_fullsized': '2024-09-16T15:38:23.064477+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:38:23.050302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:38:23.050302+0000', 'last_clean_scrub_stamp': '2024-09-16T15:38:23.050302+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-16T15:38:28.843 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1d is not active+clean 2024-09-16T15:38:28.843 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T15:38:24.054567+0000', 'last_change': '2024-09-16T15:38:24.054567+0000', 'last_active': '2024-09-16T15:38:24.054567+0000', 'last_peered': '2024-09-16T15:38:24.054567+0000', 'last_clean': '2024-09-16T15:38:24.054567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:38:24.054567+0000', 'last_undegraded': '2024-09-16T15:38:24.054567+0000', 'last_fullsized': '2024-09-16T15:38:24.054567+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_clean_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T15:38:28.843 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1c is not active+clean 2024-09-16T15:38:28.843 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-16T15:38:23.060892+0000', 'last_change': '2024-09-16T15:38:23.060892+0000', 'last_active': '2024-09-16T15:38:23.050302+0000', 'last_peered': '2024-09-16T15:38:23.050302+0000', 'last_clean': '2024-09-16T15:38:23.050302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:38:23.060892+0000', 'last_undegraded': '2024-09-16T15:38:23.060892+0000', 'last_fullsized': '2024-09-16T15:38:23.060892+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:38:23.050302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:38:23.050302+0000', 'last_clean_scrub_stamp': '2024-09-16T15:38:23.050302+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-16T15:38:28.843 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1a is not active+clean 2024-09-16T15:38:28.843 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T15:38:24.054567+0000', 'last_change': '2024-09-16T15:38:24.054567+0000', 'last_active': '2024-09-16T15:38:24.054567+0000', 'last_peered': '2024-09-16T15:38:24.054567+0000', 'last_clean': '2024-09-16T15:38:24.054567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:38:24.054567+0000', 'last_undegraded': '2024-09-16T15:38:24.054567+0000', 'last_fullsized': '2024-09-16T15:38:24.054567+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_clean_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T15:38:28.843 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1b is not active+clean 2024-09-16T15:38:28.843 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-16T15:38:23.300474+0000', 'last_change': '2024-09-16T15:38:23.300474+0000', 'last_active': '2024-09-16T15:38:23.050302+0000', 'last_peered': '2024-09-16T15:38:23.050302+0000', 'last_clean': '2024-09-16T15:38:23.050302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:38:23.300474+0000', 'last_undegraded': '2024-09-16T15:38:23.300474+0000', 'last_fullsized': '2024-09-16T15:38:23.300474+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:38:23.050302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:38:23.050302+0000', 'last_clean_scrub_stamp': '2024-09-16T15:38:23.050302+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-16T15:38:28.843 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1b is not active+clean 2024-09-16T15:38:28.843 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T15:38:24.054567+0000', 'last_change': '2024-09-16T15:38:24.054567+0000', 'last_active': '2024-09-16T15:38:24.054567+0000', 'last_peered': '2024-09-16T15:38:24.054567+0000', 'last_clean': '2024-09-16T15:38:24.054567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:38:24.054567+0000', 'last_undegraded': '2024-09-16T15:38:24.054567+0000', 'last_fullsized': '2024-09-16T15:38:24.054567+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_clean_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T15:38:28.844 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1a is not active+clean 2024-09-16T15:38:28.844 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-16T15:38:23.300424+0000', 'last_change': '2024-09-16T15:38:23.300424+0000', 'last_active': '2024-09-16T15:38:23.050302+0000', 'last_peered': '2024-09-16T15:38:23.050302+0000', 'last_clean': '2024-09-16T15:38:23.050302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:38:23.300424+0000', 'last_undegraded': '2024-09-16T15:38:23.300424+0000', 'last_fullsized': '2024-09-16T15:38:23.300424+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:38:23.050302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:38:23.050302+0000', 'last_clean_scrub_stamp': '2024-09-16T15:38:23.050302+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-16T15:38:28.844 INFO:tasks.ceph.ceph_manager.ceph:PG 5.18 is not active+clean 2024-09-16T15:38:28.844 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T15:38:24.054567+0000', 'last_change': '2024-09-16T15:38:24.054567+0000', 'last_active': '2024-09-16T15:38:24.054567+0000', 'last_peered': '2024-09-16T15:38:24.054567+0000', 'last_clean': '2024-09-16T15:38:24.054567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:38:24.054567+0000', 'last_undegraded': '2024-09-16T15:38:24.054567+0000', 'last_fullsized': '2024-09-16T15:38:24.054567+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_clean_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T15:38:28.844 INFO:tasks.ceph.ceph_manager.ceph:PG 4.19 is not active+clean 2024-09-16T15:38:28.844 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-16T15:38:23.064486+0000', 'last_change': '2024-09-16T15:38:23.064486+0000', 'last_active': '2024-09-16T15:38:23.050302+0000', 'last_peered': '2024-09-16T15:38:23.050302+0000', 'last_clean': '2024-09-16T15:38:23.050302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:38:23.064486+0000', 'last_undegraded': '2024-09-16T15:38:23.064486+0000', 'last_fullsized': '2024-09-16T15:38:23.064486+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:38:23.050302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:38:23.050302+0000', 'last_clean_scrub_stamp': '2024-09-16T15:38:23.050302+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-16T15:38:28.844 INFO:tasks.ceph.ceph_manager.ceph:PG 5.19 is not active+clean 2024-09-16T15:38:28.844 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T15:38:24.054567+0000', 'last_change': '2024-09-16T15:38:24.054567+0000', 'last_active': '2024-09-16T15:38:24.054567+0000', 'last_peered': '2024-09-16T15:38:24.054567+0000', 'last_clean': '2024-09-16T15:38:24.054567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:38:24.054567+0000', 'last_undegraded': '2024-09-16T15:38:24.054567+0000', 'last_fullsized': '2024-09-16T15:38:24.054567+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_clean_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T15:38:28.844 INFO:tasks.ceph.ceph_manager.ceph:PG 4.18 is not active+clean 2024-09-16T15:38:28.844 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-16T15:38:23.299993+0000', 'last_change': '2024-09-16T15:38:23.299993+0000', 'last_active': '2024-09-16T15:38:23.050302+0000', 'last_peered': '2024-09-16T15:38:23.050302+0000', 'last_clean': '2024-09-16T15:38:23.050302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:38:23.299993+0000', 'last_undegraded': '2024-09-16T15:38:23.299993+0000', 'last_fullsized': '2024-09-16T15:38:23.299993+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:38:23.050302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:38:23.050302+0000', 'last_clean_scrub_stamp': '2024-09-16T15:38:23.050302+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-16T15:38:28.844 INFO:tasks.ceph.ceph_manager.ceph:PG 5.16 is not active+clean 2024-09-16T15:38:28.844 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T15:38:24.054567+0000', 'last_change': '2024-09-16T15:38:24.054567+0000', 'last_active': '2024-09-16T15:38:24.054567+0000', 'last_peered': '2024-09-16T15:38:24.054567+0000', 'last_clean': '2024-09-16T15:38:24.054567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:38:24.054567+0000', 'last_undegraded': '2024-09-16T15:38:24.054567+0000', 'last_fullsized': '2024-09-16T15:38:24.054567+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_clean_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T15:38:28.845 INFO:tasks.ceph.ceph_manager.ceph:PG 4.17 is not active+clean 2024-09-16T15:38:28.845 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-16T15:38:23.066530+0000', 'last_change': '2024-09-16T15:38:23.066530+0000', 'last_active': '2024-09-16T15:38:23.050302+0000', 'last_peered': '2024-09-16T15:38:23.050302+0000', 'last_clean': '2024-09-16T15:38:23.050302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:38:23.066530+0000', 'last_undegraded': '2024-09-16T15:38:23.066530+0000', 'last_fullsized': '2024-09-16T15:38:23.066530+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:38:23.050302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:38:23.050302+0000', 'last_clean_scrub_stamp': '2024-09-16T15:38:23.050302+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-16T15:38:28.845 INFO:tasks.ceph.ceph_manager.ceph:PG 5.17 is not active+clean 2024-09-16T15:38:28.845 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T15:38:24.054567+0000', 'last_change': '2024-09-16T15:38:24.054567+0000', 'last_active': '2024-09-16T15:38:24.054567+0000', 'last_peered': '2024-09-16T15:38:24.054567+0000', 'last_clean': '2024-09-16T15:38:24.054567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:38:24.054567+0000', 'last_undegraded': '2024-09-16T15:38:24.054567+0000', 'last_fullsized': '2024-09-16T15:38:24.054567+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_clean_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T15:38:28.845 INFO:tasks.ceph.ceph_manager.ceph:PG 4.16 is not active+clean 2024-09-16T15:38:28.845 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-16T15:38:23.066906+0000', 'last_change': '2024-09-16T15:38:23.066906+0000', 'last_active': '2024-09-16T15:38:23.050302+0000', 'last_peered': '2024-09-16T15:38:23.050302+0000', 'last_clean': '2024-09-16T15:38:23.050302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:38:23.066906+0000', 'last_undegraded': '2024-09-16T15:38:23.066906+0000', 'last_fullsized': '2024-09-16T15:38:23.066906+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:38:23.050302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:38:23.050302+0000', 'last_clean_scrub_stamp': '2024-09-16T15:38:23.050302+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-16T15:38:28.845 INFO:tasks.ceph.ceph_manager.ceph:PG 5.14 is not active+clean 2024-09-16T15:38:28.845 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T15:38:24.054567+0000', 'last_change': '2024-09-16T15:38:24.054567+0000', 'last_active': '2024-09-16T15:38:24.054567+0000', 'last_peered': '2024-09-16T15:38:24.054567+0000', 'last_clean': '2024-09-16T15:38:24.054567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:38:24.054567+0000', 'last_undegraded': '2024-09-16T15:38:24.054567+0000', 'last_fullsized': '2024-09-16T15:38:24.054567+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_clean_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T15:38:28.845 INFO:tasks.ceph.ceph_manager.ceph:PG 4.15 is not active+clean 2024-09-16T15:38:28.846 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-16T15:38:23.064066+0000', 'last_change': '2024-09-16T15:38:23.064066+0000', 'last_active': '2024-09-16T15:38:23.050302+0000', 'last_peered': '2024-09-16T15:38:23.050302+0000', 'last_clean': '2024-09-16T15:38:23.050302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:38:23.064066+0000', 'last_undegraded': '2024-09-16T15:38:23.064066+0000', 'last_fullsized': '2024-09-16T15:38:23.064066+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:38:23.050302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:38:23.050302+0000', 'last_clean_scrub_stamp': '2024-09-16T15:38:23.050302+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-16T15:38:28.846 INFO:tasks.ceph.ceph_manager.ceph:PG 5.15 is not active+clean 2024-09-16T15:38:28.846 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T15:38:24.054567+0000', 'last_change': '2024-09-16T15:38:24.054567+0000', 'last_active': '2024-09-16T15:38:24.054567+0000', 'last_peered': '2024-09-16T15:38:24.054567+0000', 'last_clean': '2024-09-16T15:38:24.054567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:38:24.054567+0000', 'last_undegraded': '2024-09-16T15:38:24.054567+0000', 'last_fullsized': '2024-09-16T15:38:24.054567+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_clean_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T15:38:28.846 INFO:tasks.ceph.ceph_manager.ceph:PG 4.13 is not active+clean 2024-09-16T15:38:28.846 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-16T15:38:23.300000+0000', 'last_change': '2024-09-16T15:38:23.300000+0000', 'last_active': '2024-09-16T15:38:23.050302+0000', 'last_peered': '2024-09-16T15:38:23.050302+0000', 'last_clean': '2024-09-16T15:38:23.050302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:38:23.300000+0000', 'last_undegraded': '2024-09-16T15:38:23.300000+0000', 'last_fullsized': '2024-09-16T15:38:23.300000+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:38:23.050302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:38:23.050302+0000', 'last_clean_scrub_stamp': '2024-09-16T15:38:23.050302+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-16T15:38:28.846 INFO:tasks.ceph.ceph_manager.ceph:PG 5.13 is not active+clean 2024-09-16T15:38:28.846 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T15:38:24.054567+0000', 'last_change': '2024-09-16T15:38:24.054567+0000', 'last_active': '2024-09-16T15:38:24.054567+0000', 'last_peered': '2024-09-16T15:38:24.054567+0000', 'last_clean': '2024-09-16T15:38:24.054567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:38:24.054567+0000', 'last_undegraded': '2024-09-16T15:38:24.054567+0000', 'last_fullsized': '2024-09-16T15:38:24.054567+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_clean_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T15:38:28.846 INFO:tasks.ceph.ceph_manager.ceph:PG 4.12 is not active+clean 2024-09-16T15:38:28.846 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-16T15:38:23.060721+0000', 'last_change': '2024-09-16T15:38:23.060721+0000', 'last_active': '2024-09-16T15:38:23.050302+0000', 'last_peered': '2024-09-16T15:38:23.050302+0000', 'last_clean': '2024-09-16T15:38:23.050302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:38:23.060721+0000', 'last_undegraded': '2024-09-16T15:38:23.060721+0000', 'last_fullsized': '2024-09-16T15:38:23.060721+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:38:23.050302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:38:23.050302+0000', 'last_clean_scrub_stamp': '2024-09-16T15:38:23.050302+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-16T15:38:28.846 INFO:tasks.ceph.ceph_manager.ceph:PG 5.10 is not active+clean 2024-09-16T15:38:28.846 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T15:38:24.054567+0000', 'last_change': '2024-09-16T15:38:24.054567+0000', 'last_active': '2024-09-16T15:38:24.054567+0000', 'last_peered': '2024-09-16T15:38:24.054567+0000', 'last_clean': '2024-09-16T15:38:24.054567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:38:24.054567+0000', 'last_undegraded': '2024-09-16T15:38:24.054567+0000', 'last_fullsized': '2024-09-16T15:38:24.054567+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_clean_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T15:38:28.847 INFO:tasks.ceph.ceph_manager.ceph:PG 4.11 is not active+clean 2024-09-16T15:38:28.847 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-16T15:38:23.060776+0000', 'last_change': '2024-09-16T15:38:23.060776+0000', 'last_active': '2024-09-16T15:38:23.050302+0000', 'last_peered': '2024-09-16T15:38:23.050302+0000', 'last_clean': '2024-09-16T15:38:23.050302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:38:23.060776+0000', 'last_undegraded': '2024-09-16T15:38:23.060776+0000', 'last_fullsized': '2024-09-16T15:38:23.060776+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:38:23.050302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:38:23.050302+0000', 'last_clean_scrub_stamp': '2024-09-16T15:38:23.050302+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-16T15:38:28.847 INFO:tasks.ceph.ceph_manager.ceph:PG 5.11 is not active+clean 2024-09-16T15:38:28.847 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T15:38:24.054567+0000', 'last_change': '2024-09-16T15:38:24.054567+0000', 'last_active': '2024-09-16T15:38:24.054567+0000', 'last_peered': '2024-09-16T15:38:24.054567+0000', 'last_clean': '2024-09-16T15:38:24.054567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:38:24.054567+0000', 'last_undegraded': '2024-09-16T15:38:24.054567+0000', 'last_fullsized': '2024-09-16T15:38:24.054567+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_clean_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T15:38:28.847 INFO:tasks.ceph.ceph_manager.ceph:PG 4.10 is not active+clean 2024-09-16T15:38:28.847 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-16T15:38:23.064497+0000', 'last_change': '2024-09-16T15:38:23.064497+0000', 'last_active': '2024-09-16T15:38:23.050302+0000', 'last_peered': '2024-09-16T15:38:23.050302+0000', 'last_clean': '2024-09-16T15:38:23.050302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:38:23.064497+0000', 'last_undegraded': '2024-09-16T15:38:23.064497+0000', 'last_fullsized': '2024-09-16T15:38:23.064497+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:38:23.050302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:38:23.050302+0000', 'last_clean_scrub_stamp': '2024-09-16T15:38:23.050302+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-16T15:38:28.847 INFO:tasks.ceph.ceph_manager.ceph:PG 5.e is not active+clean 2024-09-16T15:38:28.847 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T15:38:24.054567+0000', 'last_change': '2024-09-16T15:38:24.054567+0000', 'last_active': '2024-09-16T15:38:24.054567+0000', 'last_peered': '2024-09-16T15:38:24.054567+0000', 'last_clean': '2024-09-16T15:38:24.054567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:38:24.054567+0000', 'last_undegraded': '2024-09-16T15:38:24.054567+0000', 'last_fullsized': '2024-09-16T15:38:24.054567+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_clean_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T15:38:28.847 INFO:tasks.ceph.ceph_manager.ceph:PG 4.f is not active+clean 2024-09-16T15:38:28.847 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-16T15:38:23.064522+0000', 'last_change': '2024-09-16T15:38:23.064522+0000', 'last_active': '2024-09-16T15:38:23.050302+0000', 'last_peered': '2024-09-16T15:38:23.050302+0000', 'last_clean': '2024-09-16T15:38:23.050302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:38:23.064522+0000', 'last_undegraded': '2024-09-16T15:38:23.064522+0000', 'last_fullsized': '2024-09-16T15:38:23.064522+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:38:23.050302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:38:23.050302+0000', 'last_clean_scrub_stamp': '2024-09-16T15:38:23.050302+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-16T15:38:28.847 INFO:tasks.ceph.ceph_manager.ceph:PG 5.f is not active+clean 2024-09-16T15:38:28.848 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T15:38:24.054567+0000', 'last_change': '2024-09-16T15:38:24.054567+0000', 'last_active': '2024-09-16T15:38:24.054567+0000', 'last_peered': '2024-09-16T15:38:24.054567+0000', 'last_clean': '2024-09-16T15:38:24.054567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:38:24.054567+0000', 'last_undegraded': '2024-09-16T15:38:24.054567+0000', 'last_fullsized': '2024-09-16T15:38:24.054567+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_clean_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T15:38:28.848 INFO:tasks.ceph.ceph_manager.ceph:PG 4.e is not active+clean 2024-09-16T15:38:28.848 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-16T15:38:23.299985+0000', 'last_change': '2024-09-16T15:38:23.299985+0000', 'last_active': '2024-09-16T15:38:23.050302+0000', 'last_peered': '2024-09-16T15:38:23.050302+0000', 'last_clean': '2024-09-16T15:38:23.050302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:38:23.299985+0000', 'last_undegraded': '2024-09-16T15:38:23.299985+0000', 'last_fullsized': '2024-09-16T15:38:23.299985+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:38:23.050302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:38:23.050302+0000', 'last_clean_scrub_stamp': '2024-09-16T15:38:23.050302+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-16T15:38:28.848 INFO:tasks.ceph.ceph_manager.ceph:PG 5.c is not active+clean 2024-09-16T15:38:28.848 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T15:38:24.054567+0000', 'last_change': '2024-09-16T15:38:24.054567+0000', 'last_active': '2024-09-16T15:38:24.054567+0000', 'last_peered': '2024-09-16T15:38:24.054567+0000', 'last_clean': '2024-09-16T15:38:24.054567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:38:24.054567+0000', 'last_undegraded': '2024-09-16T15:38:24.054567+0000', 'last_fullsized': '2024-09-16T15:38:24.054567+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_clean_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T15:38:28.848 INFO:tasks.ceph.ceph_manager.ceph:PG 4.d is not active+clean 2024-09-16T15:38:28.848 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-16T15:38:23.063716+0000', 'last_change': '2024-09-16T15:38:23.063716+0000', 'last_active': '2024-09-16T15:38:23.050302+0000', 'last_peered': '2024-09-16T15:38:23.050302+0000', 'last_clean': '2024-09-16T15:38:23.050302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:38:23.063716+0000', 'last_undegraded': '2024-09-16T15:38:23.063716+0000', 'last_fullsized': '2024-09-16T15:38:23.063716+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:38:23.050302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:38:23.050302+0000', 'last_clean_scrub_stamp': '2024-09-16T15:38:23.050302+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-16T15:38:28.848 INFO:tasks.ceph.ceph_manager.ceph:PG 5.d is not active+clean 2024-09-16T15:38:28.848 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T15:38:24.054567+0000', 'last_change': '2024-09-16T15:38:24.054567+0000', 'last_active': '2024-09-16T15:38:24.054567+0000', 'last_peered': '2024-09-16T15:38:24.054567+0000', 'last_clean': '2024-09-16T15:38:24.054567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:38:24.054567+0000', 'last_undegraded': '2024-09-16T15:38:24.054567+0000', 'last_fullsized': '2024-09-16T15:38:24.054567+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_clean_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T15:38:28.848 INFO:tasks.ceph.ceph_manager.ceph:PG 4.c is not active+clean 2024-09-16T15:38:28.848 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-16T15:38:23.058527+0000', 'last_change': '2024-09-16T15:38:23.058527+0000', 'last_active': '2024-09-16T15:38:23.050302+0000', 'last_peered': '2024-09-16T15:38:23.050302+0000', 'last_clean': '2024-09-16T15:38:23.050302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:38:23.058527+0000', 'last_undegraded': '2024-09-16T15:38:23.058527+0000', 'last_fullsized': '2024-09-16T15:38:23.058527+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:38:23.050302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:38:23.050302+0000', 'last_clean_scrub_stamp': '2024-09-16T15:38:23.050302+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-16T15:38:28.849 INFO:tasks.ceph.ceph_manager.ceph:PG 4.b is not active+clean 2024-09-16T15:38:28.849 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-16T15:38:23.066530+0000', 'last_change': '2024-09-16T15:38:23.066530+0000', 'last_active': '2024-09-16T15:38:23.050302+0000', 'last_peered': '2024-09-16T15:38:23.050302+0000', 'last_clean': '2024-09-16T15:38:23.050302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:38:23.066530+0000', 'last_undegraded': '2024-09-16T15:38:23.066530+0000', 'last_fullsized': '2024-09-16T15:38:23.066530+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:38:23.050302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:38:23.050302+0000', 'last_clean_scrub_stamp': '2024-09-16T15:38:23.050302+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-16T15:38:28.849 INFO:tasks.ceph.ceph_manager.ceph:PG 5.b is not active+clean 2024-09-16T15:38:28.849 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T15:38:24.054567+0000', 'last_change': '2024-09-16T15:38:24.054567+0000', 'last_active': '2024-09-16T15:38:24.054567+0000', 'last_peered': '2024-09-16T15:38:24.054567+0000', 'last_clean': '2024-09-16T15:38:24.054567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:38:24.054567+0000', 'last_undegraded': '2024-09-16T15:38:24.054567+0000', 'last_fullsized': '2024-09-16T15:38:24.054567+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_clean_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T15:38:28.849 INFO:tasks.ceph.ceph_manager.ceph:PG 4.a is not active+clean 2024-09-16T15:38:28.849 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-16T15:38:23.299990+0000', 'last_change': '2024-09-16T15:38:23.299990+0000', 'last_active': '2024-09-16T15:38:23.050302+0000', 'last_peered': '2024-09-16T15:38:23.050302+0000', 'last_clean': '2024-09-16T15:38:23.050302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:38:23.299990+0000', 'last_undegraded': '2024-09-16T15:38:23.299990+0000', 'last_fullsized': '2024-09-16T15:38:23.299990+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:38:23.050302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:38:23.050302+0000', 'last_clean_scrub_stamp': '2024-09-16T15:38:23.050302+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-16T15:38:28.849 INFO:tasks.ceph.ceph_manager.ceph:PG 4.9 is not active+clean 2024-09-16T15:38:28.849 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-16T15:38:23.062871+0000', 'last_change': '2024-09-16T15:38:23.062871+0000', 'last_active': '2024-09-16T15:38:23.050302+0000', 'last_peered': '2024-09-16T15:38:23.050302+0000', 'last_clean': '2024-09-16T15:38:23.050302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:38:23.062871+0000', 'last_undegraded': '2024-09-16T15:38:23.062871+0000', 'last_fullsized': '2024-09-16T15:38:23.062871+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:38:23.050302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:38:23.050302+0000', 'last_clean_scrub_stamp': '2024-09-16T15:38:23.050302+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-16T15:38:28.849 INFO:tasks.ceph.ceph_manager.ceph:PG 5.9 is not active+clean 2024-09-16T15:38:28.849 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T15:38:24.054567+0000', 'last_change': '2024-09-16T15:38:24.054567+0000', 'last_active': '2024-09-16T15:38:24.054567+0000', 'last_peered': '2024-09-16T15:38:24.054567+0000', 'last_clean': '2024-09-16T15:38:24.054567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:38:24.054567+0000', 'last_undegraded': '2024-09-16T15:38:24.054567+0000', 'last_fullsized': '2024-09-16T15:38:24.054567+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_clean_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T15:38:28.849 INFO:tasks.ceph.ceph_manager.ceph:PG 4.8 is not active+clean 2024-09-16T15:38:28.849 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-16T15:38:23.062781+0000', 'last_change': '2024-09-16T15:38:23.062781+0000', 'last_active': '2024-09-16T15:38:23.050302+0000', 'last_peered': '2024-09-16T15:38:23.050302+0000', 'last_clean': '2024-09-16T15:38:23.050302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:38:23.062781+0000', 'last_undegraded': '2024-09-16T15:38:23.062781+0000', 'last_fullsized': '2024-09-16T15:38:23.062781+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:38:23.050302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:38:23.050302+0000', 'last_clean_scrub_stamp': '2024-09-16T15:38:23.050302+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-16T15:38:28.850 INFO:tasks.ceph.ceph_manager.ceph:PG 5.6 is not active+clean 2024-09-16T15:38:28.850 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T15:38:24.054567+0000', 'last_change': '2024-09-16T15:38:24.054567+0000', 'last_active': '2024-09-16T15:38:24.054567+0000', 'last_peered': '2024-09-16T15:38:24.054567+0000', 'last_clean': '2024-09-16T15:38:24.054567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:38:24.054567+0000', 'last_undegraded': '2024-09-16T15:38:24.054567+0000', 'last_fullsized': '2024-09-16T15:38:24.054567+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_clean_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T15:38:28.850 INFO:tasks.ceph.ceph_manager.ceph:PG 5.7 is not active+clean 2024-09-16T15:38:28.850 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T15:38:24.054567+0000', 'last_change': '2024-09-16T15:38:24.054567+0000', 'last_active': '2024-09-16T15:38:24.054567+0000', 'last_peered': '2024-09-16T15:38:24.054567+0000', 'last_clean': '2024-09-16T15:38:24.054567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:38:24.054567+0000', 'last_undegraded': '2024-09-16T15:38:24.054567+0000', 'last_fullsized': '2024-09-16T15:38:24.054567+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_clean_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T15:38:28.850 INFO:tasks.ceph.ceph_manager.ceph:PG 4.6 is not active+clean 2024-09-16T15:38:28.850 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-16T15:38:23.066482+0000', 'last_change': '2024-09-16T15:38:23.066482+0000', 'last_active': '2024-09-16T15:38:23.050302+0000', 'last_peered': '2024-09-16T15:38:23.050302+0000', 'last_clean': '2024-09-16T15:38:23.050302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:38:23.066482+0000', 'last_undegraded': '2024-09-16T15:38:23.066482+0000', 'last_fullsized': '2024-09-16T15:38:23.066482+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:38:23.050302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:38:23.050302+0000', 'last_clean_scrub_stamp': '2024-09-16T15:38:23.050302+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-16T15:38:28.850 INFO:tasks.ceph.ceph_manager.ceph:PG 5.5 is not active+clean 2024-09-16T15:38:28.850 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T15:38:24.054567+0000', 'last_change': '2024-09-16T15:38:24.054567+0000', 'last_active': '2024-09-16T15:38:24.054567+0000', 'last_peered': '2024-09-16T15:38:24.054567+0000', 'last_clean': '2024-09-16T15:38:24.054567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:38:24.054567+0000', 'last_undegraded': '2024-09-16T15:38:24.054567+0000', 'last_fullsized': '2024-09-16T15:38:24.054567+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_clean_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T15:38:28.850 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2 is not active+clean 2024-09-16T15:38:28.850 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T15:38:24.054567+0000', 'last_change': '2024-09-16T15:38:24.054567+0000', 'last_active': '2024-09-16T15:38:24.054567+0000', 'last_peered': '2024-09-16T15:38:24.054567+0000', 'last_clean': '2024-09-16T15:38:24.054567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:38:24.054567+0000', 'last_undegraded': '2024-09-16T15:38:24.054567+0000', 'last_fullsized': '2024-09-16T15:38:24.054567+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_clean_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T15:38:28.850 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3 is not active+clean 2024-09-16T15:38:28.851 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T15:38:24.054567+0000', 'last_change': '2024-09-16T15:38:24.054567+0000', 'last_active': '2024-09-16T15:38:24.054567+0000', 'last_peered': '2024-09-16T15:38:24.054567+0000', 'last_clean': '2024-09-16T15:38:24.054567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:38:24.054567+0000', 'last_undegraded': '2024-09-16T15:38:24.054567+0000', 'last_fullsized': '2024-09-16T15:38:24.054567+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_clean_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T15:38:28.851 INFO:tasks.ceph.ceph_manager.ceph:PG 5.0 is not active+clean 2024-09-16T15:38:28.851 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T15:38:24.054567+0000', 'last_change': '2024-09-16T15:38:24.054567+0000', 'last_active': '2024-09-16T15:38:24.054567+0000', 'last_peered': '2024-09-16T15:38:24.054567+0000', 'last_clean': '2024-09-16T15:38:24.054567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:38:24.054567+0000', 'last_undegraded': '2024-09-16T15:38:24.054567+0000', 'last_fullsized': '2024-09-16T15:38:24.054567+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_clean_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T15:38:28.851 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1 is not active+clean 2024-09-16T15:38:28.851 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-16T15:38:23.299981+0000', 'last_change': '2024-09-16T15:38:23.299981+0000', 'last_active': '2024-09-16T15:38:23.050302+0000', 'last_peered': '2024-09-16T15:38:23.050302+0000', 'last_clean': '2024-09-16T15:38:23.050302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:38:23.299981+0000', 'last_undegraded': '2024-09-16T15:38:23.299981+0000', 'last_fullsized': '2024-09-16T15:38:23.299981+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:38:23.050302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:38:23.050302+0000', 'last_clean_scrub_stamp': '2024-09-16T15:38:23.050302+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-16T15:38:28.851 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1 is not active+clean 2024-09-16T15:38:28.851 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T15:38:24.054567+0000', 'last_change': '2024-09-16T15:38:24.054567+0000', 'last_active': '2024-09-16T15:38:24.054567+0000', 'last_peered': '2024-09-16T15:38:24.054567+0000', 'last_clean': '2024-09-16T15:38:24.054567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:38:24.054567+0000', 'last_undegraded': '2024-09-16T15:38:24.054567+0000', 'last_fullsized': '2024-09-16T15:38:24.054567+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_clean_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T15:38:28.851 INFO:tasks.ceph.ceph_manager.ceph:PG 4.0 is not active+clean 2024-09-16T15:38:28.851 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-16T15:38:23.060778+0000', 'last_change': '2024-09-16T15:38:23.060778+0000', 'last_active': '2024-09-16T15:38:23.050302+0000', 'last_peered': '2024-09-16T15:38:23.050302+0000', 'last_clean': '2024-09-16T15:38:23.050302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:38:23.060778+0000', 'last_undegraded': '2024-09-16T15:38:23.060778+0000', 'last_fullsized': '2024-09-16T15:38:23.060778+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:38:23.050302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:38:23.050302+0000', 'last_clean_scrub_stamp': '2024-09-16T15:38:23.050302+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-16T15:38:28.851 INFO:tasks.ceph.ceph_manager.ceph:PG 5.4 is not active+clean 2024-09-16T15:38:28.851 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T15:38:24.054567+0000', 'last_change': '2024-09-16T15:38:24.054567+0000', 'last_active': '2024-09-16T15:38:24.054567+0000', 'last_peered': '2024-09-16T15:38:24.054567+0000', 'last_clean': '2024-09-16T15:38:24.054567+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:38:24.054567+0000', 'last_undegraded': '2024-09-16T15:38:24.054567+0000', 'last_fullsized': '2024-09-16T15:38:24.054567+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'last_clean_scrub_stamp': '2024-09-16T15:38:24.054567+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T15:38:28.852 INFO:tasks.ceph.ceph_manager.ceph:PG 4.5 is not active+clean 2024-09-16T15:38:28.852 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-16T15:38:23.063322+0000', 'last_change': '2024-09-16T15:38:23.063322+0000', 'last_active': '2024-09-16T15:38:23.050302+0000', 'last_peered': '2024-09-16T15:38:23.050302+0000', 'last_clean': '2024-09-16T15:38:23.050302+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T15:38:23.063322+0000', 'last_undegraded': '2024-09-16T15:38:23.063322+0000', 'last_fullsized': '2024-09-16T15:38:23.063322+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T15:38:23.050302+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T15:38:23.050302+0000', 'last_clean_scrub_stamp': '2024-09-16T15:38:23.050302+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-16T15:38:28.852 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T15:38:28.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.971+0000 7fd7d2b6b640 1 -- 172.21.15.98:0/3451327247 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7cc0d1ee0 msgr2=0x7fd7cc0d2430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:28.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.971+0000 7fd7d2b6b640 1 --2- 172.21.15.98:0/3451327247 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7cc0d1ee0 0x7fd7cc0d2430 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc0cb060 tx=0x7fd7bc02a8f0 comp rx=0 tx=0).stop 2024-09-16T15:38:28.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.971+0000 7fd7d2b6b640 1 -- 172.21.15.98:0/3451327247 shutdown_connections 2024-09-16T15:38:28.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.971+0000 7fd7d2b6b640 1 --2- 172.21.15.98:0/3451327247 >> v2:172.21.15.135:3300/0 conn(0x7fd7cc0b4ae0 0x7fd7cc0d2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:28.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.971+0000 7fd7d2b6b640 1 --2- 172.21.15.98:0/3451327247 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7cc0d1ee0 0x7fd7cc0d2430 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:28.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.971+0000 7fd7d2b6b640 1 --2- 172.21.15.98:0/3451327247 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd7cc1616e0 0x7fd7cc0b41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:28.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.971+0000 7fd7d2b6b640 1 -- 172.21.15.98:0/3451327247 >> 172.21.15.98:0/3451327247 conn(0x7fd7cc0d3fe0 msgr2=0x7fd7cc0d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:28.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.971+0000 7fd7d2b6b640 1 -- 172.21.15.98:0/3451327247 shutdown_connections 2024-09-16T15:38:28.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.971+0000 7fd7d2b6b640 1 -- 172.21.15.98:0/3451327247 wait complete. 2024-09-16T15:38:28.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.972+0000 7fd7d2b6b640 1 Processor -- start 2024-09-16T15:38:28.975 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.972+0000 7fd7d2b6b640 1 -- start start 2024-09-16T15:38:28.976 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.973+0000 7fd7d2b6b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7cc0b4ae0 0x7fd7cc151020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:28.976 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.973+0000 7fd7d2b6b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd7cc0d1ee0 0x7fd7cc1f8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:28.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.973+0000 7fd7d2b6b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7cc1616e0 0x7fd7cc160280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:28.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.973+0000 7fd7d2b6b640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd7cc161c30 con 0x7fd7cc1616e0 2024-09-16T15:38:28.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.973+0000 7fd7d2b6b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd7cc0b4910 con 0x7fd7cc0b4ae0 2024-09-16T15:38:28.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.973+0000 7fd7d2b6b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fd7cc0d03b0 con 0x7fd7cc0d1ee0 2024-09-16T15:38:28.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.973+0000 7fd7d1108640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7cc1616e0 0x7fd7cc160280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:28.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.973+0000 7fd7d1108640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7cc1616e0 0x7fd7cc160280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40796/0 (socket says 172.21.15.98:40796) 2024-09-16T15:38:28.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.973+0000 7fd7d1108640 1 -- 172.21.15.98:0/816573942 learned_addr learned my addr 172.21.15.98:0/816573942 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:28.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.974+0000 7fd7cbfff640 1 --2- 172.21.15.98:0/816573942 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd7cc0d1ee0 0x7fd7cc1f8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:28.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.974+0000 7fd7d0907640 1 --2- 172.21.15.98:0/816573942 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7cc0b4ae0 0x7fd7cc151020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:28.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.974+0000 7fd7d1108640 1 -- 172.21.15.98:0/816573942 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd7cc0d1ee0 msgr2=0x7fd7cc1f8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:28.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.974+0000 7fd7d1108640 1 --2- 172.21.15.98:0/816573942 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd7cc0d1ee0 0x7fd7cc1f8790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:28.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.974+0000 7fd7d1108640 1 -- 172.21.15.98:0/816573942 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7cc0b4ae0 msgr2=0x7fd7cc151020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:28.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.974+0000 7fd7d1108640 1 --2- 172.21.15.98:0/816573942 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7cc0b4ae0 0x7fd7cc151020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:28.978 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.974+0000 7fd7d1108640 1 -- 172.21.15.98:0/816573942 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7cc0a0170 con 0x7fd7cc1616e0 2024-09-16T15:38:28.978 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.974+0000 7fd7d1108640 1 --2- 172.21.15.98:0/816573942 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7cc1616e0 0x7fd7cc160280 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd7b4009fd0 tx=0x7fd7b400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:28.978 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.974+0000 7fd7c97fa640 1 -- 172.21.15.98:0/816573942 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b4011830 con 0x7fd7cc1616e0 2024-09-16T15:38:28.978 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.974+0000 7fd7c97fa640 1 -- 172.21.15.98:0/816573942 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd7b4016070 con 0x7fd7cc1616e0 2024-09-16T15:38:28.978 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.974+0000 7fd7d2b6b640 1 -- 172.21.15.98:0/816573942 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7cc1f8cd0 con 0x7fd7cc1616e0 2024-09-16T15:38:28.978 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.974+0000 7fd7c97fa640 1 -- 172.21.15.98:0/816573942 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b4011d40 con 0x7fd7cc1616e0 2024-09-16T15:38:28.978 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.974+0000 7fd7d2b6b640 1 -- 172.21.15.98:0/816573942 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7cc1518e0 con 0x7fd7cc1616e0 2024-09-16T15:38:28.978 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.975+0000 7fd7d2b6b640 1 -- 172.21.15.98:0/816573942 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7cc0b41c0 con 0x7fd7cc1616e0 2024-09-16T15:38:28.978 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.976+0000 7fd7c97fa640 1 -- 172.21.15.98:0/816573942 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7fd7b401b460 con 0x7fd7cc1616e0 2024-09-16T15:38:28.979 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.976+0000 7fd7c97fa640 1 --2- 172.21.15.98:0/816573942 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fd7ac078850 0x7fd7ac07ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:28.979 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.976+0000 7fd7c97fa640 1 -- 172.21.15.98:0/816573942 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fd7b409a650 con 0x7fd7cc1616e0 2024-09-16T15:38:28.979 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.976+0000 7fd7d0907640 1 --2- 172.21.15.98:0/816573942 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fd7ac078850 0x7fd7ac07ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:28.979 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.977+0000 7fd7d0907640 1 --2- 172.21.15.98:0/816573942 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fd7ac078850 0x7fd7ac07ad10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd7c400b810 tx=0x7fd7c4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:28.981 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:28.980+0000 7fd7c97fa640 1 -- 172.21.15.98:0/816573942 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7fd7b4062cc0 con 0x7fd7cc1616e0 2024-09-16T15:38:29.228 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:29.227+0000 7fd7d2b6b640 1 -- 172.21.15.98:0/816573942 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fd7cc0b5c00 con 0x7fd7cc1616e0 2024-09-16T15:38:29.228 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:29.227+0000 7fd7c97fa640 1 -- 172.21.15.98:0/816573942 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+2827 (secure 0 0 0) 0x7fd7b40625c0 con 0x7fd7cc1616e0 2024-09-16T15:38:29.229 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:38:29.229 INFO:teuthology.orchestra.run.smithi098.stdout:{"fsid":"52a38a45-21d2-4cb0-bb3a-4fb8be3a08df","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":68,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":34,"num_osds":8,"num_up_osds":8,"osd_up_since":1726501053,"num_in_osds":8,"osd_in_since":1726501043,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":57},{"state_name":"creating+peering","count":27},{"state_name":"active+clean","count":13}],"num_pgs":97,"num_pools":3,"num_objects":7,"data_bytes":591980,"bytes_used":225370112,"bytes_avail":772868743168,"bytes_total":773094113280,"unknown_pgs_ratio":0.58762884140014648,"inactive_pgs_ratio":0.27835050225257874,"write_bytes_sec":542,"read_op_per_sec":0,"write_op_per_sec":1},"fsmap":{"epoch":15,"btime":"2024-09-16T15:38:27:185206+0000","id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":4851}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-16T15:38:26.718532+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-16T15:38:29.231 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:29.229+0000 7fd7d2b6b640 1 -- 172.21.15.98:0/816573942 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fd7ac078850 msgr2=0x7fd7ac07ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:29.231 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:29.229+0000 7fd7d2b6b640 1 --2- 172.21.15.98:0/816573942 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fd7ac078850 0x7fd7ac07ad10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd7c400b810 tx=0x7fd7c4008040 comp rx=0 tx=0).stop 2024-09-16T15:38:29.231 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:29.229+0000 7fd7d2b6b640 1 -- 172.21.15.98:0/816573942 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7cc1616e0 msgr2=0x7fd7cc160280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:29.231 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:29.229+0000 7fd7d2b6b640 1 --2- 172.21.15.98:0/816573942 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7cc1616e0 0x7fd7cc160280 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd7b4009fd0 tx=0x7fd7b400b8e0 comp rx=0 tx=0).stop 2024-09-16T15:38:29.231 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:29.230+0000 7fd7d2b6b640 1 -- 172.21.15.98:0/816573942 shutdown_connections 2024-09-16T15:38:29.231 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:29.230+0000 7fd7d2b6b640 1 --2- 172.21.15.98:0/816573942 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7cc1616e0 0x7fd7cc160280 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:29.231 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:29.230+0000 7fd7d2b6b640 1 --2- 172.21.15.98:0/816573942 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd7cc0d1ee0 0x7fd7cc1f8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:29.231 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:29.230+0000 7fd7d2b6b640 1 --2- 172.21.15.98:0/816573942 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fd7ac078850 0x7fd7ac07ad10 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:29.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:29.230+0000 7fd7d2b6b640 1 --2- 172.21.15.98:0/816573942 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7cc0b4ae0 0x7fd7cc151020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:29.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:29.230+0000 7fd7d2b6b640 1 -- 172.21.15.98:0/816573942 >> 172.21.15.98:0/816573942 conn(0x7fd7cc0d3fe0 msgr2=0x7fd7cc0b5fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:29.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:29.230+0000 7fd7d2b6b640 1 -- 172.21.15.98:0/816573942 shutdown_connections 2024-09-16T15:38:29.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:29.230+0000 7fd7d2b6b640 1 -- 172.21.15.98:0/816573942 wait complete. 2024-09-16T15:38:29.242 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-16T15:38:29.242 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T15:38:29.343 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:29.341+0000 7f84ed9d3640 1 -- 172.21.15.98:0/269204253 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84e80d1610 msgr2=0x7f84e80cecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:29.343 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:29.341+0000 7f84ed9d3640 1 --2- 172.21.15.98:0/269204253 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84e80d1610 0x7f84e80cecc0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f84e0005fd0 tx=0x7f84e002a8b0 comp rx=0 tx=0).stop 2024-09-16T15:38:29.343 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:29.341+0000 7f84ed9d3640 1 -- 172.21.15.98:0/269204253 shutdown_connections 2024-09-16T15:38:29.343 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:29.341+0000 7f84ed9d3640 1 --2- 172.21.15.98:0/269204253 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84e80d1610 0x7f84e80cecc0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:29.343 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:29.341+0000 7f84ed9d3640 1 --2- 172.21.15.98:0/269204253 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f84e80d2050 0x7f84e80d10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:29.343 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:29.341+0000 7f84ed9d3640 1 -- 172.21.15.98:0/269204253 >> 172.21.15.98:0/269204253 conn(0x7f84e80d3fe0 msgr2=0x7f84e80d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:29.343 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:29.341+0000 7f84ed9d3640 1 -- 172.21.15.98:0/269204253 shutdown_connections 2024-09-16T15:38:29.343 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:29.341+0000 7f84ed9d3640 1 -- 172.21.15.98:0/269204253 wait complete. 2024-09-16T15:38:29.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:29.343+0000 7f84ed9d3640 1 Processor -- start 2024-09-16T15:38:29.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:29.343+0000 7f84ed9d3640 1 -- start start 2024-09-16T15:38:29.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:29.343+0000 7f84ed9d3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84e80d1610 0x7f84e80ca3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:29.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:29.343+0000 7f84ed9d3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84e80d2050 0x7f84e80b8130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:29.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:29.343+0000 7f84ed9d3640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f84e815e0d0 0x7f84e815b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:29.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:29.343+0000 7f84ed9d3640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f84e80cf5e0 con 0x7f84e80d2050 2024-09-16T15:38:29.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:29.343+0000 7f84ed9d3640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f84e80cf460 con 0x7f84e80d1610 2024-09-16T15:38:29.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:29.343+0000 7f84ed9d3640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f84e80cf760 con 0x7f84e815e0d0 2024-09-16T15:38:29.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:29.344+0000 7f84de7fc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84e80d2050 0x7f84e80b8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:29.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:29.344+0000 7f84de7fc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84e80d2050 0x7f84e80b8130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40804/0 (socket says 172.21.15.98:40804) 2024-09-16T15:38:29.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:29.344+0000 7f84de7fc640 1 -- 172.21.15.98:0/2953888522 learned_addr learned my addr 172.21.15.98:0/2953888522 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:29.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:29.344+0000 7f84de7fc640 1 -- 172.21.15.98:0/2953888522 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f84e815e0d0 msgr2=0x7f84e815b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:29.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:29.344+0000 7f84de7fc640 1 --2- 172.21.15.98:0/2953888522 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f84e815e0d0 0x7f84e815b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:29.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:29.344+0000 7f84de7fc640 1 -- 172.21.15.98:0/2953888522 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84e80d1610 msgr2=0x7f84e80ca3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:29.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:29.344+0000 7f84de7fc640 1 --2- 172.21.15.98:0/2953888522 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84e80d1610 0x7f84e80ca3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:29.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:29.344+0000 7f84de7fc640 1 -- 172.21.15.98:0/2953888522 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84e81f7dd0 con 0x7f84e80d2050 2024-09-16T15:38:29.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:29.344+0000 7f84de7fc640 1 --2- 172.21.15.98:0/2953888522 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84e80d2050 0x7f84e80b8130 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f84d000c9a0 tx=0x7f84d000ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:29.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:29.344+0000 7f84e4ff9640 1 -- 172.21.15.98:0/2953888522 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d0007c10 con 0x7f84e80d2050 2024-09-16T15:38:29.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:29.344+0000 7f84e4ff9640 1 -- 172.21.15.98:0/2953888522 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f84d0018480 con 0x7f84e80d2050 2024-09-16T15:38:29.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:29.344+0000 7f84ed9d3640 1 -- 172.21.15.98:0/2953888522 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84e81f8090 con 0x7f84e80d2050 2024-09-16T15:38:29.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:29.344+0000 7f84e4ff9640 1 -- 172.21.15.98:0/2953888522 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d00188d0 con 0x7f84e80d2050 2024-09-16T15:38:29.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:29.344+0000 7f84ed9d3640 1 -- 172.21.15.98:0/2953888522 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84e81f8650 con 0x7f84e80d2050 2024-09-16T15:38:29.348 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:29.345+0000 7f84ed9d3640 1 -- 172.21.15.98:0/2953888522 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84e80cfc80 con 0x7f84e80d2050 2024-09-16T15:38:29.348 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:29.346+0000 7f84e4ff9640 1 -- 172.21.15.98:0/2953888522 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7f84d0018a70 con 0x7f84e80d2050 2024-09-16T15:38:29.348 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:29.346+0000 7f84e4ff9640 1 --2- 172.21.15.98:0/2953888522 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f84c8078850 0x7f84c807ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:29.348 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:29.346+0000 7f84e4ff9640 1 -- 172.21.15.98:0/2953888522 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f84d009b380 con 0x7f84e80d2050 2024-09-16T15:38:29.348 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:29.347+0000 7f84e6ffd640 1 --2- 172.21.15.98:0/2953888522 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f84c8078850 0x7f84c807ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:29.348 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:29.347+0000 7f84e6ffd640 1 --2- 172.21.15.98:0/2953888522 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f84c8078850 0x7f84c807ad10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f84d8001510 tx=0x7f84d8007930 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:29.351 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:29.350+0000 7f84e4ff9640 1 -- 172.21.15.98:0/2953888522 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7f84d0063a80 con 0x7f84e80d2050 2024-09-16T15:38:29.526 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:29.525+0000 7f84ed9d3640 1 -- 172.21.15.98:0/2953888522 --> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f84e815d160 con 0x7f84c8078850 2024-09-16T15:38:29.530 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:29.529+0000 7f84e4ff9640 1 -- 172.21.15.98:0/2953888522 <== mgr.4100 v2:172.21.15.135:6800/699234772 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+241492 (secure 0 0 0) 0x7f84e815d160 con 0x7f84c8078850 2024-09-16T15:38:29.533 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:38:29.534 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2024-09-16T15:38:29.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:29.532+0000 7f84ed9d3640 1 -- 172.21.15.98:0/2953888522 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f84c8078850 msgr2=0x7f84c807ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:29.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:29.532+0000 7f84ed9d3640 1 --2- 172.21.15.98:0/2953888522 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f84c8078850 0x7f84c807ad10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f84d8001510 tx=0x7f84d8007930 comp rx=0 tx=0).stop 2024-09-16T15:38:29.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:29.532+0000 7f84ed9d3640 1 -- 172.21.15.98:0/2953888522 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84e80d2050 msgr2=0x7f84e80b8130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:29.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:29.532+0000 7f84ed9d3640 1 --2- 172.21.15.98:0/2953888522 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84e80d2050 0x7f84e80b8130 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f84d000c9a0 tx=0x7f84d000ce60 comp rx=0 tx=0).stop 2024-09-16T15:38:29.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:29.532+0000 7f84ed9d3640 1 -- 172.21.15.98:0/2953888522 shutdown_connections 2024-09-16T15:38:29.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:29.532+0000 7f84ed9d3640 1 --2- 172.21.15.98:0/2953888522 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f84e815e0d0 0x7f84e815b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:29.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:29.532+0000 7f84ed9d3640 1 --2- 172.21.15.98:0/2953888522 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84e80d2050 0x7f84e80b8130 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:29.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:29.532+0000 7f84ed9d3640 1 --2- 172.21.15.98:0/2953888522 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f84c8078850 0x7f84c807ad10 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:29.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:29.532+0000 7f84ed9d3640 1 --2- 172.21.15.98:0/2953888522 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84e80d1610 0x7f84e80ca3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:29.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:29.532+0000 7f84ed9d3640 1 -- 172.21.15.98:0/2953888522 >> 172.21.15.98:0/2953888522 conn(0x7f84e80d3fe0 msgr2=0x7f84e80d43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:29.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:29.532+0000 7f84ed9d3640 1 -- 172.21.15.98:0/2953888522 shutdown_connections 2024-09-16T15:38:29.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:29.532+0000 7f84ed9d3640 1 -- 172.21.15.98:0/2953888522 wait complete. 2024-09-16T15:38:29.544 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2024-09-16T15:38:28.718881+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591980,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":110,"num_write_kb":1631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80,"ondisk_log_size":80,"up":80,"acting":80,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":23,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220088,"kb_used_data":3828,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754632,"statfs":{"total":773094113280,"available":772868743168,"internally_reserved":0,"allocated":3919872,"data_stored":2184927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1612,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.663879"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:26.083635+0000","last_change":"2024-09-16T15:38:25.081610+0000","last_active":"2024-09-16T15:38:26.083635+0000","last_peered":"2024-09-16T15:38:26.083635+0000","last_clean":"2024-09-16T15:38:26.083635+0000","last_became_active":"2024-09-16T15:38:25.081334+0000","last_became_peered":"2024-09-16T15:38:25.081334+0000","last_unstale":"2024-09-16T15:38:26.083635+0000","last_undegraded":"2024-09-16T15:38:26.083635+0000","last_fullsized":"2024-09-16T15:38:26.083635+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:21:16.692843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:26.084129+0000","last_change":"2024-09-16T15:38:25.091716+0000","last_active":"2024-09-16T15:38:26.084129+0000","last_peered":"2024-09-16T15:38:26.084129+0000","last_clean":"2024-09-16T15:38:26.084129+0000","last_became_active":"2024-09-16T15:38:25.091452+0000","last_became_peered":"2024-09-16T15:38:25.091452+0000","last_unstale":"2024-09-16T15:38:26.084129+0000","last_undegraded":"2024-09-16T15:38:26.084129+0000","last_fullsized":"2024-09-16T15:38:26.084129+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:12:59.070266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:26.083728+0000","last_change":"2024-09-16T15:38:25.086524+0000","last_active":"2024-09-16T15:38:26.083728+0000","last_peered":"2024-09-16T15:38:26.083728+0000","last_clean":"2024-09-16T15:38:26.083728+0000","last_became_active":"2024-09-16T15:38:25.084686+0000","last_became_peered":"2024-09-16T15:38:25.084686+0000","last_unstale":"2024-09-16T15:38:26.083728+0000","last_undegraded":"2024-09-16T15:38:26.083728+0000","last_fullsized":"2024-09-16T15:38:26.083728+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:29:31.900295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:26.084265+0000","last_change":"2024-09-16T15:38:25.098781+0000","last_active":"2024-09-16T15:38:26.084265+0000","last_peered":"2024-09-16T15:38:26.084265+0000","last_clean":"2024-09-16T15:38:26.084265+0000","last_became_active":"2024-09-16T15:38:25.098502+0000","last_became_peered":"2024-09-16T15:38:25.098502+0000","last_unstale":"2024-09-16T15:38:26.084265+0000","last_undegraded":"2024-09-16T15:38:26.084265+0000","last_fullsized":"2024-09-16T15:38:26.084265+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:28:29.645680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.063408+0000","last_change":"2024-09-16T15:38:23.063408+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.063408+0000","last_undegraded":"2024-09-16T15:38:23.063408+0000","last_fullsized":"2024-09-16T15:38:23.063408+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.060791+0000","last_change":"2024-09-16T15:38:23.060791+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.060791+0000","last_undegraded":"2024-09-16T15:38:23.060791+0000","last_fullsized":"2024-09-16T15:38:23.060791+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.064477+0000","last_change":"2024-09-16T15:38:23.064477+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.064477+0000","last_undegraded":"2024-09-16T15:38:23.064477+0000","last_fullsized":"2024-09-16T15:38:23.064477+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.060892+0000","last_change":"2024-09-16T15:38:23.060892+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.060892+0000","last_undegraded":"2024-09-16T15:38:23.060892+0000","last_fullsized":"2024-09-16T15:38:23.060892+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.300474+0000","last_change":"2024-09-16T15:38:23.300474+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.300474+0000","last_undegraded":"2024-09-16T15:38:23.300474+0000","last_fullsized":"2024-09-16T15:38:23.300474+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.300424+0000","last_change":"2024-09-16T15:38:23.300424+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.300424+0000","last_undegraded":"2024-09-16T15:38:23.300424+0000","last_fullsized":"2024-09-16T15:38:23.300424+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.064486+0000","last_change":"2024-09-16T15:38:23.064486+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.064486+0000","last_undegraded":"2024-09-16T15:38:23.064486+0000","last_fullsized":"2024-09-16T15:38:23.064486+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.299993+0000","last_change":"2024-09-16T15:38:23.299993+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.299993+0000","last_undegraded":"2024-09-16T15:38:23.299993+0000","last_fullsized":"2024-09-16T15:38:23.299993+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.066530+0000","last_change":"2024-09-16T15:38:23.066530+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.066530+0000","last_undegraded":"2024-09-16T15:38:23.066530+0000","last_fullsized":"2024-09-16T15:38:23.066530+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.066906+0000","last_change":"2024-09-16T15:38:23.066906+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.066906+0000","last_undegraded":"2024-09-16T15:38:23.066906+0000","last_fullsized":"2024-09-16T15:38:23.066906+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.064066+0000","last_change":"2024-09-16T15:38:23.064066+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.064066+0000","last_undegraded":"2024-09-16T15:38:23.064066+0000","last_fullsized":"2024-09-16T15:38:23.064066+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:26.084231+0000","last_change":"2024-09-16T15:38:24.070463+0000","last_active":"2024-09-16T15:38:26.084231+0000","last_peered":"2024-09-16T15:38:26.084231+0000","last_clean":"2024-09-16T15:38:26.084231+0000","last_became_active":"2024-09-16T15:38:24.070192+0000","last_became_peered":"2024-09-16T15:38:24.070192+0000","last_unstale":"2024-09-16T15:38:26.084231+0000","last_undegraded":"2024-09-16T15:38:26.084231+0000","last_fullsized":"2024-09-16T15:38:26.084231+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:41:52.194650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:26.083546+0000","last_change":"2024-09-16T15:38:25.086423+0000","last_active":"2024-09-16T15:38:26.083546+0000","last_peered":"2024-09-16T15:38:26.083546+0000","last_clean":"2024-09-16T15:38:26.083546+0000","last_became_active":"2024-09-16T15:38:25.086150+0000","last_became_peered":"2024-09-16T15:38:25.086150+0000","last_unstale":"2024-09-16T15:38:26.083546+0000","last_undegraded":"2024-09-16T15:38:26.083546+0000","last_fullsized":"2024-09-16T15:38:26.083546+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:47:05.942838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.300000+0000","last_change":"2024-09-16T15:38:23.300000+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.300000+0000","last_undegraded":"2024-09-16T15:38:23.300000+0000","last_fullsized":"2024-09-16T15:38:23.300000+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.060721+0000","last_change":"2024-09-16T15:38:23.060721+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.060721+0000","last_undegraded":"2024-09-16T15:38:23.060721+0000","last_fullsized":"2024-09-16T15:38:23.060721+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.060776+0000","last_change":"2024-09-16T15:38:23.060776+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.060776+0000","last_undegraded":"2024-09-16T15:38:23.060776+0000","last_fullsized":"2024-09-16T15:38:23.060776+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.064497+0000","last_change":"2024-09-16T15:38:23.064497+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.064497+0000","last_undegraded":"2024-09-16T15:38:23.064497+0000","last_fullsized":"2024-09-16T15:38:23.064497+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.064522+0000","last_change":"2024-09-16T15:38:23.064522+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.064522+0000","last_undegraded":"2024-09-16T15:38:23.064522+0000","last_fullsized":"2024-09-16T15:38:23.064522+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.299985+0000","last_change":"2024-09-16T15:38:23.299985+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.299985+0000","last_undegraded":"2024-09-16T15:38:23.299985+0000","last_fullsized":"2024-09-16T15:38:23.299985+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.063716+0000","last_change":"2024-09-16T15:38:23.063716+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.063716+0000","last_undegraded":"2024-09-16T15:38:23.063716+0000","last_fullsized":"2024-09-16T15:38:23.063716+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.058527+0000","last_change":"2024-09-16T15:38:23.058527+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.058527+0000","last_undegraded":"2024-09-16T15:38:23.058527+0000","last_fullsized":"2024-09-16T15:38:23.058527+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:26.083693+0000","last_change":"2024-09-16T15:38:25.089843+0000","last_active":"2024-09-16T15:38:26.083693+0000","last_peered":"2024-09-16T15:38:26.083693+0000","last_clean":"2024-09-16T15:38:26.083693+0000","last_became_active":"2024-09-16T15:38:25.089381+0000","last_became_peered":"2024-09-16T15:38:25.089381+0000","last_unstale":"2024-09-16T15:38:26.083693+0000","last_undegraded":"2024-09-16T15:38:26.083693+0000","last_fullsized":"2024-09-16T15:38:26.083693+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T23:03:36.157931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.066530+0000","last_change":"2024-09-16T15:38:23.066530+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.066530+0000","last_undegraded":"2024-09-16T15:38:23.066530+0000","last_fullsized":"2024-09-16T15:38:23.066530+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.299990+0000","last_change":"2024-09-16T15:38:23.299990+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.299990+0000","last_undegraded":"2024-09-16T15:38:23.299990+0000","last_fullsized":"2024-09-16T15:38:23.299990+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:26.083674+0000","last_change":"2024-09-16T15:38:25.087283+0000","last_active":"2024-09-16T15:38:26.083674+0000","last_peered":"2024-09-16T15:38:26.083674+0000","last_clean":"2024-09-16T15:38:26.083674+0000","last_became_active":"2024-09-16T15:38:25.087060+0000","last_became_peered":"2024-09-16T15:38:25.087060+0000","last_unstale":"2024-09-16T15:38:26.083674+0000","last_undegraded":"2024-09-16T15:38:26.083674+0000","last_fullsized":"2024-09-16T15:38:26.083674+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:30:36.134629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.062871+0000","last_change":"2024-09-16T15:38:23.062871+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.062871+0000","last_undegraded":"2024-09-16T15:38:23.062871+0000","last_fullsized":"2024-09-16T15:38:23.062871+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.062781+0000","last_change":"2024-09-16T15:38:23.062781+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.062781+0000","last_undegraded":"2024-09-16T15:38:23.062781+0000","last_fullsized":"2024-09-16T15:38:23.062781+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:26.083983+0000","last_change":"2024-09-16T15:38:24.076858+0000","last_active":"2024-09-16T15:38:26.083983+0000","last_peered":"2024-09-16T15:38:26.083983+0000","last_clean":"2024-09-16T15:38:26.083983+0000","last_became_active":"2024-09-16T15:38:24.076591+0000","last_became_peered":"2024-09-16T15:38:24.076591+0000","last_unstale":"2024-09-16T15:38:26.083983+0000","last_undegraded":"2024-09-16T15:38:26.083983+0000","last_fullsized":"2024-09-16T15:38:26.083983+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:47:03.377191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.066482+0000","last_change":"2024-09-16T15:38:23.066482+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.066482+0000","last_undegraded":"2024-09-16T15:38:23.066482+0000","last_fullsized":"2024-09-16T15:38:23.066482+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:26.084357+0000","last_change":"2024-09-16T15:38:24.072331+0000","last_active":"2024-09-16T15:38:26.084357+0000","last_peered":"2024-09-16T15:38:26.084357+0000","last_clean":"2024-09-16T15:38:26.084357+0000","last_became_active":"2024-09-16T15:38:24.071959+0000","last_became_peered":"2024-09-16T15:38:24.071959+0000","last_unstale":"2024-09-16T15:38:26.084357+0000","last_undegraded":"2024-09-16T15:38:26.084357+0000","last_fullsized":"2024-09-16T15:38:26.084357+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:30:09.123984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:26.083749+0000","last_change":"2024-09-16T15:38:24.076097+0000","last_active":"2024-09-16T15:38:26.083749+0000","last_peered":"2024-09-16T15:38:26.083749+0000","last_clean":"2024-09-16T15:38:26.083749+0000","last_became_active":"2024-09-16T15:38:24.075851+0000","last_became_peered":"2024-09-16T15:38:24.075851+0000","last_unstale":"2024-09-16T15:38:26.083749+0000","last_undegraded":"2024-09-16T15:38:26.083749+0000","last_fullsized":"2024-09-16T15:38:26.083749+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T21:07:59.238679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:26.083815+0000","last_change":"2024-09-16T15:38:24.073845+0000","last_active":"2024-09-16T15:38:26.083815+0000","last_peered":"2024-09-16T15:38:26.083815+0000","last_clean":"2024-09-16T15:38:26.083815+0000","last_became_active":"2024-09-16T15:38:24.073602+0000","last_became_peered":"2024-09-16T15:38:24.073602+0000","last_unstale":"2024-09-16T15:38:26.083815+0000","last_undegraded":"2024-09-16T15:38:26.083815+0000","last_fullsized":"2024-09-16T15:38:26.083815+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:33:40.349674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.299981+0000","last_change":"2024-09-16T15:38:23.299981+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.299981+0000","last_undegraded":"2024-09-16T15:38:23.299981+0000","last_fullsized":"2024-09-16T15:38:23.299981+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.060778+0000","last_change":"2024-09-16T15:38:23.060778+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.060778+0000","last_undegraded":"2024-09-16T15:38:23.060778+0000","last_fullsized":"2024-09-16T15:38:23.060778+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T15:38:24.054567+0000","last_change":"2024-09-16T15:38:24.054567+0000","last_active":"2024-09-16T15:38:24.054567+0000","last_peered":"2024-09-16T15:38:24.054567+0000","last_clean":"2024-09-16T15:38:24.054567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:24.054567+0000","last_undegraded":"2024-09-16T15:38:24.054567+0000","last_fullsized":"2024-09-16T15:38:24.054567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-16T15:38:23.063322+0000","last_change":"2024-09-16T15:38:23.063322+0000","last_active":"2024-09-16T15:38:23.050302+0000","last_peered":"2024-09-16T15:38:23.050302+0000","last_clean":"2024-09-16T15:38:23.050302+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T15:38:23.063322+0000","last_undegraded":"2024-09-16T15:38:23.063322+0000","last_fullsized":"2024-09-16T15:38:23.063322+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":125,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-16T15:38:23.063511+0000","last_change":"2024-09-16T15:37:37.258601+0000","last_active":"2024-09-16T15:38:23.063511+0000","last_peered":"2024-09-16T15:38:23.063511+0000","last_clean":"2024-09-16T15:38:23.063511+0000","last_became_active":"2024-09-16T15:37:37.257584+0000","last_became_peered":"2024-09-16T15:37:37.257584+0000","last_unstale":"2024-09-16T15:38:23.063511+0000","last_undegraded":"2024-09-16T15:38:23.063511+0000","last_fullsized":"2024-09-16T15:38:23.063511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:35.447043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:35.447043+0000","last_clean_scrub_stamp":"2024-09-16T15:37:35.447043+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:43:17.464894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":14,"acting":14,"num_store_stats":1},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":1612,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":339968,"data_stored":125085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509454,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":933888,"data_stored":715453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":327680,"data_stored":119268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509455,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":339968,"data_stored":125085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":339968,"data_stored":125085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509455,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27936,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343904,"statfs":{"total":96636764160,"available":96608157696,"internally_reserved":0,"allocated":921600,"data_stored":709636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509453,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":327680,"data_stored":119268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":389120,"data_stored":146047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T15:38:30.051 INFO:tasks.ceph.mds.a.smithi098.stderr:2024-09-16T15:38:30.050+0000 7fe796ef2640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-16T15:38:32.548 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T15:38:32.661 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:32.660+0000 7eff83dbb640 1 -- 172.21.15.98:0/2717293130 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff7c15f5a0 msgr2=0x7eff7c0b2440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:32.661 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:32.660+0000 7eff83dbb640 1 --2- 172.21.15.98:0/2717293130 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff7c15f5a0 0x7eff7c0b2440 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7eff7c0cfbb0 tx=0x7eff7802a4a0 comp rx=0 tx=0).stop 2024-09-16T15:38:32.661 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:32.660+0000 7eff83dbb640 1 -- 172.21.15.98:0/2717293130 shutdown_connections 2024-09-16T15:38:32.661 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:32.660+0000 7eff83dbb640 1 --2- 172.21.15.98:0/2717293130 >> v2:172.21.15.135:3300/0 conn(0x7eff7c0ccf00 0x7eff7c0acd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:32.661 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:32.660+0000 7eff83dbb640 1 --2- 172.21.15.98:0/2717293130 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff7c15f5a0 0x7eff7c0b2440 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:32.661 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:32.660+0000 7eff83dbb640 1 -- 172.21.15.98:0/2717293130 >> 172.21.15.98:0/2717293130 conn(0x7eff7c0b1950 msgr2=0x7eff7c0b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:32.662 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:32.660+0000 7eff83dbb640 1 -- 172.21.15.98:0/2717293130 shutdown_connections 2024-09-16T15:38:32.662 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:32.660+0000 7eff83dbb640 1 -- 172.21.15.98:0/2717293130 wait complete. 2024-09-16T15:38:32.662 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:32.661+0000 7eff83dbb640 1 Processor -- start 2024-09-16T15:38:32.662 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:32.661+0000 7eff83dbb640 1 -- start start 2024-09-16T15:38:32.664 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:32.662+0000 7eff83dbb640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff7c0ad270 0x7eff7c150ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:32.664 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:32.662+0000 7eff83dbb640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff7c0ccf00 0x7eff7c1468f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:32.664 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:32.662+0000 7eff83dbb640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff7c15f5a0 0x7eff7c152630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:32.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:32.662+0000 7eff83dbb640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7eff7c06f160 con 0x7eff7c15f5a0 2024-09-16T15:38:32.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:32.662+0000 7eff83dbb640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7eff7c06f2e0 con 0x7eff7c0ad270 2024-09-16T15:38:32.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:32.662+0000 7eff83dbb640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7eff7c06f460 con 0x7eff7c0ccf00 2024-09-16T15:38:32.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:32.662+0000 7eff82358640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff7c15f5a0 0x7eff7c152630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:32.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:32.662+0000 7eff82358640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff7c15f5a0 0x7eff7c152630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40824/0 (socket says 172.21.15.98:40824) 2024-09-16T15:38:32.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:32.662+0000 7eff82358640 1 -- 172.21.15.98:0/252668301 learned_addr learned my addr 172.21.15.98:0/252668301 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:32.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:32.662+0000 7eff81b57640 1 --2- 172.21.15.98:0/252668301 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff7c0ad270 0x7eff7c150ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:32.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:32.662+0000 7eff81356640 1 --2- 172.21.15.98:0/252668301 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff7c0ccf00 0x7eff7c1468f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:32.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:32.662+0000 7eff82358640 1 -- 172.21.15.98:0/252668301 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff7c0ccf00 msgr2=0x7eff7c1468f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:32.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:32.662+0000 7eff82358640 1 --2- 172.21.15.98:0/252668301 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff7c0ccf00 0x7eff7c1468f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:32.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:32.662+0000 7eff82358640 1 -- 172.21.15.98:0/252668301 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff7c0ad270 msgr2=0x7eff7c150ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:32.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:32.662+0000 7eff82358640 1 --2- 172.21.15.98:0/252668301 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff7c0ad270 0x7eff7c150ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:32.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:32.662+0000 7eff82358640 1 -- 172.21.15.98:0/252668301 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff7c153300 con 0x7eff7c15f5a0 2024-09-16T15:38:32.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:32.663+0000 7eff82358640 1 --2- 172.21.15.98:0/252668301 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff7c15f5a0 0x7eff7c152630 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7eff7400c770 tx=0x7eff7400cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:32.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:32.663+0000 7eff6e7fc640 1 -- 172.21.15.98:0/252668301 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff74017070 con 0x7eff7c15f5a0 2024-09-16T15:38:32.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:32.663+0000 7eff6e7fc640 1 -- 172.21.15.98:0/252668301 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7eff74003ca0 con 0x7eff7c15f5a0 2024-09-16T15:38:32.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:32.663+0000 7eff83dbb640 1 -- 172.21.15.98:0/252668301 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff7c1535a0 con 0x7eff7c15f5a0 2024-09-16T15:38:32.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:32.663+0000 7eff6e7fc640 1 -- 172.21.15.98:0/252668301 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff740052d0 con 0x7eff7c15f5a0 2024-09-16T15:38:32.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:32.663+0000 7eff83dbb640 1 -- 172.21.15.98:0/252668301 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff7c0d0940 con 0x7eff7c15f5a0 2024-09-16T15:38:32.667 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:32.664+0000 7eff83dbb640 1 -- 172.21.15.98:0/252668301 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff7c153990 con 0x7eff7c15f5a0 2024-09-16T15:38:32.667 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:32.665+0000 7eff6e7fc640 1 -- 172.21.15.98:0/252668301 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7eff7401a070 con 0x7eff7c15f5a0 2024-09-16T15:38:32.667 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:32.665+0000 7eff6e7fc640 1 --2- 172.21.15.98:0/252668301 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7eff60078850 0x7eff6007ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:32.667 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:32.665+0000 7eff6e7fc640 1 -- 172.21.15.98:0/252668301 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7eff74099d50 con 0x7eff7c15f5a0 2024-09-16T15:38:32.667 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:32.665+0000 7eff81b57640 1 --2- 172.21.15.98:0/252668301 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7eff60078850 0x7eff6007ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:32.667 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:32.666+0000 7eff81b57640 1 --2- 172.21.15.98:0/252668301 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7eff60078850 0x7eff6007ad10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7eff78034000 tx=0x7eff78004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:32.670 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:32.669+0000 7eff6e7fc640 1 -- 172.21.15.98:0/252668301 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7eff7409d030 con 0x7eff7c15f5a0 2024-09-16T15:38:32.845 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:32.844+0000 7eff83dbb640 1 -- 172.21.15.98:0/252668301 --> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7eff7c153770 con 0x7eff60078850 2024-09-16T15:38:32.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:32.849+0000 7eff6e7fc640 1 -- 172.21.15.98:0/252668301 <== mgr.4100 v2:172.21.15.135:6800/699234772 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251931 (secure 0 0 0) 0x7eff7c153770 con 0x7eff60078850 2024-09-16T15:38:32.852 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:38:32.853 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2024-09-16T15:38:32.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:32.852+0000 7eff83dbb640 1 -- 172.21.15.98:0/252668301 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7eff60078850 msgr2=0x7eff6007ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:32.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:32.852+0000 7eff83dbb640 1 --2- 172.21.15.98:0/252668301 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7eff60078850 0x7eff6007ad10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7eff78034000 tx=0x7eff78004730 comp rx=0 tx=0).stop 2024-09-16T15:38:32.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:32.852+0000 7eff83dbb640 1 -- 172.21.15.98:0/252668301 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff7c15f5a0 msgr2=0x7eff7c152630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:32.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:32.852+0000 7eff83dbb640 1 --2- 172.21.15.98:0/252668301 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff7c15f5a0 0x7eff7c152630 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7eff7400c770 tx=0x7eff7400cb70 comp rx=0 tx=0).stop 2024-09-16T15:38:32.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:32.852+0000 7eff83dbb640 1 -- 172.21.15.98:0/252668301 shutdown_connections 2024-09-16T15:38:32.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:32.852+0000 7eff83dbb640 1 --2- 172.21.15.98:0/252668301 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff7c15f5a0 0x7eff7c152630 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:32.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:32.852+0000 7eff83dbb640 1 --2- 172.21.15.98:0/252668301 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7eff7c0ccf00 0x7eff7c1468f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:32.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:32.852+0000 7eff83dbb640 1 --2- 172.21.15.98:0/252668301 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7eff60078850 0x7eff6007ad10 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:32.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:32.852+0000 7eff83dbb640 1 --2- 172.21.15.98:0/252668301 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff7c0ad270 0x7eff7c150ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:32.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:32.852+0000 7eff83dbb640 1 -- 172.21.15.98:0/252668301 >> 172.21.15.98:0/252668301 conn(0x7eff7c0b1950 msgr2=0x7eff7c09c5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:32.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:32.852+0000 7eff83dbb640 1 -- 172.21.15.98:0/252668301 shutdown_connections 2024-09-16T15:38:32.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:32.852+0000 7eff83dbb640 1 -- 172.21.15.98:0/252668301 wait complete. 2024-09-16T15:38:32.864 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":58,"stamp":"2024-09-16T15:38:32.719765+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":162,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220420,"kb_used_data":4168,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754300,"statfs":{"total":773094113280,"available":772868403200,"internally_reserved":0,"allocated":4268032,"data_stored":2341036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001723"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:27.049018+0000","last_change":"2024-09-16T15:38:25.089025+0000","last_active":"2024-09-16T15:38:27.049018+0000","last_peered":"2024-09-16T15:38:27.049018+0000","last_clean":"2024-09-16T15:38:27.049018+0000","last_became_active":"2024-09-16T15:38:25.088765+0000","last_became_peered":"2024-09-16T15:38:25.088765+0000","last_unstale":"2024-09-16T15:38:27.049018+0000","last_undegraded":"2024-09-16T15:38:27.049018+0000","last_fullsized":"2024-09-16T15:38:27.049018+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:26:03.896313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:26.090621+0000","last_change":"2024-09-16T15:38:25.092940+0000","last_active":"2024-09-16T15:38:26.090621+0000","last_peered":"2024-09-16T15:38:26.090621+0000","last_clean":"2024-09-16T15:38:26.090621+0000","last_became_active":"2024-09-16T15:38:25.092661+0000","last_became_peered":"2024-09-16T15:38:25.092661+0000","last_unstale":"2024-09-16T15:38:26.090621+0000","last_undegraded":"2024-09-16T15:38:26.090621+0000","last_fullsized":"2024-09-16T15:38:26.090621+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:17:40.527609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:26.655199+0000","last_change":"2024-09-16T15:38:25.091164+0000","last_active":"2024-09-16T15:38:26.655199+0000","last_peered":"2024-09-16T15:38:26.655199+0000","last_clean":"2024-09-16T15:38:26.655199+0000","last_became_active":"2024-09-16T15:38:25.090915+0000","last_became_peered":"2024-09-16T15:38:25.090915+0000","last_unstale":"2024-09-16T15:38:26.655199+0000","last_undegraded":"2024-09-16T15:38:26.655199+0000","last_fullsized":"2024-09-16T15:38:26.655199+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:04:48.775651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:27.301892+0000","last_change":"2024-09-16T15:38:25.092789+0000","last_active":"2024-09-16T15:38:27.301892+0000","last_peered":"2024-09-16T15:38:27.301892+0000","last_clean":"2024-09-16T15:38:27.301892+0000","last_became_active":"2024-09-16T15:38:25.092453+0000","last_became_peered":"2024-09-16T15:38:25.092453+0000","last_unstale":"2024-09-16T15:38:27.301892+0000","last_undegraded":"2024-09-16T15:38:27.301892+0000","last_fullsized":"2024-09-16T15:38:27.301892+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:42:07.296882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:26.090515+0000","last_change":"2024-09-16T15:38:25.088092+0000","last_active":"2024-09-16T15:38:26.090515+0000","last_peered":"2024-09-16T15:38:26.090515+0000","last_clean":"2024-09-16T15:38:26.090515+0000","last_became_active":"2024-09-16T15:38:25.087787+0000","last_became_peered":"2024-09-16T15:38:25.087787+0000","last_unstale":"2024-09-16T15:38:26.090515+0000","last_undegraded":"2024-09-16T15:38:26.090515+0000","last_fullsized":"2024-09-16T15:38:26.090515+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T23:18:13.792238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:26.083714+0000","last_change":"2024-09-16T15:38:25.091350+0000","last_active":"2024-09-16T15:38:26.083714+0000","last_peered":"2024-09-16T15:38:26.083714+0000","last_clean":"2024-09-16T15:38:26.083714+0000","last_became_active":"2024-09-16T15:38:25.091022+0000","last_became_peered":"2024-09-16T15:38:25.091022+0000","last_unstale":"2024-09-16T15:38:26.083714+0000","last_undegraded":"2024-09-16T15:38:26.083714+0000","last_fullsized":"2024-09-16T15:38:26.083714+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:29:04.507715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:27.048736+0000","last_change":"2024-09-16T15:38:25.084279+0000","last_active":"2024-09-16T15:38:27.048736+0000","last_peered":"2024-09-16T15:38:27.048736+0000","last_clean":"2024-09-16T15:38:27.048736+0000","last_became_active":"2024-09-16T15:38:25.084020+0000","last_became_peered":"2024-09-16T15:38:25.084020+0000","last_unstale":"2024-09-16T15:38:27.048736+0000","last_undegraded":"2024-09-16T15:38:27.048736+0000","last_fullsized":"2024-09-16T15:38:27.048736+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:00:27.981519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:27.048680+0000","last_change":"2024-09-16T15:38:25.087737+0000","last_active":"2024-09-16T15:38:27.048680+0000","last_peered":"2024-09-16T15:38:27.048680+0000","last_clean":"2024-09-16T15:38:27.048680+0000","last_became_active":"2024-09-16T15:38:25.087451+0000","last_became_peered":"2024-09-16T15:38:25.087451+0000","last_unstale":"2024-09-16T15:38:27.048680+0000","last_undegraded":"2024-09-16T15:38:27.048680+0000","last_fullsized":"2024-09-16T15:38:27.048680+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:23:14.228513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:26.655253+0000","last_change":"2024-09-16T15:38:25.092338+0000","last_active":"2024-09-16T15:38:26.655253+0000","last_peered":"2024-09-16T15:38:26.655253+0000","last_clean":"2024-09-16T15:38:26.655253+0000","last_became_active":"2024-09-16T15:38:25.092079+0000","last_became_peered":"2024-09-16T15:38:25.092079+0000","last_unstale":"2024-09-16T15:38:26.655253+0000","last_undegraded":"2024-09-16T15:38:26.655253+0000","last_fullsized":"2024-09-16T15:38:26.655253+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:28:10.072758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:27.302125+0000","last_change":"2024-09-16T15:38:25.092322+0000","last_active":"2024-09-16T15:38:27.302125+0000","last_peered":"2024-09-16T15:38:27.302125+0000","last_clean":"2024-09-16T15:38:27.302125+0000","last_became_active":"2024-09-16T15:38:25.091869+0000","last_became_peered":"2024-09-16T15:38:25.091869+0000","last_unstale":"2024-09-16T15:38:27.302125+0000","last_undegraded":"2024-09-16T15:38:27.302125+0000","last_fullsized":"2024-09-16T15:38:27.302125+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:17:40.527609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:26.082628+0000","last_change":"2024-09-16T15:38:25.095704+0000","last_active":"2024-09-16T15:38:26.082628+0000","last_peered":"2024-09-16T15:38:26.082628+0000","last_clean":"2024-09-16T15:38:26.082628+0000","last_became_active":"2024-09-16T15:38:25.095352+0000","last_became_peered":"2024-09-16T15:38:25.095352+0000","last_unstale":"2024-09-16T15:38:26.082628+0000","last_undegraded":"2024-09-16T15:38:26.082628+0000","last_fullsized":"2024-09-16T15:38:26.082628+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:03:22.510439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:26.655182+0000","last_change":"2024-09-16T15:38:25.089659+0000","last_active":"2024-09-16T15:38:26.655182+0000","last_peered":"2024-09-16T15:38:26.655182+0000","last_clean":"2024-09-16T15:38:26.655182+0000","last_became_active":"2024-09-16T15:38:25.089393+0000","last_became_peered":"2024-09-16T15:38:25.089393+0000","last_unstale":"2024-09-16T15:38:26.655182+0000","last_undegraded":"2024-09-16T15:38:26.655182+0000","last_fullsized":"2024-09-16T15:38:26.655182+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:37:11.268592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:26.083635+0000","last_change":"2024-09-16T15:38:25.081610+0000","last_active":"2024-09-16T15:38:26.083635+0000","last_peered":"2024-09-16T15:38:26.083635+0000","last_clean":"2024-09-16T15:38:26.083635+0000","last_became_active":"2024-09-16T15:38:25.081334+0000","last_became_peered":"2024-09-16T15:38:25.081334+0000","last_unstale":"2024-09-16T15:38:26.083635+0000","last_undegraded":"2024-09-16T15:38:26.083635+0000","last_fullsized":"2024-09-16T15:38:26.083635+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:21:16.692843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:27.301944+0000","last_change":"2024-09-16T15:38:25.089348+0000","last_active":"2024-09-16T15:38:27.301944+0000","last_peered":"2024-09-16T15:38:27.301944+0000","last_clean":"2024-09-16T15:38:27.301944+0000","last_became_active":"2024-09-16T15:38:25.089046+0000","last_became_peered":"2024-09-16T15:38:25.089046+0000","last_unstale":"2024-09-16T15:38:27.301944+0000","last_undegraded":"2024-09-16T15:38:27.301944+0000","last_fullsized":"2024-09-16T15:38:27.301944+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:50:10.827105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:27.301236+0000","last_change":"2024-09-16T15:38:25.088599+0000","last_active":"2024-09-16T15:38:27.301236+0000","last_peered":"2024-09-16T15:38:27.301236+0000","last_clean":"2024-09-16T15:38:27.301236+0000","last_became_active":"2024-09-16T15:38:25.088299+0000","last_became_peered":"2024-09-16T15:38:25.088299+0000","last_unstale":"2024-09-16T15:38:27.301236+0000","last_undegraded":"2024-09-16T15:38:27.301236+0000","last_fullsized":"2024-09-16T15:38:27.301236+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:26:03.896313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:27.300863+0000","last_change":"2024-09-16T15:38:25.093524+0000","last_active":"2024-09-16T15:38:27.300863+0000","last_peered":"2024-09-16T15:38:27.300863+0000","last_clean":"2024-09-16T15:38:27.300863+0000","last_became_active":"2024-09-16T15:38:25.093062+0000","last_became_peered":"2024-09-16T15:38:25.093062+0000","last_unstale":"2024-09-16T15:38:27.300863+0000","last_undegraded":"2024-09-16T15:38:27.300863+0000","last_fullsized":"2024-09-16T15:38:27.300863+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:36:05.496066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:26.082348+0000","last_change":"2024-09-16T15:38:25.089459+0000","last_active":"2024-09-16T15:38:26.082348+0000","last_peered":"2024-09-16T15:38:26.082348+0000","last_clean":"2024-09-16T15:38:26.082348+0000","last_became_active":"2024-09-16T15:38:25.089143+0000","last_became_peered":"2024-09-16T15:38:25.089143+0000","last_unstale":"2024-09-16T15:38:26.082348+0000","last_undegraded":"2024-09-16T15:38:26.082348+0000","last_fullsized":"2024-09-16T15:38:26.082348+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:10:50.135204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:26.084293+0000","last_change":"2024-09-16T15:38:25.088419+0000","last_active":"2024-09-16T15:38:26.084293+0000","last_peered":"2024-09-16T15:38:26.084293+0000","last_clean":"2024-09-16T15:38:26.084293+0000","last_became_active":"2024-09-16T15:38:25.088111+0000","last_became_peered":"2024-09-16T15:38:25.088111+0000","last_unstale":"2024-09-16T15:38:26.084293+0000","last_undegraded":"2024-09-16T15:38:26.084293+0000","last_fullsized":"2024-09-16T15:38:26.084293+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:33:45.236386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:26.084314+0000","last_change":"2024-09-16T15:38:25.094956+0000","last_active":"2024-09-16T15:38:26.084314+0000","last_peered":"2024-09-16T15:38:26.084314+0000","last_clean":"2024-09-16T15:38:26.084314+0000","last_became_active":"2024-09-16T15:38:25.094667+0000","last_became_peered":"2024-09-16T15:38:25.094667+0000","last_unstale":"2024-09-16T15:38:26.084314+0000","last_undegraded":"2024-09-16T15:38:26.084314+0000","last_fullsized":"2024-09-16T15:38:26.084314+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:14:35.125910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:26.084129+0000","last_change":"2024-09-16T15:38:25.091716+0000","last_active":"2024-09-16T15:38:26.084129+0000","last_peered":"2024-09-16T15:38:26.084129+0000","last_clean":"2024-09-16T15:38:26.084129+0000","last_became_active":"2024-09-16T15:38:25.091452+0000","last_became_peered":"2024-09-16T15:38:25.091452+0000","last_unstale":"2024-09-16T15:38:26.084129+0000","last_undegraded":"2024-09-16T15:38:26.084129+0000","last_fullsized":"2024-09-16T15:38:26.084129+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:12:59.070266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:27.301137+0000","last_change":"2024-09-16T15:38:25.079248+0000","last_active":"2024-09-16T15:38:27.301137+0000","last_peered":"2024-09-16T15:38:27.301137+0000","last_clean":"2024-09-16T15:38:27.301137+0000","last_became_active":"2024-09-16T15:38:25.078990+0000","last_became_peered":"2024-09-16T15:38:25.078990+0000","last_unstale":"2024-09-16T15:38:27.301137+0000","last_undegraded":"2024-09-16T15:38:27.301137+0000","last_fullsized":"2024-09-16T15:38:27.301137+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:01:02.015432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:27.048634+0000","last_change":"2024-09-16T15:38:25.091592+0000","last_active":"2024-09-16T15:38:27.048634+0000","last_peered":"2024-09-16T15:38:27.048634+0000","last_clean":"2024-09-16T15:38:27.048634+0000","last_became_active":"2024-09-16T15:38:25.091316+0000","last_became_peered":"2024-09-16T15:38:25.091316+0000","last_unstale":"2024-09-16T15:38:27.048634+0000","last_undegraded":"2024-09-16T15:38:27.048634+0000","last_fullsized":"2024-09-16T15:38:27.048634+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:28:52.274474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:26.083728+0000","last_change":"2024-09-16T15:38:25.086524+0000","last_active":"2024-09-16T15:38:26.083728+0000","last_peered":"2024-09-16T15:38:26.083728+0000","last_clean":"2024-09-16T15:38:26.083728+0000","last_became_active":"2024-09-16T15:38:25.084686+0000","last_became_peered":"2024-09-16T15:38:25.084686+0000","last_unstale":"2024-09-16T15:38:26.083728+0000","last_undegraded":"2024-09-16T15:38:26.083728+0000","last_fullsized":"2024-09-16T15:38:26.083728+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:29:31.900295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:27.048608+0000","last_change":"2024-09-16T15:38:25.095955+0000","last_active":"2024-09-16T15:38:27.048608+0000","last_peered":"2024-09-16T15:38:27.048608+0000","last_clean":"2024-09-16T15:38:27.048608+0000","last_became_active":"2024-09-16T15:38:25.095716+0000","last_became_peered":"2024-09-16T15:38:25.095716+0000","last_unstale":"2024-09-16T15:38:27.048608+0000","last_undegraded":"2024-09-16T15:38:27.048608+0000","last_fullsized":"2024-09-16T15:38:27.048608+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:44:58.250982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:27.302036+0000","last_change":"2024-09-16T15:38:25.097059+0000","last_active":"2024-09-16T15:38:27.302036+0000","last_peered":"2024-09-16T15:38:27.302036+0000","last_clean":"2024-09-16T15:38:27.302036+0000","last_became_active":"2024-09-16T15:38:25.096767+0000","last_became_peered":"2024-09-16T15:38:25.096767+0000","last_unstale":"2024-09-16T15:38:27.302036+0000","last_undegraded":"2024-09-16T15:38:27.302036+0000","last_fullsized":"2024-09-16T15:38:27.302036+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:21:36.047920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:27.302041+0000","last_change":"2024-09-16T15:38:25.083709+0000","last_active":"2024-09-16T15:38:27.302041+0000","last_peered":"2024-09-16T15:38:27.302041+0000","last_clean":"2024-09-16T15:38:27.302041+0000","last_became_active":"2024-09-16T15:38:25.083442+0000","last_became_peered":"2024-09-16T15:38:25.083442+0000","last_unstale":"2024-09-16T15:38:27.302041+0000","last_undegraded":"2024-09-16T15:38:27.302041+0000","last_fullsized":"2024-09-16T15:38:27.302041+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:56:08.212422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:26.090593+0000","last_change":"2024-09-16T15:38:25.091926+0000","last_active":"2024-09-16T15:38:26.090593+0000","last_peered":"2024-09-16T15:38:26.090593+0000","last_clean":"2024-09-16T15:38:26.090593+0000","last_became_active":"2024-09-16T15:38:25.091586+0000","last_became_peered":"2024-09-16T15:38:25.091586+0000","last_unstale":"2024-09-16T15:38:26.090593+0000","last_undegraded":"2024-09-16T15:38:26.090593+0000","last_fullsized":"2024-09-16T15:38:26.090593+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:26:03.896313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:27.049038+0000","last_change":"2024-09-16T15:38:25.081722+0000","last_active":"2024-09-16T15:38:27.049038+0000","last_peered":"2024-09-16T15:38:27.049038+0000","last_clean":"2024-09-16T15:38:27.049038+0000","last_became_active":"2024-09-16T15:38:25.081467+0000","last_became_peered":"2024-09-16T15:38:25.081467+0000","last_unstale":"2024-09-16T15:38:27.049038+0000","last_undegraded":"2024-09-16T15:38:27.049038+0000","last_fullsized":"2024-09-16T15:38:27.049038+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:17:40.527609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:27.300942+0000","last_change":"2024-09-16T15:38:25.081865+0000","last_active":"2024-09-16T15:38:27.300942+0000","last_peered":"2024-09-16T15:38:27.300942+0000","last_clean":"2024-09-16T15:38:27.300942+0000","last_became_active":"2024-09-16T15:38:25.081625+0000","last_became_peered":"2024-09-16T15:38:25.081625+0000","last_unstale":"2024-09-16T15:38:27.300942+0000","last_undegraded":"2024-09-16T15:38:27.300942+0000","last_fullsized":"2024-09-16T15:38:27.300942+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:22:10.059164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:27.300881+0000","last_change":"2024-09-16T15:38:25.087655+0000","last_active":"2024-09-16T15:38:27.300881+0000","last_peered":"2024-09-16T15:38:27.300881+0000","last_clean":"2024-09-16T15:38:27.300881+0000","last_became_active":"2024-09-16T15:38:25.087323+0000","last_became_peered":"2024-09-16T15:38:25.087323+0000","last_unstale":"2024-09-16T15:38:27.300881+0000","last_undegraded":"2024-09-16T15:38:27.300881+0000","last_fullsized":"2024-09-16T15:38:27.300881+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:49:11.318028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:27.048625+0000","last_change":"2024-09-16T15:38:25.095125+0000","last_active":"2024-09-16T15:38:27.048625+0000","last_peered":"2024-09-16T15:38:27.048625+0000","last_clean":"2024-09-16T15:38:27.048625+0000","last_became_active":"2024-09-16T15:38:25.094779+0000","last_became_peered":"2024-09-16T15:38:25.094779+0000","last_unstale":"2024-09-16T15:38:27.048625+0000","last_undegraded":"2024-09-16T15:38:27.048625+0000","last_fullsized":"2024-09-16T15:38:27.048625+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:36:05.496066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:26.082103+0000","last_change":"2024-09-16T15:38:25.096691+0000","last_active":"2024-09-16T15:38:26.082103+0000","last_peered":"2024-09-16T15:38:26.082103+0000","last_clean":"2024-09-16T15:38:26.082103+0000","last_became_active":"2024-09-16T15:38:25.096334+0000","last_became_peered":"2024-09-16T15:38:25.096334+0000","last_unstale":"2024-09-16T15:38:26.082103+0000","last_undegraded":"2024-09-16T15:38:26.082103+0000","last_fullsized":"2024-09-16T15:38:26.082103+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:22:12.871616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:26.084265+0000","last_change":"2024-09-16T15:38:25.098781+0000","last_active":"2024-09-16T15:38:26.084265+0000","last_peered":"2024-09-16T15:38:26.084265+0000","last_clean":"2024-09-16T15:38:26.084265+0000","last_became_active":"2024-09-16T15:38:25.098502+0000","last_became_peered":"2024-09-16T15:38:25.098502+0000","last_unstale":"2024-09-16T15:38:26.084265+0000","last_undegraded":"2024-09-16T15:38:26.084265+0000","last_fullsized":"2024-09-16T15:38:26.084265+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:28:29.645680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:26.082309+0000","last_change":"2024-09-16T15:38:24.074512+0000","last_active":"2024-09-16T15:38:26.082309+0000","last_peered":"2024-09-16T15:38:26.082309+0000","last_clean":"2024-09-16T15:38:26.082309+0000","last_became_active":"2024-09-16T15:38:24.074254+0000","last_became_peered":"2024-09-16T15:38:24.074254+0000","last_unstale":"2024-09-16T15:38:26.082309+0000","last_undegraded":"2024-09-16T15:38:26.082309+0000","last_fullsized":"2024-09-16T15:38:26.082309+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:01:01.011168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:27.049122+0000","last_change":"2024-09-16T15:38:25.080967+0000","last_active":"2024-09-16T15:38:27.049122+0000","last_peered":"2024-09-16T15:38:27.049122+0000","last_clean":"2024-09-16T15:38:27.049122+0000","last_became_active":"2024-09-16T15:38:25.080702+0000","last_became_peered":"2024-09-16T15:38:25.080702+0000","last_unstale":"2024-09-16T15:38:27.049122+0000","last_undegraded":"2024-09-16T15:38:27.049122+0000","last_fullsized":"2024-09-16T15:38:27.049122+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:56:08.212422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:27.302153+0000","last_change":"2024-09-16T15:38:24.076035+0000","last_active":"2024-09-16T15:38:27.302153+0000","last_peered":"2024-09-16T15:38:27.302153+0000","last_clean":"2024-09-16T15:38:27.302153+0000","last_became_active":"2024-09-16T15:38:24.075582+0000","last_became_peered":"2024-09-16T15:38:24.075582+0000","last_unstale":"2024-09-16T15:38:27.302153+0000","last_undegraded":"2024-09-16T15:38:27.302153+0000","last_fullsized":"2024-09-16T15:38:27.302153+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:21:11.273497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:27.048994+0000","last_change":"2024-09-16T15:38:25.096975+0000","last_active":"2024-09-16T15:38:27.048994+0000","last_peered":"2024-09-16T15:38:27.048994+0000","last_clean":"2024-09-16T15:38:27.048994+0000","last_became_active":"2024-09-16T15:38:25.096738+0000","last_became_peered":"2024-09-16T15:38:25.096738+0000","last_unstale":"2024-09-16T15:38:27.048994+0000","last_undegraded":"2024-09-16T15:38:27.048994+0000","last_fullsized":"2024-09-16T15:38:27.048994+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:01:02.015432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:26.084634+0000","last_change":"2024-09-16T15:38:24.077182+0000","last_active":"2024-09-16T15:38:26.084634+0000","last_peered":"2024-09-16T15:38:26.084634+0000","last_clean":"2024-09-16T15:38:26.084634+0000","last_became_active":"2024-09-16T15:38:24.076916+0000","last_became_peered":"2024-09-16T15:38:24.076916+0000","last_unstale":"2024-09-16T15:38:26.084634+0000","last_undegraded":"2024-09-16T15:38:26.084634+0000","last_fullsized":"2024-09-16T15:38:26.084634+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:08.859595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:27.302258+0000","last_change":"2024-09-16T15:38:25.086269+0000","last_active":"2024-09-16T15:38:27.302258+0000","last_peered":"2024-09-16T15:38:27.302258+0000","last_clean":"2024-09-16T15:38:27.302258+0000","last_became_active":"2024-09-16T15:38:25.085310+0000","last_became_peered":"2024-09-16T15:38:25.085310+0000","last_unstale":"2024-09-16T15:38:27.302258+0000","last_undegraded":"2024-09-16T15:38:27.302258+0000","last_fullsized":"2024-09-16T15:38:27.302258+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:53:03.411460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:27.302045+0000","last_change":"2024-09-16T15:38:24.071484+0000","last_active":"2024-09-16T15:38:27.302045+0000","last_peered":"2024-09-16T15:38:27.302045+0000","last_clean":"2024-09-16T15:38:27.302045+0000","last_became_active":"2024-09-16T15:38:24.071192+0000","last_became_peered":"2024-09-16T15:38:24.071192+0000","last_unstale":"2024-09-16T15:38:27.302045+0000","last_undegraded":"2024-09-16T15:38:27.302045+0000","last_fullsized":"2024-09-16T15:38:27.302045+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:37:48.735556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:26.655151+0000","last_change":"2024-09-16T15:38:25.090737+0000","last_active":"2024-09-16T15:38:26.655151+0000","last_peered":"2024-09-16T15:38:26.655151+0000","last_clean":"2024-09-16T15:38:26.655151+0000","last_became_active":"2024-09-16T15:38:25.090456+0000","last_became_peered":"2024-09-16T15:38:25.090456+0000","last_unstale":"2024-09-16T15:38:26.655151+0000","last_undegraded":"2024-09-16T15:38:26.655151+0000","last_fullsized":"2024-09-16T15:38:26.655151+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:06:12.328604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:27.048536+0000","last_change":"2024-09-16T15:38:24.076015+0000","last_active":"2024-09-16T15:38:27.048536+0000","last_peered":"2024-09-16T15:38:27.048536+0000","last_clean":"2024-09-16T15:38:27.048536+0000","last_became_active":"2024-09-16T15:38:24.075684+0000","last_became_peered":"2024-09-16T15:38:24.075684+0000","last_unstale":"2024-09-16T15:38:27.048536+0000","last_undegraded":"2024-09-16T15:38:27.048536+0000","last_fullsized":"2024-09-16T15:38:27.048536+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:46:52.689141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:27.048689+0000","last_change":"2024-09-16T15:38:25.094619+0000","last_active":"2024-09-16T15:38:27.048689+0000","last_peered":"2024-09-16T15:38:27.048689+0000","last_clean":"2024-09-16T15:38:27.048689+0000","last_became_active":"2024-09-16T15:38:25.094329+0000","last_became_peered":"2024-09-16T15:38:25.094329+0000","last_unstale":"2024-09-16T15:38:27.048689+0000","last_undegraded":"2024-09-16T15:38:27.048689+0000","last_fullsized":"2024-09-16T15:38:27.048689+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:56:03.529864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:27.048515+0000","last_change":"2024-09-16T15:38:24.078421+0000","last_active":"2024-09-16T15:38:27.048515+0000","last_peered":"2024-09-16T15:38:27.048515+0000","last_clean":"2024-09-16T15:38:27.048515+0000","last_became_active":"2024-09-16T15:38:24.078162+0000","last_became_peered":"2024-09-16T15:38:24.078162+0000","last_unstale":"2024-09-16T15:38:27.048515+0000","last_undegraded":"2024-09-16T15:38:27.048515+0000","last_fullsized":"2024-09-16T15:38:27.048515+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T21:47:04.574701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:26.655250+0000","last_change":"2024-09-16T15:38:25.091933+0000","last_active":"2024-09-16T15:38:26.655250+0000","last_peered":"2024-09-16T15:38:26.655250+0000","last_clean":"2024-09-16T15:38:26.655250+0000","last_became_active":"2024-09-16T15:38:25.091677+0000","last_became_peered":"2024-09-16T15:38:25.091677+0000","last_unstale":"2024-09-16T15:38:26.655250+0000","last_undegraded":"2024-09-16T15:38:26.655250+0000","last_fullsized":"2024-09-16T15:38:26.655250+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:03:59.509454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:26.083562+0000","last_change":"2024-09-16T15:38:24.074662+0000","last_active":"2024-09-16T15:38:26.083562+0000","last_peered":"2024-09-16T15:38:26.083562+0000","last_clean":"2024-09-16T15:38:26.083562+0000","last_became_active":"2024-09-16T15:38:24.074386+0000","last_became_peered":"2024-09-16T15:38:24.074386+0000","last_unstale":"2024-09-16T15:38:26.083562+0000","last_undegraded":"2024-09-16T15:38:26.083562+0000","last_fullsized":"2024-09-16T15:38:26.083562+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:33:22.057306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:27.301584+0000","last_change":"2024-09-16T15:38:25.084723+0000","last_active":"2024-09-16T15:38:27.301584+0000","last_peered":"2024-09-16T15:38:27.301584+0000","last_clean":"2024-09-16T15:38:27.301584+0000","last_became_active":"2024-09-16T15:38:25.084460+0000","last_became_peered":"2024-09-16T15:38:25.084460+0000","last_unstale":"2024-09-16T15:38:27.301584+0000","last_undegraded":"2024-09-16T15:38:27.301584+0000","last_fullsized":"2024-09-16T15:38:27.301584+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:22:10.059164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:27.048742+0000","last_change":"2024-09-16T15:38:24.071420+0000","last_active":"2024-09-16T15:38:27.048742+0000","last_peered":"2024-09-16T15:38:27.048742+0000","last_clean":"2024-09-16T15:38:27.048742+0000","last_became_active":"2024-09-16T15:38:24.071135+0000","last_became_peered":"2024-09-16T15:38:24.071135+0000","last_unstale":"2024-09-16T15:38:27.048742+0000","last_undegraded":"2024-09-16T15:38:27.048742+0000","last_fullsized":"2024-09-16T15:38:27.048742+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:33:44.232122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:26.082315+0000","last_change":"2024-09-16T15:38:25.089766+0000","last_active":"2024-09-16T15:38:26.082315+0000","last_peered":"2024-09-16T15:38:26.082315+0000","last_clean":"2024-09-16T15:38:26.082315+0000","last_became_active":"2024-09-16T15:38:25.088905+0000","last_became_peered":"2024-09-16T15:38:25.088905+0000","last_unstale":"2024-09-16T15:38:26.082315+0000","last_undegraded":"2024-09-16T15:38:26.082315+0000","last_fullsized":"2024-09-16T15:38:26.082315+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T23:33:21.710066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:26.090636+0000","last_change":"2024-09-16T15:38:24.077560+0000","last_active":"2024-09-16T15:38:26.090636+0000","last_peered":"2024-09-16T15:38:26.090636+0000","last_clean":"2024-09-16T15:38:26.090636+0000","last_became_active":"2024-09-16T15:38:24.077286+0000","last_became_peered":"2024-09-16T15:38:24.077286+0000","last_unstale":"2024-09-16T15:38:26.090636+0000","last_undegraded":"2024-09-16T15:38:26.090636+0000","last_fullsized":"2024-09-16T15:38:26.090636+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:59:27.211425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:27.302236+0000","last_change":"2024-09-16T15:38:25.084903+0000","last_active":"2024-09-16T15:38:27.302236+0000","last_peered":"2024-09-16T15:38:27.302236+0000","last_clean":"2024-09-16T15:38:27.302236+0000","last_became_active":"2024-09-16T15:38:25.084548+0000","last_became_peered":"2024-09-16T15:38:25.084548+0000","last_unstale":"2024-09-16T15:38:27.302236+0000","last_undegraded":"2024-09-16T15:38:27.302236+0000","last_fullsized":"2024-09-16T15:38:27.302236+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:08:13.237534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:26.090472+0000","last_change":"2024-09-16T15:38:24.076125+0000","last_active":"2024-09-16T15:38:26.090472+0000","last_peered":"2024-09-16T15:38:26.090472+0000","last_clean":"2024-09-16T15:38:26.090472+0000","last_became_active":"2024-09-16T15:38:24.075882+0000","last_became_peered":"2024-09-16T15:38:24.075882+0000","last_unstale":"2024-09-16T15:38:26.090472+0000","last_undegraded":"2024-09-16T15:38:26.090472+0000","last_fullsized":"2024-09-16T15:38:26.090472+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:33:45.557074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:27.302160+0000","last_change":"2024-09-16T15:38:25.089053+0000","last_active":"2024-09-16T15:38:27.302160+0000","last_peered":"2024-09-16T15:38:27.302160+0000","last_clean":"2024-09-16T15:38:27.302160+0000","last_became_active":"2024-09-16T15:38:25.088761+0000","last_became_peered":"2024-09-16T15:38:25.088761+0000","last_unstale":"2024-09-16T15:38:27.302160+0000","last_undegraded":"2024-09-16T15:38:27.302160+0000","last_fullsized":"2024-09-16T15:38:27.302160+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:17:12.373545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:26.082386+0000","last_change":"2024-09-16T15:38:24.074445+0000","last_active":"2024-09-16T15:38:26.082386+0000","last_peered":"2024-09-16T15:38:26.082386+0000","last_clean":"2024-09-16T15:38:26.082386+0000","last_became_active":"2024-09-16T15:38:24.074166+0000","last_became_peered":"2024-09-16T15:38:24.074166+0000","last_unstale":"2024-09-16T15:38:26.082386+0000","last_undegraded":"2024-09-16T15:38:26.082386+0000","last_fullsized":"2024-09-16T15:38:26.082386+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:00:26.977255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:26.082429+0000","last_change":"2024-09-16T15:38:25.095064+0000","last_active":"2024-09-16T15:38:26.082429+0000","last_peered":"2024-09-16T15:38:26.082429+0000","last_clean":"2024-09-16T15:38:26.082429+0000","last_became_active":"2024-09-16T15:38:25.094802+0000","last_became_peered":"2024-09-16T15:38:25.094802+0000","last_unstale":"2024-09-16T15:38:26.082429+0000","last_undegraded":"2024-09-16T15:38:26.082429+0000","last_fullsized":"2024-09-16T15:38:26.082429+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:56:36.995228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:26.084231+0000","last_change":"2024-09-16T15:38:24.070463+0000","last_active":"2024-09-16T15:38:26.084231+0000","last_peered":"2024-09-16T15:38:26.084231+0000","last_clean":"2024-09-16T15:38:26.084231+0000","last_became_active":"2024-09-16T15:38:24.070192+0000","last_became_peered":"2024-09-16T15:38:24.070192+0000","last_unstale":"2024-09-16T15:38:26.084231+0000","last_undegraded":"2024-09-16T15:38:26.084231+0000","last_fullsized":"2024-09-16T15:38:26.084231+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:41:52.194650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:26.083546+0000","last_change":"2024-09-16T15:38:25.086423+0000","last_active":"2024-09-16T15:38:26.083546+0000","last_peered":"2024-09-16T15:38:26.083546+0000","last_clean":"2024-09-16T15:38:26.083546+0000","last_became_active":"2024-09-16T15:38:25.086150+0000","last_became_peered":"2024-09-16T15:38:25.086150+0000","last_unstale":"2024-09-16T15:38:26.083546+0000","last_undegraded":"2024-09-16T15:38:26.083546+0000","last_fullsized":"2024-09-16T15:38:26.083546+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:47:05.942838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:27.048754+0000","last_change":"2024-09-16T15:38:24.082654+0000","last_active":"2024-09-16T15:38:27.048754+0000","last_peered":"2024-09-16T15:38:27.048754+0000","last_clean":"2024-09-16T15:38:27.048754+0000","last_became_active":"2024-09-16T15:38:24.082277+0000","last_became_peered":"2024-09-16T15:38:24.082277+0000","last_unstale":"2024-09-16T15:38:27.048754+0000","last_undegraded":"2024-09-16T15:38:27.048754+0000","last_fullsized":"2024-09-16T15:38:27.048754+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:29:03.503451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:27.302221+0000","last_change":"2024-09-16T15:38:25.086732+0000","last_active":"2024-09-16T15:38:27.302221+0000","last_peered":"2024-09-16T15:38:27.302221+0000","last_clean":"2024-09-16T15:38:27.302221+0000","last_became_active":"2024-09-16T15:38:25.085772+0000","last_became_peered":"2024-09-16T15:38:25.085772+0000","last_unstale":"2024-09-16T15:38:27.302221+0000","last_undegraded":"2024-09-16T15:38:27.302221+0000","last_fullsized":"2024-09-16T15:38:27.302221+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:31:20.228650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:27.301585+0000","last_change":"2024-09-16T15:38:24.076885+0000","last_active":"2024-09-16T15:38:27.301585+0000","last_peered":"2024-09-16T15:38:27.301585+0000","last_clean":"2024-09-16T15:38:27.301585+0000","last_became_active":"2024-09-16T15:38:24.076610+0000","last_became_peered":"2024-09-16T15:38:24.076610+0000","last_unstale":"2024-09-16T15:38:27.301585+0000","last_undegraded":"2024-09-16T15:38:27.301585+0000","last_fullsized":"2024-09-16T15:38:27.301585+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:05:34.305692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:27.048918+0000","last_change":"2024-09-16T15:38:25.083511+0000","last_active":"2024-09-16T15:38:27.048918+0000","last_peered":"2024-09-16T15:38:27.048918+0000","last_clean":"2024-09-16T15:38:27.048918+0000","last_became_active":"2024-09-16T15:38:25.083223+0000","last_became_peered":"2024-09-16T15:38:25.083223+0000","last_unstale":"2024-09-16T15:38:27.048918+0000","last_undegraded":"2024-09-16T15:38:27.048918+0000","last_fullsized":"2024-09-16T15:38:27.048918+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:37:46.120478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:27.301302+0000","last_change":"2024-09-16T15:38:24.077093+0000","last_active":"2024-09-16T15:38:27.301302+0000","last_peered":"2024-09-16T15:38:27.301302+0000","last_clean":"2024-09-16T15:38:27.301302+0000","last_became_active":"2024-09-16T15:38:24.076824+0000","last_became_peered":"2024-09-16T15:38:24.076824+0000","last_unstale":"2024-09-16T15:38:27.301302+0000","last_undegraded":"2024-09-16T15:38:27.301302+0000","last_fullsized":"2024-09-16T15:38:27.301302+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:14:34.121646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:26.082143+0000","last_change":"2024-09-16T15:38:25.090325+0000","last_active":"2024-09-16T15:38:26.082143+0000","last_peered":"2024-09-16T15:38:26.082143+0000","last_clean":"2024-09-16T15:38:26.082143+0000","last_became_active":"2024-09-16T15:38:25.090030+0000","last_became_peered":"2024-09-16T15:38:25.090030+0000","last_unstale":"2024-09-16T15:38:26.082143+0000","last_undegraded":"2024-09-16T15:38:26.082143+0000","last_fullsized":"2024-09-16T15:38:26.082143+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:44:40.401568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:26.083955+0000","last_change":"2024-09-16T15:38:24.082319+0000","last_active":"2024-09-16T15:38:26.083955+0000","last_peered":"2024-09-16T15:38:26.083955+0000","last_clean":"2024-09-16T15:38:26.083955+0000","last_became_active":"2024-09-16T15:38:24.082055+0000","last_became_peered":"2024-09-16T15:38:24.082055+0000","last_unstale":"2024-09-16T15:38:26.083955+0000","last_undegraded":"2024-09-16T15:38:26.083955+0000","last_fullsized":"2024-09-16T15:38:26.083955+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:35:11.695593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:26.082323+0000","last_change":"2024-09-16T15:38:25.095350+0000","last_active":"2024-09-16T15:38:26.082323+0000","last_peered":"2024-09-16T15:38:26.082323+0000","last_clean":"2024-09-16T15:38:26.082323+0000","last_became_active":"2024-09-16T15:38:25.094224+0000","last_became_peered":"2024-09-16T15:38:25.094224+0000","last_unstale":"2024-09-16T15:38:26.082323+0000","last_undegraded":"2024-09-16T15:38:26.082323+0000","last_fullsized":"2024-09-16T15:38:26.082323+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:58:07.412542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:26.084051+0000","last_change":"2024-09-16T15:38:24.072787+0000","last_active":"2024-09-16T15:38:26.084051+0000","last_peered":"2024-09-16T15:38:26.084051+0000","last_clean":"2024-09-16T15:38:26.084051+0000","last_became_active":"2024-09-16T15:38:24.072501+0000","last_became_peered":"2024-09-16T15:38:24.072501+0000","last_unstale":"2024-09-16T15:38:26.084051+0000","last_undegraded":"2024-09-16T15:38:26.084051+0000","last_fullsized":"2024-09-16T15:38:26.084051+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:20:36.680430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:26.655298+0000","last_change":"2024-09-16T15:38:25.093250+0000","last_active":"2024-09-16T15:38:26.655298+0000","last_peered":"2024-09-16T15:38:26.655298+0000","last_clean":"2024-09-16T15:38:26.655298+0000","last_became_active":"2024-09-16T15:38:25.092971+0000","last_became_peered":"2024-09-16T15:38:25.092971+0000","last_unstale":"2024-09-16T15:38:26.655298+0000","last_undegraded":"2024-09-16T15:38:26.655298+0000","last_fullsized":"2024-09-16T15:38:26.655298+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T23:22:18.078078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:27.048750+0000","last_change":"2024-09-16T15:38:24.082337+0000","last_active":"2024-09-16T15:38:27.048750+0000","last_peered":"2024-09-16T15:38:27.048750+0000","last_clean":"2024-09-16T15:38:27.048750+0000","last_became_active":"2024-09-16T15:38:24.081933+0000","last_became_peered":"2024-09-16T15:38:24.081933+0000","last_unstale":"2024-09-16T15:38:27.048750+0000","last_undegraded":"2024-09-16T15:38:27.048750+0000","last_fullsized":"2024-09-16T15:38:27.048750+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:06:11.324339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:26.090589+0000","last_change":"2024-09-16T15:38:25.091727+0000","last_active":"2024-09-16T15:38:26.090589+0000","last_peered":"2024-09-16T15:38:26.090589+0000","last_clean":"2024-09-16T15:38:26.090589+0000","last_became_active":"2024-09-16T15:38:25.091023+0000","last_became_peered":"2024-09-16T15:38:25.091023+0000","last_unstale":"2024-09-16T15:38:26.090589+0000","last_undegraded":"2024-09-16T15:38:26.090589+0000","last_fullsized":"2024-09-16T15:38:26.090589+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:01:02.015432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:26.082504+0000","last_change":"2024-09-16T15:38:24.075353+0000","last_active":"2024-09-16T15:38:26.082504+0000","last_peered":"2024-09-16T15:38:26.082504+0000","last_clean":"2024-09-16T15:38:26.082504+0000","last_became_active":"2024-09-16T15:38:24.075111+0000","last_became_peered":"2024-09-16T15:38:24.075111+0000","last_unstale":"2024-09-16T15:38:26.082504+0000","last_undegraded":"2024-09-16T15:38:26.082504+0000","last_fullsized":"2024-09-16T15:38:26.082504+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:17:39.523344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:26.084531+0000","last_change":"2024-09-16T15:38:25.094246+0000","last_active":"2024-09-16T15:38:26.084531+0000","last_peered":"2024-09-16T15:38:26.084531+0000","last_clean":"2024-09-16T15:38:26.084531+0000","last_became_active":"2024-09-16T15:38:25.093941+0000","last_became_peered":"2024-09-16T15:38:25.093941+0000","last_unstale":"2024-09-16T15:38:26.084531+0000","last_undegraded":"2024-09-16T15:38:26.084531+0000","last_fullsized":"2024-09-16T15:38:26.084531+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:05:35.309957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:27.301091+0000","last_change":"2024-09-16T15:38:24.076881+0000","last_active":"2024-09-16T15:38:27.301091+0000","last_peered":"2024-09-16T15:38:27.301091+0000","last_clean":"2024-09-16T15:38:27.301091+0000","last_became_active":"2024-09-16T15:38:24.076651+0000","last_became_peered":"2024-09-16T15:38:24.076651+0000","last_unstale":"2024-09-16T15:38:27.301091+0000","last_undegraded":"2024-09-16T15:38:27.301091+0000","last_fullsized":"2024-09-16T15:38:27.301091+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:03:25.931197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:26.083693+0000","last_change":"2024-09-16T15:38:25.089843+0000","last_active":"2024-09-16T15:38:26.083693+0000","last_peered":"2024-09-16T15:38:26.083693+0000","last_clean":"2024-09-16T15:38:26.083693+0000","last_became_active":"2024-09-16T15:38:25.089381+0000","last_became_peered":"2024-09-16T15:38:25.089381+0000","last_unstale":"2024-09-16T15:38:26.083693+0000","last_undegraded":"2024-09-16T15:38:26.083693+0000","last_fullsized":"2024-09-16T15:38:26.083693+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T23:03:36.157931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:26.090605+0000","last_change":"2024-09-16T15:38:24.074346+0000","last_active":"2024-09-16T15:38:26.090605+0000","last_peered":"2024-09-16T15:38:26.090605+0000","last_clean":"2024-09-16T15:38:26.090605+0000","last_became_active":"2024-09-16T15:38:24.074119+0000","last_became_peered":"2024-09-16T15:38:24.074119+0000","last_unstale":"2024-09-16T15:38:26.090605+0000","last_undegraded":"2024-09-16T15:38:26.090605+0000","last_fullsized":"2024-09-16T15:38:26.090605+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:15:07.855095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:26.090507+0000","last_change":"2024-09-16T15:38:25.091446+0000","last_active":"2024-09-16T15:38:26.090507+0000","last_peered":"2024-09-16T15:38:26.090507+0000","last_clean":"2024-09-16T15:38:26.090507+0000","last_became_active":"2024-09-16T15:38:25.091144+0000","last_became_peered":"2024-09-16T15:38:25.091144+0000","last_unstale":"2024-09-16T15:38:26.090507+0000","last_undegraded":"2024-09-16T15:38:26.090507+0000","last_fullsized":"2024-09-16T15:38:26.090507+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:00:27.981519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:27.048703+0000","last_change":"2024-09-16T15:38:24.077339+0000","last_active":"2024-09-16T15:38:27.048703+0000","last_peered":"2024-09-16T15:38:27.048703+0000","last_clean":"2024-09-16T15:38:27.048703+0000","last_became_active":"2024-09-16T15:38:24.076874+0000","last_became_peered":"2024-09-16T15:38:24.076874+0000","last_unstale":"2024-09-16T15:38:27.048703+0000","last_undegraded":"2024-09-16T15:38:27.048703+0000","last_fullsized":"2024-09-16T15:38:27.048703+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:09:49.025232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:26.083674+0000","last_change":"2024-09-16T15:38:25.087283+0000","last_active":"2024-09-16T15:38:26.083674+0000","last_peered":"2024-09-16T15:38:26.083674+0000","last_clean":"2024-09-16T15:38:26.083674+0000","last_became_active":"2024-09-16T15:38:25.087060+0000","last_became_peered":"2024-09-16T15:38:25.087060+0000","last_unstale":"2024-09-16T15:38:26.083674+0000","last_undegraded":"2024-09-16T15:38:26.083674+0000","last_fullsized":"2024-09-16T15:38:26.083674+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:30:36.134629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:26.655035+0000","last_change":"2024-09-16T15:38:24.077488+0000","last_active":"2024-09-16T15:38:26.655035+0000","last_peered":"2024-09-16T15:38:26.655035+0000","last_clean":"2024-09-16T15:38:26.655035+0000","last_became_active":"2024-09-16T15:38:24.077201+0000","last_became_peered":"2024-09-16T15:38:24.077201+0000","last_unstale":"2024-09-16T15:38:26.655035+0000","last_undegraded":"2024-09-16T15:38:26.655035+0000","last_fullsized":"2024-09-16T15:38:26.655035+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:07:58.668701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:26.655163+0000","last_change":"2024-09-16T15:38:25.092728+0000","last_active":"2024-09-16T15:38:26.655163+0000","last_peered":"2024-09-16T15:38:26.655163+0000","last_clean":"2024-09-16T15:38:26.655163+0000","last_became_active":"2024-09-16T15:38:25.092453+0000","last_became_peered":"2024-09-16T15:38:25.092453+0000","last_unstale":"2024-09-16T15:38:26.655163+0000","last_undegraded":"2024-09-16T15:38:26.655163+0000","last_fullsized":"2024-09-16T15:38:26.655163+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T23:33:55.577072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:26.082069+0000","last_change":"2024-09-16T15:38:24.075428+0000","last_active":"2024-09-16T15:38:26.082069+0000","last_peered":"2024-09-16T15:38:26.082069+0000","last_clean":"2024-09-16T15:38:26.082069+0000","last_became_active":"2024-09-16T15:38:24.075151+0000","last_became_peered":"2024-09-16T15:38:24.075151+0000","last_unstale":"2024-09-16T15:38:26.082069+0000","last_undegraded":"2024-09-16T15:38:26.082069+0000","last_fullsized":"2024-09-16T15:38:26.082069+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:37:45.116214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:26.084030+0000","last_change":"2024-09-16T15:38:25.094152+0000","last_active":"2024-09-16T15:38:26.084030+0000","last_peered":"2024-09-16T15:38:26.084030+0000","last_clean":"2024-09-16T15:38:26.084030+0000","last_became_active":"2024-09-16T15:38:25.093867+0000","last_became_peered":"2024-09-16T15:38:25.093867+0000","last_unstale":"2024-09-16T15:38:26.084030+0000","last_undegraded":"2024-09-16T15:38:26.084030+0000","last_fullsized":"2024-09-16T15:38:26.084030+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:09:50.029497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:26.083983+0000","last_change":"2024-09-16T15:38:24.076858+0000","last_active":"2024-09-16T15:38:26.083983+0000","last_peered":"2024-09-16T15:38:26.083983+0000","last_clean":"2024-09-16T15:38:26.083983+0000","last_became_active":"2024-09-16T15:38:24.076591+0000","last_became_peered":"2024-09-16T15:38:24.076591+0000","last_unstale":"2024-09-16T15:38:26.083983+0000","last_undegraded":"2024-09-16T15:38:26.083983+0000","last_fullsized":"2024-09-16T15:38:26.083983+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:47:03.377191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:26.082253+0000","last_change":"2024-09-16T15:38:25.091578+0000","last_active":"2024-09-16T15:38:26.082253+0000","last_peered":"2024-09-16T15:38:26.082253+0000","last_clean":"2024-09-16T15:38:26.082253+0000","last_became_active":"2024-09-16T15:38:25.091328+0000","last_became_peered":"2024-09-16T15:38:25.091328+0000","last_unstale":"2024-09-16T15:38:26.082253+0000","last_undegraded":"2024-09-16T15:38:26.082253+0000","last_fullsized":"2024-09-16T15:38:26.082253+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:10:27.570816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"34'1","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:26.090657+0000","last_change":"2024-09-16T15:38:24.075459+0000","last_active":"2024-09-16T15:38:26.090657+0000","last_peered":"2024-09-16T15:38:26.090657+0000","last_clean":"2024-09-16T15:38:26.090657+0000","last_became_active":"2024-09-16T15:38:24.075199+0000","last_became_peered":"2024-09-16T15:38:24.075199+0000","last_unstale":"2024-09-16T15:38:26.090657+0000","last_undegraded":"2024-09-16T15:38:26.090657+0000","last_fullsized":"2024-09-16T15:38:26.090657+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:47:06.550703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:26.084721+0000","last_change":"2024-09-16T15:38:25.094002+0000","last_active":"2024-09-16T15:38:26.084721+0000","last_peered":"2024-09-16T15:38:26.084721+0000","last_clean":"2024-09-16T15:38:26.084721+0000","last_became_active":"2024-09-16T15:38:25.093499+0000","last_became_peered":"2024-09-16T15:38:25.093499+0000","last_unstale":"2024-09-16T15:38:26.084721+0000","last_undegraded":"2024-09-16T15:38:26.084721+0000","last_fullsized":"2024-09-16T15:38:26.084721+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:37:49.739821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:26.084357+0000","last_change":"2024-09-16T15:38:24.072331+0000","last_active":"2024-09-16T15:38:26.084357+0000","last_peered":"2024-09-16T15:38:26.084357+0000","last_clean":"2024-09-16T15:38:26.084357+0000","last_became_active":"2024-09-16T15:38:24.071959+0000","last_became_peered":"2024-09-16T15:38:24.071959+0000","last_unstale":"2024-09-16T15:38:26.084357+0000","last_undegraded":"2024-09-16T15:38:26.084357+0000","last_fullsized":"2024-09-16T15:38:26.084357+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:30:09.123984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:27.300934+0000","last_change":"2024-09-16T15:38:25.091773+0000","last_active":"2024-09-16T15:38:27.300934+0000","last_peered":"2024-09-16T15:38:27.300934+0000","last_clean":"2024-09-16T15:38:27.300934+0000","last_became_active":"2024-09-16T15:38:25.091515+0000","last_became_peered":"2024-09-16T15:38:25.091515+0000","last_unstale":"2024-09-16T15:38:27.300934+0000","last_undegraded":"2024-09-16T15:38:27.300934+0000","last_fullsized":"2024-09-16T15:38:27.300934+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:56:03.529864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:26.083749+0000","last_change":"2024-09-16T15:38:24.076097+0000","last_active":"2024-09-16T15:38:26.083749+0000","last_peered":"2024-09-16T15:38:26.083749+0000","last_clean":"2024-09-16T15:38:26.083749+0000","last_became_active":"2024-09-16T15:38:24.075851+0000","last_became_peered":"2024-09-16T15:38:24.075851+0000","last_unstale":"2024-09-16T15:38:26.083749+0000","last_undegraded":"2024-09-16T15:38:26.083749+0000","last_fullsized":"2024-09-16T15:38:26.083749+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T21:07:59.238679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:27.302165+0000","last_change":"2024-09-16T15:38:25.085745+0000","last_active":"2024-09-16T15:38:27.302165+0000","last_peered":"2024-09-16T15:38:27.302165+0000","last_clean":"2024-09-16T15:38:27.302165+0000","last_became_active":"2024-09-16T15:38:25.085462+0000","last_became_peered":"2024-09-16T15:38:25.085462+0000","last_unstale":"2024-09-16T15:38:27.302165+0000","last_undegraded":"2024-09-16T15:38:27.302165+0000","last_fullsized":"2024-09-16T15:38:27.302165+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T23:22:36.728269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:26.083815+0000","last_change":"2024-09-16T15:38:24.073845+0000","last_active":"2024-09-16T15:38:26.083815+0000","last_peered":"2024-09-16T15:38:26.083815+0000","last_clean":"2024-09-16T15:38:26.083815+0000","last_became_active":"2024-09-16T15:38:24.073602+0000","last_became_peered":"2024-09-16T15:38:24.073602+0000","last_unstale":"2024-09-16T15:38:26.083815+0000","last_undegraded":"2024-09-16T15:38:26.083815+0000","last_fullsized":"2024-09-16T15:38:26.083815+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:33:40.349674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:27.301697+0000","last_change":"2024-09-16T15:38:25.096299+0000","last_active":"2024-09-16T15:38:27.301697+0000","last_peered":"2024-09-16T15:38:27.301697+0000","last_clean":"2024-09-16T15:38:27.301697+0000","last_became_active":"2024-09-16T15:38:25.096028+0000","last_became_peered":"2024-09-16T15:38:25.096028+0000","last_unstale":"2024-09-16T15:38:27.301697+0000","last_undegraded":"2024-09-16T15:38:27.301697+0000","last_fullsized":"2024-09-16T15:38:27.301697+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T23:18:13.792238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:27.048732+0000","last_change":"2024-09-16T15:38:24.082593+0000","last_active":"2024-09-16T15:38:27.048732+0000","last_peered":"2024-09-16T15:38:27.048732+0000","last_clean":"2024-09-16T15:38:27.048732+0000","last_became_active":"2024-09-16T15:38:24.082320+0000","last_became_peered":"2024-09-16T15:38:24.082320+0000","last_unstale":"2024-09-16T15:38:27.048732+0000","last_undegraded":"2024-09-16T15:38:27.048732+0000","last_fullsized":"2024-09-16T15:38:27.048732+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:14:34.121646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:26.082217+0000","last_change":"2024-09-16T15:38:25.095598+0000","last_active":"2024-09-16T15:38:26.082217+0000","last_peered":"2024-09-16T15:38:26.082217+0000","last_clean":"2024-09-16T15:38:26.082217+0000","last_became_active":"2024-09-16T15:38:25.094255+0000","last_became_peered":"2024-09-16T15:38:25.094255+0000","last_unstale":"2024-09-16T15:38:26.082217+0000","last_undegraded":"2024-09-16T15:38:26.082217+0000","last_fullsized":"2024-09-16T15:38:26.082217+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:01:00.079446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:27.301508+0000","last_change":"2024-09-16T15:38:24.075973+0000","last_active":"2024-09-16T15:38:27.301508+0000","last_peered":"2024-09-16T15:38:27.301508+0000","last_clean":"2024-09-16T15:38:27.301508+0000","last_became_active":"2024-09-16T15:38:24.075643+0000","last_became_peered":"2024-09-16T15:38:24.075643+0000","last_unstale":"2024-09-16T15:38:27.301508+0000","last_undegraded":"2024-09-16T15:38:27.301508+0000","last_fullsized":"2024-09-16T15:38:27.301508+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T23:53:59.111637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:27.301059+0000","last_change":"2024-09-16T15:38:25.091834+0000","last_active":"2024-09-16T15:38:27.301059+0000","last_peered":"2024-09-16T15:38:27.301059+0000","last_clean":"2024-09-16T15:38:27.301059+0000","last_became_active":"2024-09-16T15:38:25.091540+0000","last_became_peered":"2024-09-16T15:38:25.091540+0000","last_unstale":"2024-09-16T15:38:27.301059+0000","last_undegraded":"2024-09-16T15:38:27.301059+0000","last_fullsized":"2024-09-16T15:38:27.301059+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:24.054567+0000","last_clean_scrub_stamp":"2024-09-16T15:38:24.054567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:37:46.120478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:26.082593+0000","last_change":"2024-09-16T15:38:24.075360+0000","last_active":"2024-09-16T15:38:26.082593+0000","last_peered":"2024-09-16T15:38:26.082593+0000","last_clean":"2024-09-16T15:38:26.082593+0000","last_became_active":"2024-09-16T15:38:24.075069+0000","last_became_peered":"2024-09-16T15:38:24.075069+0000","last_unstale":"2024-09-16T15:38:26.082593+0000","last_undegraded":"2024-09-16T15:38:26.082593+0000","last_fullsized":"2024-09-16T15:38:26.082593+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:38:23.050302+0000","last_clean_scrub_stamp":"2024-09-16T15:38:23.050302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:26:02.892048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":131,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-16T15:38:26.654961+0000","last_change":"2024-09-16T15:37:37.258601+0000","last_active":"2024-09-16T15:38:26.654961+0000","last_peered":"2024-09-16T15:38:26.654961+0000","last_clean":"2024-09-16T15:38:26.654961+0000","last_became_active":"2024-09-16T15:37:37.257584+0000","last_became_peered":"2024-09-16T15:37:37.257584+0000","last_unstale":"2024-09-16T15:38:26.654961+0000","last_undegraded":"2024-09-16T15:38:26.654961+0000","last_fullsized":"2024-09-16T15:38:26.654961+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:35.447043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:35.447043+0000","last_clean_scrub_stamp":"2024-09-16T15:37:35.447043+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:43:17.464894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509455,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":144457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509455,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":974848,"data_stored":735385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509456,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":393216,"data_stored":146069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509456,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":393216,"data_stored":145211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509455,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":144469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509456,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":974848,"data_stored":734873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509454,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":144525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":389120,"data_stored":146047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T15:38:32.868 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-16T15:38:32.868 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-16T15:38:33.015 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.013+0000 7f340ea71640 1 -- 172.21.15.98:0/4026208075 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33f4004800 msgr2=0x7f33f4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:33.015 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.013+0000 7f340ea71640 1 --2- 172.21.15.98:0/4026208075 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33f4004800 0x7f33f4004c80 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f34080b5010 tx=0x7f33f4005830 comp rx=0 tx=0).stop 2024-09-16T15:38:33.015 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.014+0000 7f340ea71640 1 -- 172.21.15.98:0/4026208075 shutdown_connections 2024-09-16T15:38:33.015 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.014+0000 7f340ea71640 1 --2- 172.21.15.98:0/4026208075 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33f4004800 0x7f33f4004c80 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:33.015 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.014+0000 7f340ea71640 1 -- 172.21.15.98:0/4026208075 >> 172.21.15.98:0/4026208075 conn(0x7f34080b1840 msgr2=0x7f34080b1c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:33.015 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.014+0000 7f340ea71640 1 -- 172.21.15.98:0/4026208075 shutdown_connections 2024-09-16T15:38:33.015 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.014+0000 7f340ea71640 1 -- 172.21.15.98:0/4026208075 wait complete. 2024-09-16T15:38:33.016 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.015+0000 7f340ea71640 1 Processor -- start 2024-09-16T15:38:33.016 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.015+0000 7f340ea71640 1 -- start start 2024-09-16T15:38:33.018 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.016+0000 7f340ea71640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33f4004800 0x7f340813b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:33.018 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.016+0000 7f340ea71640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f34081e8b20 0x7f34081e8f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:33.019 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.016+0000 7f340ea71640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f340806f940 0x7f340806fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:33.019 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.016+0000 7f340ea71640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f34080cf130 con 0x7f33f4004800 2024-09-16T15:38:33.019 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.016+0000 7f340ea71640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f34080cefb0 con 0x7f34081e8b20 2024-09-16T15:38:33.019 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.016+0000 7f340ea71640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f340815e980 con 0x7f340806f940 2024-09-16T15:38:33.019 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.016+0000 7f340c80d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33f4004800 0x7f340813b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:33.019 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.016+0000 7f340c80d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33f4004800 0x7f340813b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40838/0 (socket says 172.21.15.98:40838) 2024-09-16T15:38:33.019 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.016+0000 7f340c80d640 1 -- 172.21.15.98:0/3532469631 learned_addr learned my addr 172.21.15.98:0/3532469631 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:33.019 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.016+0000 7f340d00e640 1 --2- 172.21.15.98:0/3532469631 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f340806f940 0x7f340806fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:33.019 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.016+0000 7f3407fff640 1 --2- 172.21.15.98:0/3532469631 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f34081e8b20 0x7f34081e8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:33.019 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.016+0000 7f340c80d640 1 -- 172.21.15.98:0/3532469631 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f340806f940 msgr2=0x7f340806fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:33.020 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.016+0000 7f340c80d640 1 --2- 172.21.15.98:0/3532469631 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f340806f940 0x7f340806fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:33.020 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.016+0000 7f340c80d640 1 -- 172.21.15.98:0/3532469631 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f34081e8b20 msgr2=0x7f34081e8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:33.020 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.016+0000 7f340c80d640 1 --2- 172.21.15.98:0/3532469631 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f34081e8b20 0x7f34081e8f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:33.020 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.016+0000 7f340c80d640 1 -- 172.21.15.98:0/3532469631 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34081f5060 con 0x7f33f4004800 2024-09-16T15:38:33.020 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.016+0000 7f340c80d640 1 --2- 172.21.15.98:0/3532469631 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33f4004800 0x7f340813b040 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f33f80060e0 tx=0x7f33f80065a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:33.020 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.016+0000 7f34057fa640 1 -- 172.21.15.98:0/3532469631 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f8015070 con 0x7f33f4004800 2024-09-16T15:38:33.020 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.016+0000 7f34057fa640 1 -- 172.21.15.98:0/3532469631 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f33f800fb30 con 0x7f33f4004800 2024-09-16T15:38:33.020 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.016+0000 7f340ea71640 1 -- 172.21.15.98:0/3532469631 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34081f5340 con 0x7f33f4004800 2024-09-16T15:38:33.020 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.016+0000 7f34057fa640 1 -- 172.21.15.98:0/3532469631 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f8011430 con 0x7f33f4004800 2024-09-16T15:38:33.020 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.016+0000 7f340ea71640 1 -- 172.21.15.98:0/3532469631 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34081f5900 con 0x7f33f4004800 2024-09-16T15:38:33.020 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.017+0000 7f340ea71640 1 -- 172.21.15.98:0/3532469631 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34081e94c0 con 0x7f33f4004800 2024-09-16T15:38:33.021 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.018+0000 7f34057fa640 1 -- 172.21.15.98:0/3532469631 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7f33f80115d0 con 0x7f33f4004800 2024-09-16T15:38:33.021 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.018+0000 7f34057fa640 1 --2- 172.21.15.98:0/3532469631 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f33e8078850 0x7f33e807ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:33.021 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.018+0000 7f34057fa640 1 -- 172.21.15.98:0/3532469631 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f33f809b7d0 con 0x7f33f4004800 2024-09-16T15:38:33.021 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.019+0000 7f3407fff640 1 --2- 172.21.15.98:0/3532469631 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f33e8078850 0x7f33e807ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:33.021 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.019+0000 7f3407fff640 1 --2- 172.21.15.98:0/3532469631 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f33e8078850 0x7f33e807ad10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f33f0036000 tx=0x7f33f00046c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:33.023 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.023+0000 7f34057fa640 1 -- 172.21.15.98:0/3532469631 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7f33f8063ed0 con 0x7f33f4004800 2024-09-16T15:38:33.271 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.270+0000 7f340ea71640 1 -- 172.21.15.98:0/3532469631 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f340815f3e0 con 0x7f33f4004800 2024-09-16T15:38:33.273 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.272+0000 7f34057fa640 1 -- 172.21.15.98:0/3532469631 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) ==== 190+0+147 (secure 0 0 0) 0x7f33f80637d0 con 0x7f33f4004800 2024-09-16T15:38:33.273 INFO:teuthology.orchestra.run.smithi098.stdout:[client.0] 2024-09-16T15:38:33.273 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQCNUOhm6+4tFBAAxdHfj+ZVPqgZXxWTlCBNMg== 2024-09-16T15:38:33.273 INFO:teuthology.orchestra.run.smithi098.stdout: caps mds = "allow" 2024-09-16T15:38:33.273 INFO:teuthology.orchestra.run.smithi098.stdout: caps mon = "allow r" 2024-09-16T15:38:33.273 INFO:teuthology.orchestra.run.smithi098.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-16T15:38:33.274 INFO:teuthology.orchestra.run.smithi098.stderr:updated caps for client.0 2024-09-16T15:38:33.275 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.274+0000 7f340ea71640 1 -- 172.21.15.98:0/3532469631 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f33e8078850 msgr2=0x7f33e807ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:33.275 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.274+0000 7f340ea71640 1 --2- 172.21.15.98:0/3532469631 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f33e8078850 0x7f33e807ad10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f33f0036000 tx=0x7f33f00046c0 comp rx=0 tx=0).stop 2024-09-16T15:38:33.275 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.274+0000 7f340ea71640 1 -- 172.21.15.98:0/3532469631 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33f4004800 msgr2=0x7f340813b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:33.275 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.274+0000 7f340ea71640 1 --2- 172.21.15.98:0/3532469631 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33f4004800 0x7f340813b040 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f33f80060e0 tx=0x7f33f80065a0 comp rx=0 tx=0).stop 2024-09-16T15:38:33.275 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.274+0000 7f340ea71640 1 -- 172.21.15.98:0/3532469631 shutdown_connections 2024-09-16T15:38:33.276 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.274+0000 7f340ea71640 1 --2- 172.21.15.98:0/3532469631 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f340806f940 0x7f340806fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:33.276 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.274+0000 7f340ea71640 1 --2- 172.21.15.98:0/3532469631 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f33e8078850 0x7f33e807ad10 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:33.276 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.274+0000 7f340ea71640 1 --2- 172.21.15.98:0/3532469631 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f34081e8b20 0x7f34081e8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:33.276 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.274+0000 7f340ea71640 1 --2- 172.21.15.98:0/3532469631 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33f4004800 0x7f340813b040 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:33.276 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.274+0000 7f340ea71640 1 -- 172.21.15.98:0/3532469631 >> 172.21.15.98:0/3532469631 conn(0x7f34080b1840 msgr2=0x7f340815d3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:33.276 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.274+0000 7f340ea71640 1 -- 172.21.15.98:0/3532469631 shutdown_connections 2024-09-16T15:38:33.276 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.274+0000 7f340ea71640 1 -- 172.21.15.98:0/3532469631 wait complete. 2024-09-16T15:38:33.287 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T15:38:33.387 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.386+0000 7f3f65552640 1 -- 172.21.15.98:0/4017086302 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f6015e0d0 msgr2=0x7f3f600d09c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:33.387 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.386+0000 7f3f65552640 1 --2- 172.21.15.98:0/4017086302 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f6015e0d0 0x7f3f600d09c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f3f50005fd0 tx=0x7f3f5002aa90 comp rx=0 tx=0).stop 2024-09-16T15:38:33.387 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.386+0000 7f3f65552640 1 -- 172.21.15.98:0/4017086302 shutdown_connections 2024-09-16T15:38:33.387 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.386+0000 7f3f65552640 1 --2- 172.21.15.98:0/4017086302 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3f600d1610 0x7f3f600cecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:33.387 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.386+0000 7f3f65552640 1 --2- 172.21.15.98:0/4017086302 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f6015e0d0 0x7f3f600d09c0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:33.387 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.386+0000 7f3f65552640 1 -- 172.21.15.98:0/4017086302 >> 172.21.15.98:0/4017086302 conn(0x7f3f600d3fe0 msgr2=0x7f3f600d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:33.388 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.386+0000 7f3f65552640 1 -- 172.21.15.98:0/4017086302 shutdown_connections 2024-09-16T15:38:33.388 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.386+0000 7f3f65552640 1 -- 172.21.15.98:0/4017086302 wait complete. 2024-09-16T15:38:33.388 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.387+0000 7f3f65552640 1 Processor -- start 2024-09-16T15:38:33.388 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.387+0000 7f3f65552640 1 -- start start 2024-09-16T15:38:33.390 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.388+0000 7f3f65552640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3f600d1610 0x7f3f600b0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:33.390 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.388+0000 7f3f65552640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f600d2050 0x7f3f6014a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:33.391 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.388+0000 7f3f65552640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3f6015e0d0 0x7f3f600b9410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:33.391 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.388+0000 7f3f65552640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3f600cf5d0 con 0x7f3f600d2050 2024-09-16T15:38:33.391 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.388+0000 7f3f65552640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3f600cf450 con 0x7f3f600d1610 2024-09-16T15:38:33.391 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.388+0000 7f3f65552640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f3f600cf750 con 0x7f3f6015e0d0 2024-09-16T15:38:33.391 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.388+0000 7f3f5e7fc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f600d2050 0x7f3f6014a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:33.391 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.388+0000 7f3f5e7fc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f600d2050 0x7f3f6014a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40854/0 (socket says 172.21.15.98:40854) 2024-09-16T15:38:33.391 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.388+0000 7f3f5e7fc640 1 -- 172.21.15.98:0/3093881160 learned_addr learned my addr 172.21.15.98:0/3093881160 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:33.391 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.388+0000 7f3f5f7fe640 1 --2- 172.21.15.98:0/3093881160 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3f6015e0d0 0x7f3f600b9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:33.391 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.388+0000 7f3f5effd640 1 --2- 172.21.15.98:0/3093881160 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3f600d1610 0x7f3f600b0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:33.391 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.388+0000 7f3f5e7fc640 1 -- 172.21.15.98:0/3093881160 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3f6015e0d0 msgr2=0x7f3f600b9410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:33.391 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.388+0000 7f3f5e7fc640 1 --2- 172.21.15.98:0/3093881160 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3f6015e0d0 0x7f3f600b9410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:33.391 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.388+0000 7f3f5e7fc640 1 -- 172.21.15.98:0/3093881160 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3f600d1610 msgr2=0x7f3f600b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:33.392 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.388+0000 7f3f5e7fc640 1 --2- 172.21.15.98:0/3093881160 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3f600d1610 0x7f3f600b0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:33.392 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.388+0000 7f3f5e7fc640 1 -- 172.21.15.98:0/3093881160 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f600cc7b0 con 0x7f3f600d2050 2024-09-16T15:38:33.392 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.388+0000 7f3f5effd640 1 --2- 172.21.15.98:0/3093881160 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3f600d1610 0x7f3f600b0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T15:38:33.392 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.388+0000 7f3f5e7fc640 1 --2- 172.21.15.98:0/3093881160 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f600d2050 0x7f3f6014a600 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3f5400c500 tx=0x7f3f5400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:33.392 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.389+0000 7f3f477fe640 1 -- 172.21.15.98:0/3093881160 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f540052d0 con 0x7f3f600d2050 2024-09-16T15:38:33.392 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.389+0000 7f3f477fe640 1 -- 172.21.15.98:0/3093881160 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3f54005470 con 0x7f3f600d2050 2024-09-16T15:38:33.392 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.389+0000 7f3f65552640 1 -- 172.21.15.98:0/3093881160 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f600cca90 con 0x7f3f600d2050 2024-09-16T15:38:33.392 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.389+0000 7f3f477fe640 1 -- 172.21.15.98:0/3093881160 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f54012870 con 0x7f3f600d2050 2024-09-16T15:38:33.392 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.389+0000 7f3f65552640 1 -- 172.21.15.98:0/3093881160 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f600cd050 con 0x7f3f600d2050 2024-09-16T15:38:33.392 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.390+0000 7f3f65552640 1 -- 172.21.15.98:0/3093881160 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f600cd250 con 0x7f3f600d2050 2024-09-16T15:38:33.393 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.390+0000 7f3f477fe640 1 -- 172.21.15.98:0/3093881160 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7f3f540035f0 con 0x7f3f600d2050 2024-09-16T15:38:33.393 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.391+0000 7f3f477fe640 1 --2- 172.21.15.98:0/3093881160 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f3f4c078880 0x7f3f4c07ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:33.393 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.391+0000 7f3f477fe640 1 -- 172.21.15.98:0/3093881160 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f3f5409a380 con 0x7f3f600d2050 2024-09-16T15:38:33.393 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.391+0000 7f3f5effd640 1 --2- 172.21.15.98:0/3093881160 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f3f4c078880 0x7f3f4c07ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:33.393 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.391+0000 7f3f5effd640 1 --2- 172.21.15.98:0/3093881160 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f3f4c078880 0x7f3f4c07ad40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3f50035000 tx=0x7f3f50038040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:33.396 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.395+0000 7f3f477fe640 1 -- 172.21.15.98:0/3093881160 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7f3f600cd250 con 0x7f3f600d2050 2024-09-16T15:38:33.606 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.606+0000 7f3f65552640 1 -- 172.21.15.98:0/3093881160 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3f600d3650 con 0x7f3f600d2050 2024-09-16T15:38:33.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.606+0000 7f3f477fe640 1 -- 172.21.15.98:0/3093881160 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5229 (secure 0 0 0) 0x7f3f54062a00 con 0x7f3f600d2050 2024-09-16T15:38:33.607 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:38:33.608 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":15,"btime":"2024-09-16T15:38:27:185206+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4804,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/1917138590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":1917138590},{"type":"v1","addr":"172.21.15.135:6836","nonce":1917138590}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4807,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2813663234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2813663234},{"type":"v1","addr":"172.21.15.135:6837","nonce":2813663234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4848,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6834/2449820374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":2449820374},{"type":"v1","addr":"172.21.15.98:6834","nonce":2449820374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T15:38:24.409442+0000","modified":"2024-09-16T15:38:26.524070+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4851},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4851":{"gid":4851,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.98:6835/1806390493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6833","nonce":1806390493},{"type":"v1","addr":"172.21.15.98:6835","nonce":1806390493}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4851,"qdb_cluster":[4851]},"id":2}]} 2024-09-16T15:38:33.608 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 15 2024-09-16T15:38:33.609 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.608+0000 7f3f65552640 1 -- 172.21.15.98:0/3093881160 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f3f4c078880 msgr2=0x7f3f4c07ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:33.609 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.608+0000 7f3f65552640 1 --2- 172.21.15.98:0/3093881160 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f3f4c078880 0x7f3f4c07ad40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3f50035000 tx=0x7f3f50038040 comp rx=0 tx=0).stop 2024-09-16T15:38:33.610 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.608+0000 7f3f65552640 1 -- 172.21.15.98:0/3093881160 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f600d2050 msgr2=0x7f3f6014a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:33.610 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.608+0000 7f3f65552640 1 --2- 172.21.15.98:0/3093881160 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f600d2050 0x7f3f6014a600 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3f5400c500 tx=0x7f3f5400c9c0 comp rx=0 tx=0).stop 2024-09-16T15:38:33.610 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.608+0000 7f3f65552640 1 -- 172.21.15.98:0/3093881160 shutdown_connections 2024-09-16T15:38:33.610 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.608+0000 7f3f65552640 1 --2- 172.21.15.98:0/3093881160 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3f6015e0d0 0x7f3f600b9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:33.610 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.608+0000 7f3f65552640 1 --2- 172.21.15.98:0/3093881160 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f600d2050 0x7f3f6014a600 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:33.610 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.608+0000 7f3f65552640 1 --2- 172.21.15.98:0/3093881160 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f3f4c078880 0x7f3f4c07ad40 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:33.610 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.608+0000 7f3f65552640 1 --2- 172.21.15.98:0/3093881160 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3f600d1610 0x7f3f600b0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:33.610 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.608+0000 7f3f65552640 1 -- 172.21.15.98:0/3093881160 >> 172.21.15.98:0/3093881160 conn(0x7f3f600d3fe0 msgr2=0x7f3f6006ea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:33.610 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.608+0000 7f3f65552640 1 -- 172.21.15.98:0/3093881160 shutdown_connections 2024-09-16T15:38:33.610 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:33.608+0000 7f3f65552640 1 -- 172.21.15.98:0/3093881160 wait complete. 2024-09-16T15:38:34.023 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-16T15:38:24.409442+0000', 'modified': '2024-09-16T15:38:26.524070+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4851}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4851': {'gid': 4851, 'name': 'a', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.98:6835/1806390493', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6833', 'nonce': 1806390493}, {'type': 'v1', 'addr': '172.21.15.98:6835', 'nonce': 1806390493}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4851, 'qdb_cluster': [4851]} 2024-09-16T15:38:34.023 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-16T15:38:34.024 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-16T15:38:34.129 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.128+0000 7f7e03ce2640 1 -- 172.21.15.98:0/591026941 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7dfc15f220 msgr2=0x7f7dfc0cfc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:34.129 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.128+0000 7f7e03ce2640 1 --2- 172.21.15.98:0/591026941 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7dfc15f220 0x7f7dfc0cfc40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7df8005fd0 tx=0x7f7df802a5d0 comp rx=0 tx=0).stop 2024-09-16T15:38:34.129 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.128+0000 7f7e03ce2640 1 -- 172.21.15.98:0/591026941 shutdown_connections 2024-09-16T15:38:34.129 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.128+0000 7f7e03ce2640 1 --2- 172.21.15.98:0/591026941 >> v2:172.21.15.135:3300/0 conn(0x7f7dfc0cd8a0 0x7f7dfc0cdce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:34.129 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.128+0000 7f7e03ce2640 1 --2- 172.21.15.98:0/591026941 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7dfc15f220 0x7f7dfc0cfc40 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:34.129 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.128+0000 7f7e03ce2640 1 -- 172.21.15.98:0/591026941 >> 172.21.15.98:0/591026941 conn(0x7f7dfc0b2b90 msgr2=0x7f7dfc0b2f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:34.129 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.128+0000 7f7e03ce2640 1 -- 172.21.15.98:0/591026941 shutdown_connections 2024-09-16T15:38:34.130 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.128+0000 7f7e03ce2640 1 -- 172.21.15.98:0/591026941 wait complete. 2024-09-16T15:38:34.130 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.129+0000 7f7e03ce2640 1 Processor -- start 2024-09-16T15:38:34.130 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.129+0000 7f7e03ce2640 1 -- start start 2024-09-16T15:38:34.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.130+0000 7f7e03ce2640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7dfc0cd8a0 0x7f7dfc06cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:34.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.130+0000 7f7e03ce2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7dfc15b0c0 0x7f7dfc155780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:34.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.130+0000 7f7e03ce2640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7dfc15f220 0x7f7dfc155cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:34.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.130+0000 7f7e03ce2640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7dfc0708c0 con 0x7f7dfc15f220 2024-09-16T15:38:34.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.130+0000 7f7e03ce2640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7dfc070740 con 0x7f7dfc15b0c0 2024-09-16T15:38:34.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.130+0000 7f7e03ce2640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f7dfc070a40 con 0x7f7dfc0cd8a0 2024-09-16T15:38:34.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.130+0000 7f7e01a7e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7dfc0cd8a0 0x7f7dfc06cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:34.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.130+0000 7f7e0227f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7dfc15f220 0x7f7dfc155cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:34.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.130+0000 7f7e01a7e640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7dfc0cd8a0 0x7f7dfc06cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3301/0 says I am v2:172.21.15.98:50876/0 (socket says 172.21.15.98:50876) 2024-09-16T15:38:34.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.130+0000 7f7e01a7e640 1 -- 172.21.15.98:0/3860810523 learned_addr learned my addr 172.21.15.98:0/3860810523 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:34.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.130+0000 7f7e0127d640 1 --2- 172.21.15.98:0/3860810523 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7dfc15b0c0 0x7f7dfc155780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:34.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.130+0000 7f7e0227f640 1 -- 172.21.15.98:0/3860810523 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7dfc0cd8a0 msgr2=0x7f7dfc06cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:34.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.130+0000 7f7e0227f640 1 --2- 172.21.15.98:0/3860810523 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7dfc0cd8a0 0x7f7dfc06cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:34.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.130+0000 7f7e0227f640 1 -- 172.21.15.98:0/3860810523 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7dfc15b0c0 msgr2=0x7f7dfc155780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:34.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.130+0000 7f7e0227f640 1 --2- 172.21.15.98:0/3860810523 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7dfc15b0c0 0x7f7dfc155780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:34.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.130+0000 7f7e0227f640 1 -- 172.21.15.98:0/3860810523 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dfc144740 con 0x7f7dfc15f220 2024-09-16T15:38:34.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.130+0000 7f7e0227f640 1 --2- 172.21.15.98:0/3860810523 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7dfc15f220 0x7f7dfc155cc0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f7df4002230 tx=0x7f7df400cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:34.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.131+0000 7f7df27fc640 1 -- 172.21.15.98:0/3860810523 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df4003b90 con 0x7f7dfc15f220 2024-09-16T15:38:34.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.131+0000 7f7df27fc640 1 -- 172.21.15.98:0/3860810523 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7df4003d50 con 0x7f7dfc15f220 2024-09-16T15:38:34.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.131+0000 7f7e03ce2640 1 -- 172.21.15.98:0/3860810523 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dfc144a20 con 0x7f7dfc15f220 2024-09-16T15:38:34.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.131+0000 7f7df27fc640 1 -- 172.21.15.98:0/3860810523 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df4005330 con 0x7f7dfc15f220 2024-09-16T15:38:34.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.131+0000 7f7e03ce2640 1 -- 172.21.15.98:0/3860810523 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dfc144fe0 con 0x7f7dfc15f220 2024-09-16T15:38:34.134 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.132+0000 7f7df27fc640 1 -- 172.21.15.98:0/3860810523 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7f7df40056e0 con 0x7f7dfc15f220 2024-09-16T15:38:34.135 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.133+0000 7f7df27fc640 1 --2- 172.21.15.98:0/3860810523 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f7de0078850 0x7f7de007ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:34.135 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.133+0000 7f7df27fc640 1 -- 172.21.15.98:0/3860810523 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f7df409a750 con 0x7f7dfc15f220 2024-09-16T15:38:34.135 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.133+0000 7f7e01a7e640 1 --2- 172.21.15.98:0/3860810523 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f7de0078850 0x7f7de007ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:34.135 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.134+0000 7f7e01a7e640 1 --2- 172.21.15.98:0/3860810523 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f7de0078850 0x7f7de007ad10 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7df8009230 tx=0x7f7df8004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:34.135 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.134+0000 7f7e06ab2740 1 Processor -- start 2024-09-16T15:38:34.135 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.134+0000 7f7e06ab2740 1 -- start start 2024-09-16T15:38:34.138 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.134+0000 7f7e06ab2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562ee35a81b0 0x562ee357fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:34.138 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.134+0000 7f7e06ab2740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562ee35c7df0 0x562ee35c81f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:34.138 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.134+0000 7f7e06ab2740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ee357d5f0 0x562ee357da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:34.138 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.134+0000 7f7e06ab2740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x562ee34f4820 con 0x562ee357d5f0 2024-09-16T15:38:34.138 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.134+0000 7f7e06ab2740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x562ee34e3c50 con 0x562ee35a81b0 2024-09-16T15:38:34.138 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.134+0000 7f7e06ab2740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x562ee34e7a60 con 0x562ee35c7df0 2024-09-16T15:38:34.138 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.135+0000 7f7e0227f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ee357d5f0 0x562ee357da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:34.138 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.135+0000 7f7e0227f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ee357d5f0 0x562ee357da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40878/0 (socket says 172.21.15.98:40878) 2024-09-16T15:38:34.138 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.135+0000 7f7e01a7e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562ee35a81b0 0x562ee357fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:34.138 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.135+0000 7f7e0227f640 1 -- 172.21.15.98:0/2481928842 learned_addr learned my addr 172.21.15.98:0/2481928842 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:34.139 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.135+0000 7f7e0127d640 1 --2- 172.21.15.98:0/2481928842 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562ee35c7df0 0x562ee35c81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:34.139 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.135+0000 7f7e0227f640 1 -- 172.21.15.98:0/2481928842 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562ee35c7df0 msgr2=0x562ee35c81f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T15:38:34.139 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.135+0000 7f7e0227f640 1 --2- 172.21.15.98:0/2481928842 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562ee35c7df0 0x562ee35c81f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:34.139 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.135+0000 7f7e0227f640 1 -- 172.21.15.98:0/2481928842 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562ee35a81b0 msgr2=0x562ee357fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T15:38:34.139 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.135+0000 7f7e0227f640 1 --2- 172.21.15.98:0/2481928842 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562ee35a81b0 0x562ee357fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:34.139 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.135+0000 7f7e0227f640 1 -- 172.21.15.98:0/2481928842 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ee3245850 con 0x562ee357d5f0 2024-09-16T15:38:34.139 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.135+0000 7f7e0227f640 1 --2- 172.21.15.98:0/2481928842 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ee357d5f0 0x562ee357da40 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f7df4098d30 tx=0x7f7df4062150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bef7ed3212141f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:34.139 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.135+0000 7f7ddf7fe640 1 -- 172.21.15.98:0/2481928842 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df4062780 con 0x562ee357d5f0 2024-09-16T15:38:34.139 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.135+0000 7f7ddf7fe640 1 -- 172.21.15.98:0/2481928842 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7df40671b0 con 0x562ee357d5f0 2024-09-16T15:38:34.139 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.135+0000 7f7ddf7fe640 1 -- 172.21.15.98:0/2481928842 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df4069640 con 0x562ee357d5f0 2024-09-16T15:38:34.139 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.136+0000 7f7e06ab2740 1 -- 172.21.15.98:0/2481928842 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ee357d5f0 msgr2=0x562ee357da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:34.139 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.136+0000 7f7e06ab2740 1 --2- 172.21.15.98:0/2481928842 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ee357d5f0 0x562ee357da40 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f7df4098d30 tx=0x7f7df4062150 comp rx=0 tx=0).stop 2024-09-16T15:38:34.139 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.136+0000 7f7e06ab2740 1 -- 172.21.15.98:0/2481928842 shutdown_connections 2024-09-16T15:38:34.139 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.136+0000 7f7e06ab2740 1 --2- 172.21.15.98:0/2481928842 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ee357d5f0 0x562ee357da40 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:34.140 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.136+0000 7f7e06ab2740 1 --2- 172.21.15.98:0/2481928842 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562ee35c7df0 0x562ee35c81f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:34.140 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.136+0000 7f7e06ab2740 1 --2- 172.21.15.98:0/2481928842 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562ee35a81b0 0x562ee357fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:34.140 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.136+0000 7f7e06ab2740 1 -- 172.21.15.98:0/2481928842 >> 172.21.15.98:0/2481928842 conn(0x562ee357e6a0 msgr2=0x562ee35820c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:34.140 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.136+0000 7f7e06ab2740 1 -- 172.21.15.98:0/2481928842 shutdown_connections 2024-09-16T15:38:34.140 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.136+0000 7f7e06ab2740 1 -- 172.21.15.98:0/2481928842 wait complete. 2024-09-16T15:38:34.140 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.136+0000 7f7e06ab2740 1 -- start start 2024-09-16T15:38:34.140 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.137+0000 7f7e06ab2740 1 Processor -- start 2024-09-16T15:38:34.143 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.137+0000 7f7e06ab2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562ee35a81b0 0x562ee35a13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:34.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.137+0000 7f7e06ab2740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ee35c7df0 0x562ee35c0790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:34.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.137+0000 7f7e06ab2740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562ee35a0470 0x562ee35aa700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:34.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.137+0000 7f7e06ab2740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x562ee3254620 con 0x562ee35c7df0 2024-09-16T15:38:34.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.137+0000 7f7e06ab2740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x562ee34895f0 con 0x562ee35a81b0 2024-09-16T15:38:34.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.137+0000 7f7e06ab2740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x562ee357cb30 con 0x562ee35a0470 2024-09-16T15:38:34.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.137+0000 7f7e06ab2740 10 client.0 _ll_register_callbacks cb 0x562ee348d0a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T15:38:34.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.138+0000 7f7e0127d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ee35c7df0 0x562ee35c0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:34.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.138+0000 7f7e0127d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ee35c7df0 0x562ee35c0790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40882/0 (socket says 172.21.15.98:40882) 2024-09-16T15:38:34.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.138+0000 7f7e0127d640 1 -- 172.21.15.98:0/2175180115 learned_addr learned my addr 172.21.15.98:0/2175180115 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:34.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.138+0000 7f7e01a7e640 1 --2- 172.21.15.98:0/2175180115 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562ee35a81b0 0x562ee35a13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:34.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.138+0000 7f7e0227f640 1 --2- 172.21.15.98:0/2175180115 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562ee35a0470 0x562ee35aa700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:34.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.138+0000 7f7e0127d640 1 -- 172.21.15.98:0/2175180115 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562ee35a0470 msgr2=0x562ee35aa700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T15:38:34.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.138+0000 7f7e0127d640 1 --2- 172.21.15.98:0/2175180115 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562ee35a0470 0x562ee35aa700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:34.145 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.138+0000 7f7e0127d640 1 -- 172.21.15.98:0/2175180115 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562ee35a81b0 msgr2=0x562ee35a13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T15:38:34.145 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.138+0000 7f7e0127d640 1 --2- 172.21.15.98:0/2175180115 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562ee35a81b0 0x562ee35a13f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:34.145 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.138+0000 7f7e0127d640 1 -- 172.21.15.98:0/2175180115 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ee32bc6b0 con 0x562ee35c7df0 2024-09-16T15:38:34.145 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.138+0000 7f7e0127d640 1 --2- 172.21.15.98:0/2175180115 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ee35c7df0 0x562ee35c0790 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f7dec012720 tx=0x7f7dec012be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b97a4c04b24353e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:34.145 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.138+0000 7f7ddcff9640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-16T15:38:34.145 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.138+0000 7f7ddcff9640 1 -- 172.21.15.98:0/2175180115 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dec00f920 con 0x562ee35c7df0 2024-09-16T15:38:34.145 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.138+0000 7f7ddcff9640 1 -- 172.21.15.98:0/2175180115 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f7dec01db20 con 0x562ee35c7df0 2024-09-16T15:38:34.145 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.138+0000 7f7e06ab2740 1 -- 172.21.15.98:0/2175180115 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7df40671b0 con 0x562ee35c7df0 2024-09-16T15:38:34.145 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.138+0000 7f7ddcff9640 1 -- 172.21.15.98:0/2175180115 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f7dec01dd60 con 0x562ee35c7df0 2024-09-16T15:38:34.145 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.138+0000 7f7e06ab2740 10 client.5037 fetch_fsmap learned FSMap version 15 2024-09-16T15:38:34.145 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.138+0000 7f7e06ab2740 1 -- 172.21.15.98:0/2175180115 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x562ee35a19c0 con 0x562ee35c7df0 2024-09-16T15:38:34.145 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.139+0000 7f7ddcff9640 1 -- 172.21.15.98:0/2175180115 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7df40671b0 con 0x562ee35c7df0 2024-09-16T15:38:34.145 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.139+0000 7f7ddcff9640 1 -- 172.21.15.98:0/2175180115 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 15) ==== 3502+0+0 (secure 0 0 0) 0x7f7dec00fac0 con 0x562ee35c7df0 2024-09-16T15:38:34.145 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.139+0000 7f7e06ab2740 10 client.5037 fetch_fsmap finished waiting for FSMap version 15 2024-09-16T15:38:34.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.139+0000 7f7e06ab2740 10 client.5037 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-16T15:38:34.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.139+0000 7f7e06ab2740 20 client.5037 populate_metadata read hostname 'smithi098' 2024-09-16T15:38:34.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.139+0000 7f7e06ab2740 1 --2- 172.21.15.98:0/2175180115 >> [v2:172.21.15.98:6833/1806390493,v1:172.21.15.98:6835/1806390493] conn(0x562ee35d7090 0x562ee35d7470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:34.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.139+0000 7f7e06ab2740 4 client.5037 mds_command: new command op to 4851 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T15:38:34.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.139+0000 7f7e06ab2740 1 -- 172.21.15.98:0/2175180115 --> [v2:172.21.15.98:6833/1806390493,v1:172.21.15.98:6835/1806390493] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562ee34f6770 con 0x562ee35d7090 2024-09-16T15:38:34.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.139+0000 7f7e01a7e640 1 --2- 172.21.15.98:0/2175180115 >> [v2:172.21.15.98:6833/1806390493,v1:172.21.15.98:6835/1806390493] conn(0x562ee35d7090 0x562ee35d7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:34.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.139+0000 7f7e01a7e640 1 --2- 172.21.15.98:0/2175180115 >> [v2:172.21.15.98:6833/1806390493,v1:172.21.15.98:6835/1806390493] conn(0x562ee35d7090 0x562ee35d7470 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f927725534f65d9 server_cookie=bcac00758df752d5 in_seq=0 out_seq=0 2024-09-16T15:38:34.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.139+0000 7f7ddcff9640 10 client.5037 ms_handle_connect on v2:172.21.15.98:6833/1806390493 2024-09-16T15:38:34.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.140+0000 7f7ddcff9640 1 -- 172.21.15.98:0/2175180115 <== mds.0 v2:172.21.15.98:6833/1806390493 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562ee34f6770 con 0x562ee35d7090 2024-09-16T15:38:34.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.140+0000 7f7ddcff9640 10 client.5037 handle_command_reply: tid=0 2024-09-16T15:38:34.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.140+0000 7f7e06ab2740 1 client.5037 shutdown 2024-09-16T15:38:34.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.140+0000 7f7e06ab2740 1 -- 172.21.15.98:0/2175180115 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ee35c7df0 msgr2=0x562ee35c0790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:34.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.140+0000 7f7e06ab2740 1 --2- 172.21.15.98:0/2175180115 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ee35c7df0 0x562ee35c0790 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f7dec012720 tx=0x7f7dec012be0 comp rx=0 tx=0).stop 2024-09-16T15:38:34.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.140+0000 7f7e06ab2740 1 -- 172.21.15.98:0/2175180115 shutdown_connections 2024-09-16T15:38:34.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.140+0000 7f7e06ab2740 1 --2- 172.21.15.98:0/2175180115 >> [v2:172.21.15.98:6833/1806390493,v1:172.21.15.98:6835/1806390493] conn(0x562ee35d7090 0x562ee35d7470 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:34.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.140+0000 7f7e06ab2740 1 --2- 172.21.15.98:0/2175180115 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562ee35a0470 0x562ee35aa700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:34.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.140+0000 7f7e06ab2740 1 --2- 172.21.15.98:0/2175180115 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ee35c7df0 0x562ee35c0790 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:34.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.140+0000 7f7e06ab2740 1 --2- 172.21.15.98:0/2175180115 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562ee35a81b0 0x562ee35a13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:34.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.140+0000 7f7ddcff9640 0 client.5037 ms_handle_reset on v2:172.21.15.98:6833/1806390493 2024-09-16T15:38:34.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.140+0000 7f7e06ab2740 1 -- 172.21.15.98:0/2175180115 >> 172.21.15.98:0/2175180115 conn(0x562ee357d5f0 msgr2=0x562ee357b5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:34.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.140+0000 7f7e06ab2740 1 -- 172.21.15.98:0/2175180115 shutdown_connections 2024-09-16T15:38:34.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.140+0000 7f7e06ab2740 1 -- 172.21.15.98:0/2175180115 wait complete. 2024-09-16T15:38:34.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.140+0000 7f7e06ab2740 20 client.5037 trim_cache size 0 max 16384 2024-09-16T15:38:34.159 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.158+0000 7f7e06ab2740 1 Processor -- start 2024-09-16T15:38:34.159 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.158+0000 7f7e06ab2740 1 -- start start 2024-09-16T15:38:34.162 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.159+0000 7f7e06ab2740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562ee35a0470 0x562ee35aa6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:34.162 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.159+0000 7f7e06ab2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562ee35a81b0 0x562ee35abae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:34.162 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.159+0000 7f7e06ab2740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ee35c7df0 0x562ee35c05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:34.162 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.159+0000 7f7e06ab2740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7dfc1fe080 con 0x562ee35c7df0 2024-09-16T15:38:34.162 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.159+0000 7f7e06ab2740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7dfc1f6280 con 0x562ee35a81b0 2024-09-16T15:38:34.162 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.159+0000 7f7e06ab2740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f7dfc1f68d0 con 0x562ee35a0470 2024-09-16T15:38:34.162 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.159+0000 7f7e0227f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ee35c7df0 0x562ee35c05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:34.162 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.159+0000 7f7e0227f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ee35c7df0 0x562ee35c05a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40890/0 (socket says 172.21.15.98:40890) 2024-09-16T15:38:34.162 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.159+0000 7f7e0227f640 1 -- 172.21.15.98:0/2457006557 learned_addr learned my addr 172.21.15.98:0/2457006557 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:34.162 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.159+0000 7f7e0127d640 1 --2- 172.21.15.98:0/2457006557 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562ee35a81b0 0x562ee35abae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:34.162 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.159+0000 7f7e01a7e640 1 --2- 172.21.15.98:0/2457006557 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562ee35a0470 0x562ee35aa6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:34.162 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.159+0000 7f7e0227f640 1 -- 172.21.15.98:0/2457006557 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562ee35a0470 msgr2=0x562ee35aa6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T15:38:34.163 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.160+0000 7f7e0227f640 1 --2- 172.21.15.98:0/2457006557 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562ee35a0470 0x562ee35aa6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:34.163 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.160+0000 7f7e0227f640 1 -- 172.21.15.98:0/2457006557 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562ee35a81b0 msgr2=0x562ee35abae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T15:38:34.163 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.160+0000 7f7e0227f640 1 --2- 172.21.15.98:0/2457006557 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562ee35a81b0 0x562ee35abae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:34.163 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.160+0000 7f7e0227f640 1 -- 172.21.15.98:0/2457006557 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ee35c9560 con 0x562ee35c7df0 2024-09-16T15:38:34.163 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.160+0000 7f7e0127d640 1 --2- 172.21.15.98:0/2457006557 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562ee35a81b0 0x562ee35abae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T15:38:34.163 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.160+0000 7f7e0227f640 1 --2- 172.21.15.98:0/2457006557 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ee35c7df0 0x562ee35c05a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7df4062480 tx=0x7f7df40014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b62d19a83d2d6c44 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:34.163 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.160+0000 7f7ddeffd640 1 -- 172.21.15.98:0/2457006557 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df40671b0 con 0x562ee35c7df0 2024-09-16T15:38:34.163 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.160+0000 7f7ddeffd640 1 -- 172.21.15.98:0/2457006557 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7df407c030 con 0x562ee35c7df0 2024-09-16T15:38:34.163 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.160+0000 7f7ddeffd640 1 -- 172.21.15.98:0/2457006557 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df4069620 con 0x562ee35c7df0 2024-09-16T15:38:34.163 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.160+0000 7f7e06ab2740 1 -- 172.21.15.98:0/2457006557 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ee35c7df0 msgr2=0x562ee35c05a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:34.163 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.160+0000 7f7e06ab2740 1 --2- 172.21.15.98:0/2457006557 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ee35c7df0 0x562ee35c05a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7df4062480 tx=0x7f7df40014a0 comp rx=0 tx=0).stop 2024-09-16T15:38:34.163 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.160+0000 7f7e06ab2740 1 -- 172.21.15.98:0/2457006557 shutdown_connections 2024-09-16T15:38:34.163 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.160+0000 7f7e06ab2740 1 --2- 172.21.15.98:0/2457006557 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ee35c7df0 0x562ee35c05a0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:34.163 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.160+0000 7f7e06ab2740 1 --2- 172.21.15.98:0/2457006557 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562ee35a81b0 0x562ee35abae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:34.163 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.160+0000 7f7e06ab2740 1 --2- 172.21.15.98:0/2457006557 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562ee35a0470 0x562ee35aa6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:34.164 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.160+0000 7f7e06ab2740 1 -- 172.21.15.98:0/2457006557 >> 172.21.15.98:0/2457006557 conn(0x562ee357d5f0 msgr2=0x562ee35d9480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:34.164 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.160+0000 7f7e06ab2740 1 -- 172.21.15.98:0/2457006557 shutdown_connections 2024-09-16T15:38:34.164 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.160+0000 7f7e06ab2740 1 -- 172.21.15.98:0/2457006557 wait complete. 2024-09-16T15:38:34.164 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.161+0000 7f7e06ab2740 1 -- start start 2024-09-16T15:38:34.164 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.161+0000 7f7e06ab2740 1 Processor -- start 2024-09-16T15:38:34.167 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.162+0000 7f7e06ab2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562ee35a0470 0x562ee364ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:34.167 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.162+0000 7f7e06ab2740 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562ee35a81b0 0x562ee35a0b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:34.168 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.162+0000 7f7e06ab2740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ee35c7df0 0x562ee35a10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:34.168 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.162+0000 7f7e06ab2740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x562ee35a3d40 con 0x562ee35c7df0 2024-09-16T15:38:34.168 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.162+0000 7f7e06ab2740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x562ee35a4390 con 0x562ee35a0470 2024-09-16T15:38:34.168 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.162+0000 7f7e06ab2740 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x562ee35da550 con 0x562ee35a81b0 2024-09-16T15:38:34.168 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.162+0000 7f7e06ab2740 10 client.0 _ll_register_callbacks cb 0x7f7dec009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T15:38:34.168 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.162+0000 7f7e0227f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ee35c7df0 0x562ee35a10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:34.168 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.162+0000 7f7e0227f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ee35c7df0 0x562ee35a10a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40892/0 (socket says 172.21.15.98:40892) 2024-09-16T15:38:34.168 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.162+0000 7f7e0227f640 1 -- 172.21.15.98:0/1869337932 learned_addr learned my addr 172.21.15.98:0/1869337932 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:34.168 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.162+0000 7f7e0127d640 1 --2- 172.21.15.98:0/1869337932 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562ee35a81b0 0x562ee35a0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:34.168 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.162+0000 7f7e01a7e640 1 --2- 172.21.15.98:0/1869337932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562ee35a0470 0x562ee364ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:34.168 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.162+0000 7f7e0227f640 1 -- 172.21.15.98:0/1869337932 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562ee35a81b0 msgr2=0x562ee35a0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T15:38:34.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.162+0000 7f7e0227f640 1 --2- 172.21.15.98:0/1869337932 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562ee35a81b0 0x562ee35a0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:34.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.162+0000 7f7e0227f640 1 -- 172.21.15.98:0/1869337932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562ee35a0470 msgr2=0x562ee364ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T15:38:34.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.162+0000 7f7e0227f640 1 --2- 172.21.15.98:0/1869337932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562ee35a0470 0x562ee364ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:34.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.162+0000 7f7e0227f640 1 -- 172.21.15.98:0/1869337932 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ee35d5f50 con 0x562ee35c7df0 2024-09-16T15:38:34.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.163+0000 7f7e0227f640 1 --2- 172.21.15.98:0/1869337932 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ee35c7df0 0x562ee35a10a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7df400a430 tx=0x7f7df4069670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b0792dbb0597229 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:34.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.163+0000 7f7ddcff9640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-16T15:38:34.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.163+0000 7f7ddcff9640 1 -- 172.21.15.98:0/1869337932 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df4062780 con 0x562ee35c7df0 2024-09-16T15:38:34.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.163+0000 7f7ddcff9640 1 -- 172.21.15.98:0/1869337932 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f7df4061bf0 con 0x562ee35c7df0 2024-09-16T15:38:34.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.163+0000 7f7e06ab2740 1 -- 172.21.15.98:0/1869337932 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7df407c030 con 0x562ee35c7df0 2024-09-16T15:38:34.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.163+0000 7f7ddcff9640 1 -- 172.21.15.98:0/1869337932 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f7df4073050 con 0x562ee35c7df0 2024-09-16T15:38:34.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.163+0000 7f7e06ab2740 10 client.5043 fetch_fsmap learned FSMap version 15 2024-09-16T15:38:34.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.163+0000 7f7e06ab2740 1 -- 172.21.15.98:0/1869337932 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x562ee35c6df0 con 0x562ee35c7df0 2024-09-16T15:38:34.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.163+0000 7f7ddcff9640 1 -- 172.21.15.98:0/1869337932 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7df407c030 con 0x562ee35c7df0 2024-09-16T15:38:34.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.163+0000 7f7ddcff9640 1 -- 172.21.15.98:0/1869337932 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 15) ==== 3502+0+0 (secure 0 0 0) 0x7f7df4076020 con 0x562ee35c7df0 2024-09-16T15:38:34.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.163+0000 7f7e06ab2740 10 client.5043 fetch_fsmap finished waiting for FSMap version 15 2024-09-16T15:38:34.170 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.163+0000 7f7e06ab2740 10 client.5043 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-16T15:38:34.170 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.163+0000 7f7e06ab2740 20 client.5043 populate_metadata read hostname 'smithi098' 2024-09-16T15:38:34.170 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.163+0000 7f7e06ab2740 1 --2- 172.21.15.98:0/1869337932 >> [v2:172.21.15.98:6833/1806390493,v1:172.21.15.98:6835/1806390493] conn(0x562ee35a67b0 0x562ee35a6b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:34.170 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.163+0000 7f7e06ab2740 4 client.5043 mds_command: new command op to 4851 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-16T15:38:34.170 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.163+0000 7f7e06ab2740 1 -- 172.21.15.98:0/1869337932 --> [v2:172.21.15.98:6833/1806390493,v1:172.21.15.98:6835/1806390493] -- command(tid 0: {"prefix": "status"}) -- 0x562ee35c1540 con 0x562ee35a67b0 2024-09-16T15:38:34.170 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.163+0000 7f7e01a7e640 1 --2- 172.21.15.98:0/1869337932 >> [v2:172.21.15.98:6833/1806390493,v1:172.21.15.98:6835/1806390493] conn(0x562ee35a67b0 0x562ee35a6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:34.170 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.163+0000 7f7ddcff9640 10 client.5043 ms_handle_connect on v2:172.21.15.98:6833/1806390493 2024-09-16T15:38:34.170 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.163+0000 7f7e01a7e640 1 --2- 172.21.15.98:0/1869337932 >> [v2:172.21.15.98:6833/1806390493,v1:172.21.15.98:6835/1806390493] conn(0x562ee35a67b0 0x562ee35a6b90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2b650a573fac4d8 server_cookie=678e1c8827af89c7 in_seq=0 out_seq=0 2024-09-16T15:38:34.170 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.164+0000 7f7ddcff9640 1 -- 172.21.15.98:0/1869337932 <== mds.0 v2:172.21.15.98:6833/1806390493 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x562ee35c1540 con 0x562ee35a67b0 2024-09-16T15:38:34.170 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.164+0000 7f7ddcff9640 10 client.5043 handle_command_reply: tid=0 2024-09-16T15:38:34.170 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.164+0000 7f7e06ab2740 1 client.5043 shutdown 2024-09-16T15:38:34.170 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.164+0000 7f7e06ab2740 1 -- 172.21.15.98:0/1869337932 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ee35c7df0 msgr2=0x562ee35a10a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:34.170 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.164+0000 7f7e06ab2740 1 --2- 172.21.15.98:0/1869337932 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ee35c7df0 0x562ee35a10a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7df400a430 tx=0x7f7df4069670 comp rx=0 tx=0).stop 2024-09-16T15:38:34.170 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.164+0000 7f7e06ab2740 1 -- 172.21.15.98:0/1869337932 shutdown_connections 2024-09-16T15:38:34.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.164+0000 7f7e06ab2740 1 --2- 172.21.15.98:0/1869337932 >> [v2:172.21.15.98:6833/1806390493,v1:172.21.15.98:6835/1806390493] conn(0x562ee35a67b0 0x562ee35a6b90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:34.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.164+0000 7f7e06ab2740 1 --2- 172.21.15.98:0/1869337932 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ee35c7df0 0x562ee35a10a0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:34.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.164+0000 7f7e06ab2740 1 --2- 172.21.15.98:0/1869337932 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562ee35a81b0 0x562ee35a0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:34.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.164+0000 7f7e06ab2740 1 --2- 172.21.15.98:0/1869337932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562ee35a0470 0x562ee364ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:34.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.164+0000 7f7ddcff9640 0 client.5043 ms_handle_reset on v2:172.21.15.98:6833/1806390493 2024-09-16T15:38:34.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.164+0000 7f7e06ab2740 1 -- 172.21.15.98:0/1869337932 >> 172.21.15.98:0/1869337932 conn(0x562ee357d5f0 msgr2=0x562ee35d9480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:34.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.164+0000 7f7e06ab2740 1 -- 172.21.15.98:0/1869337932 shutdown_connections 2024-09-16T15:38:34.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.164+0000 7f7e06ab2740 1 -- 172.21.15.98:0/1869337932 wait complete. 2024-09-16T15:38:34.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.164+0000 7f7e06ab2740 20 client.5043 trim_cache size 0 max 16384 2024-09-16T15:38:34.171 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-16T15:38:34.171 INFO:teuthology.orchestra.run.smithi098.stdout: "cluster_fsid": "52a38a45-21d2-4cb0-bb3a-4fb8be3a08df", 2024-09-16T15:38:34.171 INFO:teuthology.orchestra.run.smithi098.stdout: "whoami": 0, 2024-09-16T15:38:34.172 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 4851, 2024-09-16T15:38:34.172 INFO:teuthology.orchestra.run.smithi098.stdout: "want_state": "up:active", 2024-09-16T15:38:34.172 INFO:teuthology.orchestra.run.smithi098.stdout: "state": "up:active", 2024-09-16T15:38:34.172 INFO:teuthology.orchestra.run.smithi098.stdout: "fs_name": "cephfs", 2024-09-16T15:38:34.172 INFO:teuthology.orchestra.run.smithi098.stdout: "rank_uptime": 9.0829330240000008, 2024-09-16T15:38:34.172 INFO:teuthology.orchestra.run.smithi098.stdout: "mdsmap_epoch": 15, 2024-09-16T15:38:34.172 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_epoch": 34, 2024-09-16T15:38:34.172 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_epoch_barrier": 34, 2024-09-16T15:38:34.172 INFO:teuthology.orchestra.run.smithi098.stdout: "uptime": 15.979131052 2024-09-16T15:38:34.172 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-16T15:38:34.173 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.165+0000 7f7e03ce2640 1 -- 172.21.15.98:0/3860810523 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f7de0078850 msgr2=0x7f7de007ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:34.173 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.165+0000 7f7e03ce2640 1 --2- 172.21.15.98:0/3860810523 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f7de0078850 0x7f7de007ad10 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7df8009230 tx=0x7f7df8004730 comp rx=0 tx=0).stop 2024-09-16T15:38:34.173 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.165+0000 7f7e03ce2640 1 -- 172.21.15.98:0/3860810523 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7dfc15f220 msgr2=0x7f7dfc155cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:34.173 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.165+0000 7f7e03ce2640 1 --2- 172.21.15.98:0/3860810523 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7dfc15f220 0x7f7dfc155cc0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f7df4002230 tx=0x7f7df400cb90 comp rx=0 tx=0).stop 2024-09-16T15:38:34.173 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.165+0000 7f7e03ce2640 1 -- 172.21.15.98:0/3860810523 shutdown_connections 2024-09-16T15:38:34.173 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.165+0000 7f7e03ce2640 1 --2- 172.21.15.98:0/3860810523 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7dfc15f220 0x7f7dfc155cc0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:34.173 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.165+0000 7f7e03ce2640 1 --2- 172.21.15.98:0/3860810523 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f7de0078850 0x7f7de007ad10 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:34.173 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.165+0000 7f7e03ce2640 1 --2- 172.21.15.98:0/3860810523 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7dfc15b0c0 0x7f7dfc155780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:34.174 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.165+0000 7f7e03ce2640 1 --2- 172.21.15.98:0/3860810523 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f7dfc0cd8a0 0x7f7dfc06cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:34.174 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.165+0000 7f7e03ce2640 1 -- 172.21.15.98:0/3860810523 >> 172.21.15.98:0/3860810523 conn(0x7f7dfc0b2b90 msgr2=0x7f7dfc075900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:34.174 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.165+0000 7f7e03ce2640 1 -- 172.21.15.98:0/3860810523 shutdown_connections 2024-09-16T15:38:34.174 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.165+0000 7f7e03ce2640 1 -- 172.21.15.98:0/3860810523 wait complete. 2024-09-16T15:38:34.176 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-16T15:38:34.276 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.275+0000 7f95a3ed4640 1 -- 172.21.15.98:0/2256693041 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f959c1445d0 msgr2=0x7f959c0cebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:34.277 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.275+0000 7f95a3ed4640 1 --2- 172.21.15.98:0/2256693041 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f959c1445d0 0x7f959c0cebf0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f9598005fd0 tx=0x7f959802a670 comp rx=0 tx=0).stop 2024-09-16T15:38:34.277 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.275+0000 7f95a3ed4640 1 -- 172.21.15.98:0/2256693041 shutdown_connections 2024-09-16T15:38:34.277 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.275+0000 7f95a3ed4640 1 --2- 172.21.15.98:0/2256693041 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f959c0b4ca0 0x7f959c0cf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:34.277 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.275+0000 7f95a3ed4640 1 --2- 172.21.15.98:0/2256693041 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f959c1445d0 0x7f959c0cebf0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:34.277 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.275+0000 7f95a3ed4640 1 -- 172.21.15.98:0/2256693041 >> 172.21.15.98:0/2256693041 conn(0x7f959c0b1950 msgr2=0x7f959c0b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:34.277 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.275+0000 7f95a3ed4640 1 -- 172.21.15.98:0/2256693041 shutdown_connections 2024-09-16T15:38:34.277 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.275+0000 7f95a3ed4640 1 -- 172.21.15.98:0/2256693041 wait complete. 2024-09-16T15:38:34.278 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.277+0000 7f95a3ed4640 1 Processor -- start 2024-09-16T15:38:34.278 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.277+0000 7f95a3ed4640 1 -- start start 2024-09-16T15:38:34.280 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.277+0000 7f95a3ed4640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f959c0b4ca0 0x7f959c142700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:34.280 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.277+0000 7f95a3ed4640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f959c0ccfd0 0x7f959c0cdae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:34.280 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.277+0000 7f95a3ed4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f959c1445d0 0x7f959c0ce020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:34.280 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.277+0000 7f95a3ed4640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f959c15f080 con 0x7f959c0b4ca0 2024-09-16T15:38:34.280 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.277+0000 7f95a3ed4640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f959c073bc0 con 0x7f959c1445d0 2024-09-16T15:38:34.280 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.277+0000 7f95a3ed4640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f959c15f200 con 0x7f959c0ccfd0 2024-09-16T15:38:34.280 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.277+0000 7f95a1c70640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f959c0b4ca0 0x7f959c142700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:34.280 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.277+0000 7f95a1c70640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f959c0b4ca0 0x7f959c142700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40910/0 (socket says 172.21.15.98:40910) 2024-09-16T15:38:34.280 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.277+0000 7f95a1c70640 1 -- 172.21.15.98:0/2160399692 learned_addr learned my addr 172.21.15.98:0/2160399692 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:34.280 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.278+0000 7f95a1c70640 1 -- 172.21.15.98:0/2160399692 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f959c0ccfd0 msgr2=0x7f959c0cdae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:34.280 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.278+0000 7f95a1c70640 1 --2- 172.21.15.98:0/2160399692 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f959c0ccfd0 0x7f959c0cdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:34.280 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.278+0000 7f95a1c70640 1 -- 172.21.15.98:0/2160399692 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f959c1445d0 msgr2=0x7f959c0ce020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:34.280 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.278+0000 7f95a1c70640 1 --2- 172.21.15.98:0/2160399692 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f959c1445d0 0x7f959c0ce020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:34.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.278+0000 7f95a1c70640 1 -- 172.21.15.98:0/2160399692 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f959c142c40 con 0x7f959c0b4ca0 2024-09-16T15:38:34.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.278+0000 7f95a1c70640 1 --2- 172.21.15.98:0/2160399692 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f959c0b4ca0 0x7f959c142700 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f9598034040 tx=0x7f9598003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:34.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.278+0000 7f958e7fc640 1 -- 172.21.15.98:0/2160399692 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f959803e030 con 0x7f959c0b4ca0 2024-09-16T15:38:34.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.278+0000 7f958e7fc640 1 -- 172.21.15.98:0/2160399692 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f95980047a0 con 0x7f959c0b4ca0 2024-09-16T15:38:34.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.278+0000 7f95a3ed4640 1 -- 172.21.15.98:0/2160399692 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f959c1f6d70 con 0x7f959c0b4ca0 2024-09-16T15:38:34.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.278+0000 7f958e7fc640 1 -- 172.21.15.98:0/2160399692 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9598035040 con 0x7f959c0b4ca0 2024-09-16T15:38:34.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.278+0000 7f95a3ed4640 1 -- 172.21.15.98:0/2160399692 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f959c1f2f60 con 0x7f959c0b4ca0 2024-09-16T15:38:34.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.279+0000 7f95a3ed4640 1 -- 172.21.15.98:0/2160399692 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f959c0745c0 con 0x7f959c0b4ca0 2024-09-16T15:38:34.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.280+0000 7f958e7fc640 1 -- 172.21.15.98:0/2160399692 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7f9598041030 con 0x7f959c0b4ca0 2024-09-16T15:38:34.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.280+0000 7f958e7fc640 1 --2- 172.21.15.98:0/2160399692 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f9580078850 0x7f958007ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:34.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.280+0000 7f958e7fc640 1 -- 172.21.15.98:0/2160399692 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f95980bafa0 con 0x7f959c0b4ca0 2024-09-16T15:38:34.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.280+0000 7f95a146f640 1 --2- 172.21.15.98:0/2160399692 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f9580078850 0x7f958007ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:34.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.281+0000 7f95a146f640 1 --2- 172.21.15.98:0/2160399692 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f9580078850 0x7f958007ad10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f959c06acf0 tx=0x7f95900078d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:34.285 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.284+0000 7f958e7fc640 1 -- 172.21.15.98:0/2160399692 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7f959c0745c0 con 0x7f959c0b4ca0 2024-09-16T15:38:34.496 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.495+0000 7f95a3ed4640 1 -- 172.21.15.98:0/2160399692 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f959c0af300 con 0x7f959c0b4ca0 2024-09-16T15:38:34.497 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.496+0000 7f958e7fc640 1 -- 172.21.15.98:0/2160399692 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) ==== 53+0+73 (secure 0 0 0) 0x7f959c142c40 con 0x7f959c0b4ca0 2024-09-16T15:38:34.497 INFO:teuthology.orchestra.run.smithi098.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-16T15:38:34.499 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.498+0000 7f95a3ed4640 1 -- 172.21.15.98:0/2160399692 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f9580078850 msgr2=0x7f958007ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:34.499 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.498+0000 7f95a3ed4640 1 --2- 172.21.15.98:0/2160399692 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f9580078850 0x7f958007ad10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f959c06acf0 tx=0x7f95900078d0 comp rx=0 tx=0).stop 2024-09-16T15:38:34.499 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.498+0000 7f95a3ed4640 1 -- 172.21.15.98:0/2160399692 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f959c0b4ca0 msgr2=0x7f959c142700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:34.499 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.498+0000 7f95a3ed4640 1 --2- 172.21.15.98:0/2160399692 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f959c0b4ca0 0x7f959c142700 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f9598034040 tx=0x7f9598003970 comp rx=0 tx=0).stop 2024-09-16T15:38:34.499 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.498+0000 7f95a3ed4640 1 -- 172.21.15.98:0/2160399692 shutdown_connections 2024-09-16T15:38:34.499 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.498+0000 7f95a3ed4640 1 --2- 172.21.15.98:0/2160399692 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f9580078850 0x7f958007ad10 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:34.499 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.498+0000 7f95a3ed4640 1 --2- 172.21.15.98:0/2160399692 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f959c1445d0 0x7f959c0ce020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:34.499 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.498+0000 7f95a3ed4640 1 --2- 172.21.15.98:0/2160399692 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f959c0ccfd0 0x7f959c0cdae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:34.499 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.498+0000 7f95a3ed4640 1 --2- 172.21.15.98:0/2160399692 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f959c0b4ca0 0x7f959c142700 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:34.499 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.498+0000 7f95a3ed4640 1 -- 172.21.15.98:0/2160399692 >> 172.21.15.98:0/2160399692 conn(0x7f959c0b1950 msgr2=0x7f959c0cbe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:34.499 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.498+0000 7f95a3ed4640 1 -- 172.21.15.98:0/2160399692 shutdown_connections 2024-09-16T15:38:34.499 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34.498+0000 7f95a3ed4640 1 -- 172.21.15.98:0/2160399692 wait complete. 2024-09-16T15:38:34.510 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-16T15:38:34.510 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-16T15:38:34.510 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi098.front.sepia.ceph.com 2024-09-16T15:38:34.510 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-16T15:38:34.510 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-16T15:38:34.510 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-16T15:38:34.510 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-16T15:38:34.510 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-16T15:38:34.510 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-16T15:38:34.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T15:38:34.511 DEBUG:teuthology.orchestra.run.smithi098:> ip addr 2024-09-16T15:38:34.527 INFO:teuthology.orchestra.run.smithi098.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T15:38:34.527 INFO:teuthology.orchestra.run.smithi098.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T15:38:34.527 INFO:teuthology.orchestra.run.smithi098.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T15:38:34.527 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2024-09-16T15:38:34.527 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 ::1/128 scope host 2024-09-16T15:38:34.527 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2024-09-16T15:38:34.527 INFO:teuthology.orchestra.run.smithi098.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T15:38:34.527 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:d8:d9:b8 brd ff:ff:ff:ff:ff:ff 2024-09-16T15:38:34.527 INFO:teuthology.orchestra.run.smithi098.stdout: altname enp7s0f0 2024-09-16T15:38:34.527 INFO:teuthology.orchestra.run.smithi098.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T15:38:34.527 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:d8:d9:b9 brd ff:ff:ff:ff:ff:ff 2024-09-16T15:38:34.527 INFO:teuthology.orchestra.run.smithi098.stdout: altname enp7s0f1 2024-09-16T15:38:34.528 INFO:teuthology.orchestra.run.smithi098.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T15:38:34.528 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:8f:d2:6a brd ff:ff:ff:ff:ff:ff 2024-09-16T15:38:34.528 INFO:teuthology.orchestra.run.smithi098.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-16T15:38:34.528 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:8f:d2:6b brd ff:ff:ff:ff:ff:ff 2024-09-16T15:38:34.528 INFO:teuthology.orchestra.run.smithi098.stdout: inet 172.21.15.98/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-16T15:38:34.528 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft 42727sec preferred_lft 42727sec 2024-09-16T15:38:34.528 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::ec4:7aff:fe8f:d26b/64 scope link noprefixroute 2024-09-16T15:38:34.528 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2024-09-16T15:38:34.528 INFO:teuthology.orchestra.run.smithi098.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-16T15:38:34.528 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 4a:7e:29:4f:fa:c8 brd ff:ff:ff:ff:ff:ff 2024-09-16T15:38:34.528 INFO:teuthology.orchestra.run.smithi098.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-16T15:38:34.528 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2024-09-16T15:38:34.529 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::c409:2eff:febe:bb92/64 scope link 2024-09-16T15:38:34.529 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2024-09-16T15:38:34.529 INFO:teuthology.orchestra.run.smithi098.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T15:38:34.529 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 66:90:2f:f2:79:64 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-16T15:38:34.529 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::6490:2fff:fef2:7964/64 scope link 2024-09-16T15:38:34.529 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2024-09-16T15:38:34.529 INFO:teuthology.orchestra.run.smithi098.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T15:38:34.529 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 4a:7e:29:4f:fa:c8 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-16T15:38:34.529 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::487e:29ff:fe4f:fac8/64 scope link 2024-09-16T15:38:34.529 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2024-09-16T15:38:34.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T15:38:34.530 DEBUG:teuthology.orchestra.run.smithi098:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-16T15:38:34.590 INFO:teuthology.orchestra.run.smithi098.stdout:1 2024-09-16T15:38:34.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T15:38:34.591 DEBUG:teuthology.orchestra.run.smithi098:> route 2024-09-16T15:38:34.648 INFO:teuthology.orchestra.run.smithi098.stdout:Kernel IP routing table 2024-09-16T15:38:34.648 INFO:teuthology.orchestra.run.smithi098.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-16T15:38:34.648 INFO:teuthology.orchestra.run.smithi098.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-16T15:38:34.649 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-16T15:38:34.649 INFO:teuthology.orchestra.run.smithi098.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-16T15:38:34.649 DEBUG:teuthology.orchestra.run.smithi098:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T15:38:34.649 DEBUG:teuthology.orchestra.run.smithi098:> set -e 2024-09-16T15:38:34.649 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-16T15:38:34.649 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-16T15:38:34.649 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-16T15:38:34.649 DEBUG:teuthology.orchestra.run.smithi098:> ') 2024-09-16T15:38:34.737 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T15:38:34.768 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T15:38:34.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T15:38:34.774 DEBUG:teuthology.orchestra.run.smithi098:> ip netns list 2024-09-16T15:38:34.789 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-16T15:38:34.790 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-16T15:38:34.790 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-16T15:38:34.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T15:38:34.790 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link set brx.0 up 2024-09-16T15:38:34.855 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T15:38:34.855 DEBUG:teuthology.orchestra.run.smithi098:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-16T15:38:34.910 INFO:teuthology.orchestra.run.smithi098.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-16T15:38:34.910 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T15:38:34.911 DEBUG:teuthology.orchestra.run.smithi098:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-16T15:38:34.965 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-16T15:38:34.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T15:38:34.966 DEBUG:teuthology.orchestra.run.smithi098:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T15:38:35.050 INFO:teuthology.orchestra.run.smithi098.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T15:38:35.050 INFO:teuthology.orchestra.run.smithi098.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T15:38:35.050 INFO:teuthology.orchestra.run.smithi098.stdout:invalid new device string format 2024-09-16T15:38:35.059 INFO:teuthology.orchestra.run.smithi098.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T15:38:35.059 INFO:teuthology.orchestra.run.smithi098.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T15:38:35.059 INFO:teuthology.orchestra.run.smithi098.stdout:invalid new device string format 2024-09-16T15:38:35.059 INFO:teuthology.orchestra.run.smithi098.stdout:mount.ceph: resolved to: "172.21.15.98:3300,172.21.15.135:3300,172.21.15.135:3301" 2024-09-16T15:38:35.059 INFO:teuthology.orchestra.run.smithi098.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T15:38:35.065 INFO:teuthology.orchestra.run.smithi098.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T15:38:35.065 INFO:teuthology.orchestra.run.smithi098.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T15:38:35.065 INFO:teuthology.orchestra.run.smithi098.stdout:invalid new device string format 2024-09-16T15:38:35.065 INFO:teuthology.orchestra.run.smithi098.stdout:mount.ceph: resolved to: "172.21.15.98:3300,172.21.15.135:3300,172.21.15.135:3301" 2024-09-16T15:38:35.065 INFO:teuthology.orchestra.run.smithi098.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T15:38:35.065 INFO:teuthology.orchestra.run.smithi098.stdout:mount.ceph: resolved to: "172.21.15.98:6789,172.21.15.135:6789,172.21.15.135:6790" 2024-09-16T15:38:35.065 INFO:teuthology.orchestra.run.smithi098.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.98:6789,172.21.15.135:6789,172.21.15.135:6790:/ 2024-09-16T15:38:35.065 INFO:teuthology.orchestra.run.smithi098.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=52a38a45-21d2-4cb0-bb3a-4fb8be3a08df" will pass to kernel 2024-09-16T15:38:35.066 INFO:teuthology.orchestra.run.smithi098.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-16T15:38:35.066 INFO:teuthology.orchestra.run.smithi098.stdout: You just mounted a file system that supports labels which does not 2024-09-16T15:38:35.066 INFO:teuthology.orchestra.run.smithi098.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-16T15:38:35.066 INFO:teuthology.orchestra.run.smithi098.stdout: applications will generate AVC messages and not be allowed access to 2024-09-16T15:38:35.066 INFO:teuthology.orchestra.run.smithi098.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-16T15:38:35.067 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-16T15:38:35.068 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T15:38:35.068 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-16T15:38:35.092 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T15:38:35.181 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:35 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T15:38:35.185 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T15:38:35.191 INFO:teuthology.orchestra.run.smithi098.stdout:client4942 2024-09-16T15:38:35.192 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-16T15:38:35.192 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T15:38:35.207 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-16T15:38:35.349 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:35.348+0000 7f1667071640 1 -- 172.21.15.98:0/1139899835 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1660073ea0 msgr2=0x7f16600cf830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:35.350 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:35.348+0000 7f1667071640 1 --2- 172.21.15.98:0/1139899835 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1660073ea0 0x7f16600cf830 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f166006fc10 tx=0x7f164c02a5f0 comp rx=0 tx=0).stop 2024-09-16T15:38:35.350 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:35.348+0000 7f1667071640 1 -- 172.21.15.98:0/1139899835 shutdown_connections 2024-09-16T15:38:35.350 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:35.348+0000 7f1667071640 1 --2- 172.21.15.98:0/1139899835 >> v2:172.21.15.135:3300/0 conn(0x7f16600ce910 0x7f16600cb390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:35.350 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:35.348+0000 7f1667071640 1 --2- 172.21.15.98:0/1139899835 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1660073ea0 0x7f16600cf830 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:35.350 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:35.348+0000 7f1667071640 1 -- 172.21.15.98:0/1139899835 >> 172.21.15.98:0/1139899835 conn(0x7f16600d0d40 msgr2=0x7f16600d1120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:35.350 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:35.348+0000 7f1667071640 1 -- 172.21.15.98:0/1139899835 shutdown_connections 2024-09-16T15:38:35.350 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:35.348+0000 7f1667071640 1 -- 172.21.15.98:0/1139899835 wait complete. 2024-09-16T15:38:35.350 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:35.350+0000 7f1667071640 1 Processor -- start 2024-09-16T15:38:35.351 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:35.350+0000 7f1667071640 1 -- start start 2024-09-16T15:38:35.353 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:35.351+0000 7f1667071640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1660073ea0 0x7f16601f3030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:35.353 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:35.351+0000 7f1667071640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16600ce910 0x7f16600aa090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:35.353 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:35.351+0000 7f1667071640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f166015ac00 0x7f16601f5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:35.353 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:35.351+0000 7f1667071640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f16600cba50 con 0x7f1660073ea0 2024-09-16T15:38:35.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:35.351+0000 7f1667071640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f16600cb8d0 con 0x7f16600ce910 2024-09-16T15:38:35.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:35.351+0000 7f1667071640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f16600cbbd0 con 0x7f166015ac00 2024-09-16T15:38:35.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:35.351+0000 7f1664e0d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1660073ea0 0x7f16601f3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:35.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:35.351+0000 7f1664e0d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1660073ea0 0x7f16601f3030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42312/0 (socket says 172.21.15.98:42312) 2024-09-16T15:38:35.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:35.351+0000 7f1664e0d640 1 -- 172.21.15.98:0/3878361827 learned_addr learned my addr 172.21.15.98:0/3878361827 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:35.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:35.351+0000 7f165ffff640 1 --2- 172.21.15.98:0/3878361827 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16600ce910 0x7f16600aa090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:35.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:35.351+0000 7f166560e640 1 --2- 172.21.15.98:0/3878361827 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f166015ac00 0x7f16601f5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:35.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:35.351+0000 7f1664e0d640 1 -- 172.21.15.98:0/3878361827 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f166015ac00 msgr2=0x7f16601f5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:35.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:35.351+0000 7f1664e0d640 1 --2- 172.21.15.98:0/3878361827 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f166015ac00 0x7f16601f5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:35.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:35.351+0000 7f1664e0d640 1 -- 172.21.15.98:0/3878361827 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16600ce910 msgr2=0x7f16600aa090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:35.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:35.351+0000 7f1664e0d640 1 --2- 172.21.15.98:0/3878361827 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16600ce910 0x7f16600aa090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:35.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:35.351+0000 7f1664e0d640 1 -- 172.21.15.98:0/3878361827 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16601f6580 con 0x7f1660073ea0 2024-09-16T15:38:35.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:35.351+0000 7f165ffff640 1 --2- 172.21.15.98:0/3878361827 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16600ce910 0x7f16600aa090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T15:38:35.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:35.351+0000 7f166560e640 1 --2- 172.21.15.98:0/3878361827 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f166015ac00 0x7f16601f5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T15:38:35.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:35.351+0000 7f1664e0d640 1 --2- 172.21.15.98:0/3878361827 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1660073ea0 0x7f16601f3030 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f165400c3c0 tx=0x7f165400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:35.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:35.351+0000 7f165d7fa640 1 -- 172.21.15.98:0/3878361827 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1654017070 con 0x7f1660073ea0 2024-09-16T15:38:35.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:35.351+0000 7f165d7fa640 1 -- 172.21.15.98:0/3878361827 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f16540035f0 con 0x7f1660073ea0 2024-09-16T15:38:35.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:35.351+0000 7f1667071640 1 -- 172.21.15.98:0/3878361827 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16601f6860 con 0x7f1660073ea0 2024-09-16T15:38:35.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:35.351+0000 7f165d7fa640 1 -- 172.21.15.98:0/3878361827 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1654003a40 con 0x7f1660073ea0 2024-09-16T15:38:35.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:35.352+0000 7f1667071640 1 -- 172.21.15.98:0/3878361827 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16601f3570 con 0x7f1660073ea0 2024-09-16T15:38:35.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:35.353+0000 7f1667071640 1 -- 172.21.15.98:0/3878361827 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16600cc140 con 0x7f1660073ea0 2024-09-16T15:38:35.356 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:35.353+0000 7f165d7fa640 1 -- 172.21.15.98:0/3878361827 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7f165401a070 con 0x7f1660073ea0 2024-09-16T15:38:35.356 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:35.353+0000 7f165d7fa640 1 --2- 172.21.15.98:0/3878361827 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f1644078850 0x7f164407ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:35.356 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:35.354+0000 7f165d7fa640 1 -- 172.21.15.98:0/3878361827 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f1654099cc0 con 0x7f1660073ea0 2024-09-16T15:38:35.357 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:35.354+0000 7f165ffff640 1 --2- 172.21.15.98:0/3878361827 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f1644078850 0x7f164407ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:35.357 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:35.354+0000 7f165ffff640 1 --2- 172.21.15.98:0/3878361827 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f1644078850 0x7f164407ad10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f164c033000 tx=0x7f164c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:35.359 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:35.358+0000 7f165d7fa640 1 -- 172.21.15.98:0/3878361827 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7f16540622b0 con 0x7f1660073ea0 2024-09-16T15:38:35.571 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:35.570+0000 7f1667071640 1 -- 172.21.15.98:0/3878361827 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f16600b6cc0 con 0x7f1660073ea0 2024-09-16T15:38:35.571 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:35.570+0000 7f165d7fa640 1 -- 172.21.15.98:0/3878361827 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) ==== 53+0+73 (secure 0 0 0) 0x7f1654061bb0 con 0x7f1660073ea0 2024-09-16T15:38:35.572 INFO:teuthology.orchestra.run.smithi098.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-16T15:38:35.574 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:35.572+0000 7f1667071640 1 -- 172.21.15.98:0/3878361827 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f1644078850 msgr2=0x7f164407ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:35.574 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:35.572+0000 7f1667071640 1 --2- 172.21.15.98:0/3878361827 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f1644078850 0x7f164407ad10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f164c033000 tx=0x7f164c004730 comp rx=0 tx=0).stop 2024-09-16T15:38:35.574 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:35.573+0000 7f1667071640 1 -- 172.21.15.98:0/3878361827 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1660073ea0 msgr2=0x7f16601f3030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:35.574 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:35.573+0000 7f1667071640 1 --2- 172.21.15.98:0/3878361827 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1660073ea0 0x7f16601f3030 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f165400c3c0 tx=0x7f165400c880 comp rx=0 tx=0).stop 2024-09-16T15:38:35.574 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:35.573+0000 7f1667071640 1 -- 172.21.15.98:0/3878361827 shutdown_connections 2024-09-16T15:38:35.574 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:35.573+0000 7f1667071640 1 --2- 172.21.15.98:0/3878361827 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f166015ac00 0x7f16601f5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:35.574 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:35.573+0000 7f1667071640 1 --2- 172.21.15.98:0/3878361827 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f1644078850 0x7f164407ad10 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:35.574 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:35.573+0000 7f1667071640 1 --2- 172.21.15.98:0/3878361827 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16600ce910 0x7f16600aa090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:35.574 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:35.573+0000 7f1667071640 1 --2- 172.21.15.98:0/3878361827 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1660073ea0 0x7f16601f3030 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:35.574 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:35.573+0000 7f1667071640 1 -- 172.21.15.98:0/3878361827 >> 172.21.15.98:0/3878361827 conn(0x7f16600d0d40 msgr2=0x7f1660071aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:35.575 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:35.573+0000 7f1667071640 1 -- 172.21.15.98:0/3878361827 shutdown_connections 2024-09-16T15:38:35.575 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:35.573+0000 7f1667071640 1 -- 172.21.15.98:0/3878361827 wait complete. 2024-09-16T15:38:35.584 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-16T15:38:35.585 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-16T15:38:35.585 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi135.front.sepia.ceph.com 2024-09-16T15:38:35.585 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-16T15:38:35.585 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-16T15:38:35.585 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-16T15:38:35.585 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-16T15:38:35.585 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-16T15:38:35.585 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-16T15:38:35.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T15:38:35.586 DEBUG:teuthology.orchestra.run.smithi135:> ip addr 2024-09-16T15:38:35.605 INFO:teuthology.orchestra.run.smithi135.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T15:38:35.605 INFO:teuthology.orchestra.run.smithi135.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T15:38:35.605 INFO:teuthology.orchestra.run.smithi135.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T15:38:35.606 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2024-09-16T15:38:35.606 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 ::1/128 scope host 2024-09-16T15:38:35.606 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2024-09-16T15:38:35.606 INFO:teuthology.orchestra.run.smithi135.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T15:38:35.606 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:d9:36:76 brd ff:ff:ff:ff:ff:ff 2024-09-16T15:38:35.606 INFO:teuthology.orchestra.run.smithi135.stdout: altname enp7s0f0 2024-09-16T15:38:35.606 INFO:teuthology.orchestra.run.smithi135.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T15:38:35.606 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:d9:36:77 brd ff:ff:ff:ff:ff:ff 2024-09-16T15:38:35.606 INFO:teuthology.orchestra.run.smithi135.stdout: altname enp7s0f1 2024-09-16T15:38:35.606 INFO:teuthology.orchestra.run.smithi135.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T15:38:35.606 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:88:80:82 brd ff:ff:ff:ff:ff:ff 2024-09-16T15:38:35.606 INFO:teuthology.orchestra.run.smithi135.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-16T15:38:35.607 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:88:80:83 brd ff:ff:ff:ff:ff:ff 2024-09-16T15:38:35.607 INFO:teuthology.orchestra.run.smithi135.stdout: inet 172.21.15.135/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-16T15:38:35.607 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft 42730sec preferred_lft 42730sec 2024-09-16T15:38:35.607 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 fe80::ec4:7aff:fe88:8083/64 scope link noprefixroute 2024-09-16T15:38:35.607 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2024-09-16T15:38:35.607 INFO:teuthology.orchestra.run.smithi135.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-16T15:38:35.607 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0e:3a:ee:d6:bf:3d brd ff:ff:ff:ff:ff:ff 2024-09-16T15:38:35.607 INFO:teuthology.orchestra.run.smithi135.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-16T15:38:35.607 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2024-09-16T15:38:35.607 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 fe80::7c19:bbff:fe16:bf9b/64 scope link 2024-09-16T15:38:35.607 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2024-09-16T15:38:35.607 INFO:teuthology.orchestra.run.smithi135.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T15:38:35.607 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0e:3a:ee:d6:bf:3d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-16T15:38:35.608 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 fe80::c3a:eeff:fed6:bf3d/64 scope link 2024-09-16T15:38:35.608 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2024-09-16T15:38:35.608 INFO:teuthology.orchestra.run.smithi135.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T15:38:35.608 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 6e:6b:a3:d0:7c:01 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-16T15:38:35.608 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 fe80::6c6b:a3ff:fed0:7c01/64 scope link 2024-09-16T15:38:35.608 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2024-09-16T15:38:35.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T15:38:35.608 DEBUG:teuthology.orchestra.run.smithi135:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-16T15:38:35.674 INFO:teuthology.orchestra.run.smithi135.stdout:1 2024-09-16T15:38:35.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T15:38:35.676 DEBUG:teuthology.orchestra.run.smithi135:> route 2024-09-16T15:38:35.733 INFO:teuthology.orchestra.run.smithi135.stdout:Kernel IP routing table 2024-09-16T15:38:35.734 INFO:teuthology.orchestra.run.smithi135.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-16T15:38:35.734 INFO:teuthology.orchestra.run.smithi135.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-16T15:38:35.734 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-16T15:38:35.734 INFO:teuthology.orchestra.run.smithi135.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-16T15:38:35.734 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T15:38:35.734 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2024-09-16T15:38:35.734 DEBUG:teuthology.orchestra.run.smithi135:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-16T15:38:35.734 DEBUG:teuthology.orchestra.run.smithi135:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-16T15:38:35.734 DEBUG:teuthology.orchestra.run.smithi135:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-16T15:38:35.734 DEBUG:teuthology.orchestra.run.smithi135:> ') 2024-09-16T15:38:35.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:38:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T15:38:35.858 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:38:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T15:38:35.864 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T15:38:35.864 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list 2024-09-16T15:38:35.879 INFO:teuthology.orchestra.run.smithi135.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-16T15:38:35.879 INFO:teuthology.orchestra.run.smithi135.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-16T15:38:35.880 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-16T15:38:35.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T15:38:35.880 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link set brx.0 up 2024-09-16T15:38:35.945 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T15:38:35.945 DEBUG:teuthology.orchestra.run.smithi135:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-16T15:38:36.000 INFO:teuthology.orchestra.run.smithi135.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-16T15:38:36.001 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T15:38:36.001 DEBUG:teuthology.orchestra.run.smithi135:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-16T15:38:36.056 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-16T15:38:36.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T15:38:36.056 DEBUG:teuthology.orchestra.run.smithi135:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T15:38:36.140 INFO:teuthology.orchestra.run.smithi135.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T15:38:36.141 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-16T15:38:36.141 INFO:teuthology.orchestra.run.smithi135.stdout:invalid new device string format 2024-09-16T15:38:36.149 INFO:teuthology.orchestra.run.smithi135.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T15:38:36.149 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-16T15:38:36.149 INFO:teuthology.orchestra.run.smithi135.stdout:invalid new device string format 2024-09-16T15:38:36.149 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: resolved to: "172.21.15.98:3300,172.21.15.135:3300,172.21.15.135:3301" 2024-09-16T15:38:36.149 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T15:38:36.155 INFO:teuthology.orchestra.run.smithi135.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T15:38:36.156 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-16T15:38:36.156 INFO:teuthology.orchestra.run.smithi135.stdout:invalid new device string format 2024-09-16T15:38:36.156 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: resolved to: "172.21.15.98:3300,172.21.15.135:3300,172.21.15.135:3301" 2024-09-16T15:38:36.156 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T15:38:36.156 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: resolved to: "172.21.15.98:6789,172.21.15.135:6789,172.21.15.135:6790" 2024-09-16T15:38:36.156 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.98:6789,172.21.15.135:6789,172.21.15.135:6790:/ 2024-09-16T15:38:36.156 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=52a38a45-21d2-4cb0-bb3a-4fb8be3a08df" will pass to kernel 2024-09-16T15:38:36.158 INFO:teuthology.orchestra.run.smithi135.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-16T15:38:36.158 INFO:teuthology.orchestra.run.smithi135.stdout: You just mounted a file system that supports labels which does not 2024-09-16T15:38:36.159 INFO:teuthology.orchestra.run.smithi135.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-16T15:38:36.159 INFO:teuthology.orchestra.run.smithi135.stdout: applications will generate AVC messages and not be allowed access to 2024-09-16T15:38:36.159 INFO:teuthology.orchestra.run.smithi135.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-16T15:38:36.159 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-16T15:38:36.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T15:38:36.159 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-16T15:38:36.183 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T15:38:36.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:38:36 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T15:38:36.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-16T15:38:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T15:38:36.280 INFO:teuthology.orchestra.run.smithi135.stdout:client5064 2024-09-16T15:38:36.280 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-16T15:38:36.280 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T15:38:36.295 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-09-16T15:38:36.408 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:36.407+0000 7fd137a8c640 1 -- 172.21.15.98:0/3554936338 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd1300cffb0 msgr2=0x7fd1300b3350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:36.409 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:36.407+0000 7fd137a8c640 1 --2- 172.21.15.98:0/3554936338 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd1300cffb0 0x7fd1300b3350 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fd12c009900 tx=0x7fd12c02a610 comp rx=0 tx=0).stop 2024-09-16T15:38:36.409 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:36.407+0000 7fd137a8c640 1 -- 172.21.15.98:0/3554936338 shutdown_connections 2024-09-16T15:38:36.409 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:36.407+0000 7fd137a8c640 1 --2- 172.21.15.98:0/3554936338 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd1300d0390 0x7fd13015eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:36.409 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:36.407+0000 7fd137a8c640 1 --2- 172.21.15.98:0/3554936338 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd1300cffb0 0x7fd1300b3350 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:36.409 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:36.407+0000 7fd137a8c640 1 -- 172.21.15.98:0/3554936338 >> 172.21.15.98:0/3554936338 conn(0x7fd1300d1e40 msgr2=0x7fd1300d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:36.409 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:36.407+0000 7fd137a8c640 1 -- 172.21.15.98:0/3554936338 shutdown_connections 2024-09-16T15:38:36.409 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:36.407+0000 7fd137a8c640 1 -- 172.21.15.98:0/3554936338 wait complete. 2024-09-16T15:38:36.410 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:36.409+0000 7fd137a8c640 1 Processor -- start 2024-09-16T15:38:36.410 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:36.409+0000 7fd137a8c640 1 -- start start 2024-09-16T15:38:36.411 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:36.409+0000 7fd137a8c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1300cffb0 0x7fd13015e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:36.411 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:36.409+0000 7fd137a8c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd1300d0390 0x7fd1300c5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:36.411 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:36.409+0000 7fd137a8c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd13015f530 0x7fd1301f31b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:36.412 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:36.409+0000 7fd137a8c640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd1300afb90 con 0x7fd13015f530 2024-09-16T15:38:36.412 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:36.409+0000 7fd137a8c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd1300b20d0 con 0x7fd1300cffb0 2024-09-16T15:38:36.412 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:36.409+0000 7fd137a8c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fd1300afd10 con 0x7fd1300d0390 2024-09-16T15:38:36.412 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:36.410+0000 7fd136029640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd13015f530 0x7fd1301f31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:36.412 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:36.410+0000 7fd136029640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd13015f530 0x7fd1301f31b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42332/0 (socket says 172.21.15.98:42332) 2024-09-16T15:38:36.412 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:36.410+0000 7fd136029640 1 -- 172.21.15.98:0/4273616322 learned_addr learned my addr 172.21.15.98:0/4273616322 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:36.412 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:36.410+0000 7fd135027640 1 --2- 172.21.15.98:0/4273616322 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd1300d0390 0x7fd1300c5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:36.412 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:36.410+0000 7fd135828640 1 --2- 172.21.15.98:0/4273616322 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1300cffb0 0x7fd13015e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:36.412 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:36.410+0000 7fd136029640 1 -- 172.21.15.98:0/4273616322 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd1300d0390 msgr2=0x7fd1300c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:36.412 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:36.410+0000 7fd136029640 1 --2- 172.21.15.98:0/4273616322 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd1300d0390 0x7fd1300c5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:36.412 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:36.410+0000 7fd136029640 1 -- 172.21.15.98:0/4273616322 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1300cffb0 msgr2=0x7fd13015e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:36.412 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:36.410+0000 7fd136029640 1 --2- 172.21.15.98:0/4273616322 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1300cffb0 0x7fd13015e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:36.412 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:36.410+0000 7fd136029640 1 -- 172.21.15.98:0/4273616322 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd13015e780 con 0x7fd13015f530 2024-09-16T15:38:36.412 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:36.410+0000 7fd136029640 1 --2- 172.21.15.98:0/4273616322 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd13015f530 0x7fd1301f31b0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fd12800c6b0 tx=0x7fd12800cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:36.413 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:36.410+0000 7fd1227fc640 1 -- 172.21.15.98:0/4273616322 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd128003b70 con 0x7fd13015f530 2024-09-16T15:38:36.413 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:36.410+0000 7fd1227fc640 1 -- 172.21.15.98:0/4273616322 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd128003d30 con 0x7fd13015f530 2024-09-16T15:38:36.413 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:36.410+0000 7fd137a8c640 1 -- 172.21.15.98:0/4273616322 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1300c7d60 con 0x7fd13015f530 2024-09-16T15:38:36.413 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:36.410+0000 7fd1227fc640 1 -- 172.21.15.98:0/4273616322 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd128005330 con 0x7fd13015f530 2024-09-16T15:38:36.413 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:36.410+0000 7fd137a8c640 1 -- 172.21.15.98:0/4273616322 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1300c8320 con 0x7fd13015f530 2024-09-16T15:38:36.414 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:36.411+0000 7fd137a8c640 1 -- 172.21.15.98:0/4273616322 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1300b3350 con 0x7fd13015f530 2024-09-16T15:38:36.414 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:36.412+0000 7fd1227fc640 1 -- 172.21.15.98:0/4273616322 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7fd1280054d0 con 0x7fd13015f530 2024-09-16T15:38:36.414 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:36.412+0000 7fd1227fc640 1 --2- 172.21.15.98:0/4273616322 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fd114078850 0x7fd11407ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:36.414 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:36.413+0000 7fd1227fc640 1 -- 172.21.15.98:0/4273616322 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fd12809a690 con 0x7fd13015f530 2024-09-16T15:38:36.414 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:36.413+0000 7fd135828640 1 --2- 172.21.15.98:0/4273616322 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fd114078850 0x7fd11407ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:36.414 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:36.413+0000 7fd135828640 1 --2- 172.21.15.98:0/4273616322 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fd114078850 0x7fd11407ad10 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd12c033000 tx=0x7fd12c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:36.417 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:36.417+0000 7fd1227fc640 1 -- 172.21.15.98:0/4273616322 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7fd128062d00 con 0x7fd13015f530 2024-09-16T15:38:36.629 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:36.629+0000 7fd137a8c640 1 -- 172.21.15.98:0/4273616322 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7fd130074bf0 con 0x7fd13015f530 2024-09-16T15:38:37.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.116+0000 7fd1227fc640 1 -- 172.21.15.98:0/4273616322 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v16) ==== 136+0+0 (secure 0 0 0) 0x7fd128062600 con 0x7fd13015f530 2024-09-16T15:38:37.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.118+0000 7fd137a8c640 1 -- 172.21.15.98:0/4273616322 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fd114078850 msgr2=0x7fd11407ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:37.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.118+0000 7fd137a8c640 1 --2- 172.21.15.98:0/4273616322 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fd114078850 0x7fd11407ad10 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd12c033000 tx=0x7fd12c004730 comp rx=0 tx=0).stop 2024-09-16T15:38:37.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.118+0000 7fd137a8c640 1 -- 172.21.15.98:0/4273616322 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd13015f530 msgr2=0x7fd1301f31b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:37.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.118+0000 7fd137a8c640 1 --2- 172.21.15.98:0/4273616322 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd13015f530 0x7fd1301f31b0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fd12800c6b0 tx=0x7fd12800cb70 comp rx=0 tx=0).stop 2024-09-16T15:38:37.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.118+0000 7fd137a8c640 1 -- 172.21.15.98:0/4273616322 shutdown_connections 2024-09-16T15:38:37.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.118+0000 7fd137a8c640 1 --2- 172.21.15.98:0/4273616322 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd13015f530 0x7fd1301f31b0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:37.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.118+0000 7fd137a8c640 1 --2- 172.21.15.98:0/4273616322 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd1300d0390 0x7fd1300c5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:37.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.118+0000 7fd137a8c640 1 --2- 172.21.15.98:0/4273616322 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fd114078850 0x7fd11407ad10 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:37.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.118+0000 7fd137a8c640 1 --2- 172.21.15.98:0/4273616322 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1300cffb0 0x7fd13015e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:37.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.118+0000 7fd137a8c640 1 -- 172.21.15.98:0/4273616322 >> 172.21.15.98:0/4273616322 conn(0x7fd1300d1e40 msgr2=0x7fd130071ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:37.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.118+0000 7fd137a8c640 1 -- 172.21.15.98:0/4273616322 shutdown_connections 2024-09-16T15:38:37.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.118+0000 7fd137a8c640 1 -- 172.21.15.98:0/4273616322 wait complete. 2024-09-16T15:38:37.132 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-16T15:38:37.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.236+0000 7ff9967a3640 1 -- 172.21.15.98:0/2238179931 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff9900b43f0 msgr2=0x7ff9900b47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:37.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.236+0000 7ff9967a3640 1 --2- 172.21.15.98:0/2238179931 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff9900b43f0 0x7ff9900b47d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff980005fd0 tx=0x7ff98002a4b0 comp rx=0 tx=0).stop 2024-09-16T15:38:37.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.236+0000 7ff9967a3640 1 -- 172.21.15.98:0/2238179931 shutdown_connections 2024-09-16T15:38:37.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.236+0000 7ff9967a3640 1 --2- 172.21.15.98:0/2238179931 >> v2:172.21.15.135:3300/0 conn(0x7ff990074150 0x7ff99006e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:37.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.236+0000 7ff9967a3640 1 --2- 172.21.15.98:0/2238179931 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff9900b43f0 0x7ff9900b47d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:37.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.236+0000 7ff9967a3640 1 -- 172.21.15.98:0/2238179931 >> 172.21.15.98:0/2238179931 conn(0x7ff9900b1950 msgr2=0x7ff9900b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:37.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.236+0000 7ff9967a3640 1 -- 172.21.15.98:0/2238179931 shutdown_connections 2024-09-16T15:38:37.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.236+0000 7ff9967a3640 1 -- 172.21.15.98:0/2238179931 wait complete. 2024-09-16T15:38:37.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.237+0000 7ff9967a3640 1 Processor -- start 2024-09-16T15:38:37.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.237+0000 7ff9967a3640 1 -- start start 2024-09-16T15:38:37.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.238+0000 7ff9967a3640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff990074150 0x7ff9901f4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:37.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.238+0000 7ff9967a3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff9900746a0 0x7ff9901f8c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:37.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.238+0000 7ff9967a3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9900b43f0 0x7ff99009d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:37.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.238+0000 7ff9967a3640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff99006f3b0 con 0x7ff9900746a0 2024-09-16T15:38:37.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.238+0000 7ff9967a3640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff9900704c0 con 0x7ff9900b43f0 2024-09-16T15:38:37.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.238+0000 7ff9967a3640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff99006f530 con 0x7ff990074150 2024-09-16T15:38:37.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.238+0000 7ff98f7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff9900746a0 0x7ff9901f8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:37.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.238+0000 7ff98f7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff9900746a0 0x7ff9901f8c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42338/0 (socket says 172.21.15.98:42338) 2024-09-16T15:38:37.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.238+0000 7ff98f7fe640 1 -- 172.21.15.98:0/3605025819 learned_addr learned my addr 172.21.15.98:0/3605025819 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:37.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.238+0000 7ff98ffff640 1 --2- 172.21.15.98:0/3605025819 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff990074150 0x7ff9901f4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:37.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.238+0000 7ff994d40640 1 --2- 172.21.15.98:0/3605025819 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9900b43f0 0x7ff99009d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:37.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.238+0000 7ff98f7fe640 1 -- 172.21.15.98:0/3605025819 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff990074150 msgr2=0x7ff9901f4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:37.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.238+0000 7ff98f7fe640 1 --2- 172.21.15.98:0/3605025819 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff990074150 0x7ff9901f4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:37.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.238+0000 7ff98f7fe640 1 -- 172.21.15.98:0/3605025819 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9900b43f0 msgr2=0x7ff99009d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:37.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.238+0000 7ff98f7fe640 1 --2- 172.21.15.98:0/3605025819 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9900b43f0 0x7ff99009d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:37.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.238+0000 7ff98f7fe640 1 -- 172.21.15.98:0/3605025819 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9901f91b0 con 0x7ff9900746a0 2024-09-16T15:38:37.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.239+0000 7ff98f7fe640 1 --2- 172.21.15.98:0/3605025819 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff9900746a0 0x7ff9901f8c70 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff98400e9f0 tx=0x7ff98400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:37.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.239+0000 7ff98cff9640 1 -- 172.21.15.98:0/3605025819 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff98400cd80 con 0x7ff9900746a0 2024-09-16T15:38:37.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.239+0000 7ff98cff9640 1 -- 172.21.15.98:0/3605025819 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff984004020 con 0x7ff9900746a0 2024-09-16T15:38:37.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.239+0000 7ff9967a3640 1 -- 172.21.15.98:0/3605025819 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff99009d950 con 0x7ff9900746a0 2024-09-16T15:38:37.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.239+0000 7ff98cff9640 1 -- 172.21.15.98:0/3605025819 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff984004470 con 0x7ff9900746a0 2024-09-16T15:38:37.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.239+0000 7ff9967a3640 1 -- 172.21.15.98:0/3605025819 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9901f5820 con 0x7ff9900746a0 2024-09-16T15:38:37.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.240+0000 7ff9967a3640 1 -- 172.21.15.98:0/3605025819 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9900b47d0 con 0x7ff9900746a0 2024-09-16T15:38:37.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.240+0000 7ff98cff9640 1 -- 172.21.15.98:0/3605025819 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7ff9840035f0 con 0x7ff9900746a0 2024-09-16T15:38:37.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.241+0000 7ff98cff9640 1 --2- 172.21.15.98:0/3605025819 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7ff97c078850 0x7ff97c07ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:37.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.241+0000 7ff98cff9640 1 -- 172.21.15.98:0/3605025819 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7ff98409b170 con 0x7ff9900746a0 2024-09-16T15:38:37.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.241+0000 7ff98ffff640 1 --2- 172.21.15.98:0/3605025819 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7ff97c078850 0x7ff97c07ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:37.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.241+0000 7ff98ffff640 1 --2- 172.21.15.98:0/3605025819 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7ff97c078850 0x7ff97c07ad10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff980033000 tx=0x7ff980004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:37.246 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.245+0000 7ff98cff9640 1 -- 172.21.15.98:0/3605025819 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7ff99009d950 con 0x7ff9900746a0 2024-09-16T15:38:37.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.441+0000 7ff9967a3640 1 -- 172.21.15.98:0/3605025819 --> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7ff9900cd320 con 0x7ff97c078850 2024-09-16T15:38:37.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.443+0000 7ff98cff9640 1 -- 172.21.15.98:0/3605025819 <== mgr.4100 v2:172.21.15.135:6800/699234772 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7ff9900cd320 con 0x7ff97c078850 2024-09-16T15:38:37.444 INFO:teuthology.orchestra.run.smithi098.stdout:[ 2024-09-16T15:38:37.445 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:37.445 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "cephfs" 2024-09-16T15:38:37.445 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:37.445 INFO:teuthology.orchestra.run.smithi098.stdout:] 2024-09-16T15:38:37.447 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.445+0000 7ff9967a3640 1 -- 172.21.15.98:0/3605025819 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7ff97c078850 msgr2=0x7ff97c07ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:37.447 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.445+0000 7ff9967a3640 1 --2- 172.21.15.98:0/3605025819 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7ff97c078850 0x7ff97c07ad10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff980033000 tx=0x7ff980004730 comp rx=0 tx=0).stop 2024-09-16T15:38:37.447 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.445+0000 7ff9967a3640 1 -- 172.21.15.98:0/3605025819 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff9900746a0 msgr2=0x7ff9901f8c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:37.447 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.445+0000 7ff9967a3640 1 --2- 172.21.15.98:0/3605025819 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff9900746a0 0x7ff9901f8c70 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff98400e9f0 tx=0x7ff98400eeb0 comp rx=0 tx=0).stop 2024-09-16T15:38:37.447 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.446+0000 7ff9967a3640 1 -- 172.21.15.98:0/3605025819 shutdown_connections 2024-09-16T15:38:37.447 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.446+0000 7ff9967a3640 1 --2- 172.21.15.98:0/3605025819 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7ff97c078850 0x7ff97c07ad10 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:37.447 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.446+0000 7ff9967a3640 1 --2- 172.21.15.98:0/3605025819 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9900b43f0 0x7ff99009d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:37.447 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.446+0000 7ff9967a3640 1 --2- 172.21.15.98:0/3605025819 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff9900746a0 0x7ff9901f8c70 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:37.447 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.446+0000 7ff9967a3640 1 --2- 172.21.15.98:0/3605025819 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff990074150 0x7ff9901f4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:37.447 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.446+0000 7ff9967a3640 1 -- 172.21.15.98:0/3605025819 >> 172.21.15.98:0/3605025819 conn(0x7ff9900b1950 msgr2=0x7ff9900cebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:37.448 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.446+0000 7ff9967a3640 1 -- 172.21.15.98:0/3605025819 shutdown_connections 2024-09-16T15:38:37.448 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.446+0000 7ff9967a3640 1 -- 172.21.15.98:0/3605025819 wait complete. 2024-09-16T15:38:37.457 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-16T15:38:37.562 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.560+0000 7f010667f640 1 -- 172.21.15.98:0/3707724724 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f01000b3370 msgr2=0x7f01000cebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:37.562 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.560+0000 7f010667f640 1 --2- 172.21.15.98:0/3707724724 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f01000b3370 0x7f01000cebe0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f010006db10 tx=0x7f00f002a530 comp rx=0 tx=0).stop 2024-09-16T15:38:37.562 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.560+0000 7f010667f640 1 -- 172.21.15.98:0/3707724724 shutdown_connections 2024-09-16T15:38:37.562 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.560+0000 7f010667f640 1 --2- 172.21.15.98:0/3707724724 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f010015f090 0x7f01000cf120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:37.562 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.560+0000 7f010667f640 1 --2- 172.21.15.98:0/3707724724 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f01000b3370 0x7f01000cebe0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:37.562 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.560+0000 7f010667f640 1 -- 172.21.15.98:0/3707724724 >> 172.21.15.98:0/3707724724 conn(0x7f01000b1840 msgr2=0x7f01000b1c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:37.562 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.561+0000 7f010667f640 1 -- 172.21.15.98:0/3707724724 shutdown_connections 2024-09-16T15:38:37.562 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.561+0000 7f010667f640 1 -- 172.21.15.98:0/3707724724 wait complete. 2024-09-16T15:38:37.563 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.562+0000 7f010667f640 1 Processor -- start 2024-09-16T15:38:37.563 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.562+0000 7f010667f640 1 -- start start 2024-09-16T15:38:37.565 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.563+0000 7f010667f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f01000b3370 0x7f010012be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:37.565 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.563+0000 7f010667f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f010015c080 0x7f01001f41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:37.565 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.563+0000 7f010667f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f010015f090 0x7f01001f4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:37.565 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.563+0000 7f010667f640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0100164e50 con 0x7f010015c080 2024-09-16T15:38:37.565 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.563+0000 7f010667f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0100164cd0 con 0x7f01000b3370 2024-09-16T15:38:37.565 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.563+0000 7f010667f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f0100164fd0 con 0x7f010015f090 2024-09-16T15:38:37.565 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.563+0000 7f00ff7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f010015c080 0x7f01001f41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:37.565 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.563+0000 7f00ff7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f010015c080 0x7f01001f41f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42352/0 (socket says 172.21.15.98:42352) 2024-09-16T15:38:37.565 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.563+0000 7f00ff7fe640 1 -- 172.21.15.98:0/2956767385 learned_addr learned my addr 172.21.15.98:0/2956767385 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:37.566 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.563+0000 7f00fffff640 1 --2- 172.21.15.98:0/2956767385 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f01000b3370 0x7f010012be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:37.566 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.563+0000 7f0104c1c640 1 --2- 172.21.15.98:0/2956767385 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f010015f090 0x7f01001f4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:37.566 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.563+0000 7f00ff7fe640 1 -- 172.21.15.98:0/2956767385 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f010015f090 msgr2=0x7f01001f4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:37.566 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.563+0000 7f00ff7fe640 1 --2- 172.21.15.98:0/2956767385 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f010015f090 0x7f01001f4730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:37.566 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.563+0000 7f00ff7fe640 1 -- 172.21.15.98:0/2956767385 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f01000b3370 msgr2=0x7f010012be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:37.566 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.563+0000 7f00ff7fe640 1 --2- 172.21.15.98:0/2956767385 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f01000b3370 0x7f010012be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:37.566 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.563+0000 7f00ff7fe640 1 -- 172.21.15.98:0/2956767385 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0100140180 con 0x7f010015c080 2024-09-16T15:38:37.566 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.563+0000 7f00ff7fe640 1 --2- 172.21.15.98:0/2956767385 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f010015c080 0x7f01001f41f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f00f400c3f0 tx=0x7f00f400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:37.566 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.563+0000 7f00fcff9640 1 -- 172.21.15.98:0/2956767385 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f4007020 con 0x7f010015c080 2024-09-16T15:38:37.566 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.563+0000 7f00fcff9640 1 -- 172.21.15.98:0/2956767385 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f00f40072b0 con 0x7f010015c080 2024-09-16T15:38:37.566 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.563+0000 7f010667f640 1 -- 172.21.15.98:0/2956767385 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0100140460 con 0x7f010015c080 2024-09-16T15:38:37.566 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.563+0000 7f00fcff9640 1 -- 172.21.15.98:0/2956767385 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f40067d0 con 0x7f010015c080 2024-09-16T15:38:37.566 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.564+0000 7f010667f640 1 -- 172.21.15.98:0/2956767385 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0100140a20 con 0x7f010015c080 2024-09-16T15:38:37.567 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.564+0000 7f010667f640 1 -- 172.21.15.98:0/2956767385 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f010015e980 con 0x7f010015c080 2024-09-16T15:38:37.567 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.565+0000 7f00fcff9640 1 -- 172.21.15.98:0/2956767385 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7f00f4019020 con 0x7f010015c080 2024-09-16T15:38:37.567 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.566+0000 7f00fcff9640 1 --2- 172.21.15.98:0/2956767385 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f00ec078850 0x7f00ec07ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:37.568 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.566+0000 7f00fcff9640 1 -- 172.21.15.98:0/2956767385 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f00f4099fd0 con 0x7f010015c080 2024-09-16T15:38:37.568 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.566+0000 7f00fffff640 1 --2- 172.21.15.98:0/2956767385 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f00ec078850 0x7f00ec07ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:37.568 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.566+0000 7f00fffff640 1 --2- 172.21.15.98:0/2956767385 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f00ec078850 0x7f00ec07ad10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f00f0033000 tx=0x7f00f0004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:37.571 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.570+0000 7f00fcff9640 1 -- 172.21.15.98:0/2956767385 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7f00f4061f70 con 0x7f010015c080 2024-09-16T15:38:37.748 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.747+0000 7f010667f640 1 -- 172.21.15.98:0/2956767385 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f010015cf00 con 0x7f010015c080 2024-09-16T15:38:37.748 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.748+0000 7f00fcff9640 1 -- 172.21.15.98:0/2956767385 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v28)=0 v28) ==== 122+0+0 (secure 0 0 0) 0x7f00f40669a0 con 0x7f010015c080 2024-09-16T15:38:37.751 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.750+0000 7f010667f640 1 -- 172.21.15.98:0/2956767385 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f00ec078850 msgr2=0x7f00ec07ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:37.751 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.750+0000 7f010667f640 1 --2- 172.21.15.98:0/2956767385 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f00ec078850 0x7f00ec07ad10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f00f0033000 tx=0x7f00f0004730 comp rx=0 tx=0).stop 2024-09-16T15:38:37.751 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.750+0000 7f010667f640 1 -- 172.21.15.98:0/2956767385 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f010015c080 msgr2=0x7f01001f41f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:37.751 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.750+0000 7f010667f640 1 --2- 172.21.15.98:0/2956767385 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f010015c080 0x7f01001f41f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f00f400c3f0 tx=0x7f00f400c8b0 comp rx=0 tx=0).stop 2024-09-16T15:38:37.751 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.750+0000 7f010667f640 1 -- 172.21.15.98:0/2956767385 shutdown_connections 2024-09-16T15:38:37.751 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.750+0000 7f010667f640 1 --2- 172.21.15.98:0/2956767385 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f010015f090 0x7f01001f4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:37.751 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.750+0000 7f010667f640 1 --2- 172.21.15.98:0/2956767385 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f010015c080 0x7f01001f41f0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:37.751 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.750+0000 7f010667f640 1 --2- 172.21.15.98:0/2956767385 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f00ec078850 0x7f00ec07ad10 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:37.751 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.750+0000 7f010667f640 1 --2- 172.21.15.98:0/2956767385 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f01000b3370 0x7f010012be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:37.752 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.750+0000 7f010667f640 1 -- 172.21.15.98:0/2956767385 >> 172.21.15.98:0/2956767385 conn(0x7f01000b1840 msgr2=0x7f010013d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:37.752 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.750+0000 7f010667f640 1 -- 172.21.15.98:0/2956767385 shutdown_connections 2024-09-16T15:38:37.752 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.750+0000 7f010667f640 1 -- 172.21.15.98:0/2956767385 wait complete. 2024-09-16T15:38:37.762 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create cephfs subvol_grp460 2024-09-16T15:38:37.867 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.866+0000 7f888e0e6640 1 -- 172.21.15.98:0/1813783605 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8888161590 msgr2=0x7f88880b6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:37.867 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.866+0000 7f888e0e6640 1 --2- 172.21.15.98:0/1813783605 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8888161590 0x7f88880b6e00 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8878005fd0 tx=0x7f887802a8b0 comp rx=0 tx=0).stop 2024-09-16T15:38:37.867 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.866+0000 7f888e0e6640 1 -- 172.21.15.98:0/1813783605 shutdown_connections 2024-09-16T15:38:37.867 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.866+0000 7f888e0e6640 1 --2- 172.21.15.98:0/1813783605 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f88880b5630 0x7f88880cf5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:37.867 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.866+0000 7f888e0e6640 1 --2- 172.21.15.98:0/1813783605 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8888161590 0x7f88880b6e00 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:37.867 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.866+0000 7f888e0e6640 1 -- 172.21.15.98:0/1813783605 >> 172.21.15.98:0/1813783605 conn(0x7f88880d3fb0 msgr2=0x7f88880d43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:37.867 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.866+0000 7f888e0e6640 1 -- 172.21.15.98:0/1813783605 shutdown_connections 2024-09-16T15:38:37.867 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.866+0000 7f888e0e6640 1 -- 172.21.15.98:0/1813783605 wait complete. 2024-09-16T15:38:37.868 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.867+0000 7f888e0e6640 1 Processor -- start 2024-09-16T15:38:37.868 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.867+0000 7f888e0e6640 1 -- start start 2024-09-16T15:38:37.870 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.868+0000 7f888e0e6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88880b5630 0x7f8888159440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:37.870 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.868+0000 7f888e0e6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88880b7340 0x7f88880cb080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:37.870 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.868+0000 7f888e0e6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8888161590 0x7f88880cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:37.870 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.868+0000 7f888e0e6640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f88880cfe80 con 0x7f88880b5630 2024-09-16T15:38:37.870 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.868+0000 7f888e0e6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f88880cfd00 con 0x7f88880b7340 2024-09-16T15:38:37.870 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.868+0000 7f888e0e6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f8888162430 con 0x7f8888161590 2024-09-16T15:38:37.870 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.868+0000 7f88877fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88880b5630 0x7f8888159440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:37.870 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.868+0000 7f88877fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88880b5630 0x7f8888159440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42354/0 (socket says 172.21.15.98:42354) 2024-09-16T15:38:37.870 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.868+0000 7f88877fe640 1 -- 172.21.15.98:0/4110313878 learned_addr learned my addr 172.21.15.98:0/4110313878 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:37.870 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.868+0000 7f8886ffd640 1 --2- 172.21.15.98:0/4110313878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88880b7340 0x7f88880cb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:37.870 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.868+0000 7f8887fff640 1 --2- 172.21.15.98:0/4110313878 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8888161590 0x7f88880cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:37.870 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.868+0000 7f88877fe640 1 -- 172.21.15.98:0/4110313878 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8888161590 msgr2=0x7f88880cb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:37.870 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.868+0000 7f88877fe640 1 --2- 172.21.15.98:0/4110313878 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8888161590 0x7f88880cb5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:37.870 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.868+0000 7f88877fe640 1 -- 172.21.15.98:0/4110313878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88880b7340 msgr2=0x7f88880cb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:37.871 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.868+0000 7f88877fe640 1 --2- 172.21.15.98:0/4110313878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88880b7340 0x7f88880cb080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:37.871 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.868+0000 7f88877fe640 1 -- 172.21.15.98:0/4110313878 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8888159d70 con 0x7f88880b5630 2024-09-16T15:38:37.871 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.868+0000 7f8886ffd640 1 --2- 172.21.15.98:0/4110313878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88880b7340 0x7f88880cb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T15:38:37.871 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.868+0000 7f8887fff640 1 --2- 172.21.15.98:0/4110313878 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8888161590 0x7f88880cb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T15:38:37.871 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.868+0000 7f88877fe640 1 --2- 172.21.15.98:0/4110313878 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88880b5630 0x7f8888159440 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f8878000f80 tx=0x7f8878003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:37.871 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.868+0000 7f886ffff640 1 -- 172.21.15.98:0/4110313878 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8878031990 con 0x7f88880b5630 2024-09-16T15:38:37.871 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.869+0000 7f886ffff640 1 -- 172.21.15.98:0/4110313878 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8878031c20 con 0x7f88880b5630 2024-09-16T15:38:37.871 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.869+0000 7f888e0e6640 1 -- 172.21.15.98:0/4110313878 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88881490a0 con 0x7f88880b5630 2024-09-16T15:38:37.871 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.869+0000 7f886ffff640 1 -- 172.21.15.98:0/4110313878 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88780330d0 con 0x7f88880b5630 2024-09-16T15:38:37.871 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.869+0000 7f888e0e6640 1 -- 172.21.15.98:0/4110313878 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8888149660 con 0x7f88880b5630 2024-09-16T15:38:37.872 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.870+0000 7f888e0e6640 1 -- 172.21.15.98:0/4110313878 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88881628b0 con 0x7f88880b5630 2024-09-16T15:38:37.872 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.870+0000 7f886ffff640 1 -- 172.21.15.98:0/4110313878 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7f8878033270 con 0x7f88880b5630 2024-09-16T15:38:37.872 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.871+0000 7f886ffff640 1 --2- 172.21.15.98:0/4110313878 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f8874078850 0x7f887407ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:37.872 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.871+0000 7f886ffff640 1 -- 172.21.15.98:0/4110313878 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f88780bbd30 con 0x7f88880b5630 2024-09-16T15:38:37.872 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.871+0000 7f8886ffd640 1 --2- 172.21.15.98:0/4110313878 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f8874078850 0x7f887407ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:37.872 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.871+0000 7f8886ffd640 1 --2- 172.21.15.98:0/4110313878 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f8874078850 0x7f887407ad10 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f888815dd20 tx=0x7f887c005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:37.876 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:37.875+0000 7f886ffff640 1 -- 172.21.15.98:0/4110313878 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7f887803f030 con 0x7f88880b5630 2024-09-16T15:38:38.075 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.074+0000 7f888e0e6640 1 -- 172.21.15.98:0/4110313878 --> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "subvol_grp460", "target": ["mon-mgr", ""]}) -- 0x7f88880b9f30 con 0x7f8874078850 2024-09-16T15:38:38.080 INFO:tasks.ceph.mgr.x.smithi135.stderr:2024-09-16T15:38:38.079+0000 7fae68d53640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T15:38:38.080 INFO:tasks.ceph.mgr.x.smithi135.stderr:2024-09-16T15:38:38.079+0000 7fae68d53640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T15:38:38.080 INFO:tasks.ceph.mgr.x.smithi135.stderr:2024-09-16T15:38:38.079+0000 7fae68d53640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T15:38:38.080 INFO:tasks.ceph.mgr.x.smithi135.stderr:2024-09-16T15:38:38.079+0000 7fae68d53640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T15:38:38.081 INFO:tasks.ceph.mgr.x.smithi135.stderr:2024-09-16T15:38:38.079+0000 7fae68d53640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T15:38:38.096 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.096+0000 7f886ffff640 1 -- 172.21.15.98:0/4110313878 <== mgr.4100 v2:172.21.15.135:6800/699234772 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f88880b9f30 con 0x7f8874078850 2024-09-16T15:38:38.099 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.098+0000 7f888e0e6640 1 -- 172.21.15.98:0/4110313878 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f8874078850 msgr2=0x7f887407ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:38.099 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.098+0000 7f888e0e6640 1 --2- 172.21.15.98:0/4110313878 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f8874078850 0x7f887407ad10 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f888815dd20 tx=0x7f887c005f90 comp rx=0 tx=0).stop 2024-09-16T15:38:38.099 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.098+0000 7f888e0e6640 1 -- 172.21.15.98:0/4110313878 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88880b5630 msgr2=0x7f8888159440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:38.099 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.098+0000 7f888e0e6640 1 --2- 172.21.15.98:0/4110313878 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88880b5630 0x7f8888159440 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f8878000f80 tx=0x7f8878003970 comp rx=0 tx=0).stop 2024-09-16T15:38:38.099 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.098+0000 7f888e0e6640 1 -- 172.21.15.98:0/4110313878 shutdown_connections 2024-09-16T15:38:38.100 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.098+0000 7f888e0e6640 1 --2- 172.21.15.98:0/4110313878 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8888161590 0x7f88880cb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:38.100 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.098+0000 7f888e0e6640 1 --2- 172.21.15.98:0/4110313878 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f8874078850 0x7f887407ad10 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:38.100 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.098+0000 7f888e0e6640 1 --2- 172.21.15.98:0/4110313878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88880b7340 0x7f88880cb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:38.100 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.098+0000 7f888e0e6640 1 --2- 172.21.15.98:0/4110313878 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f88880b5630 0x7f8888159440 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:38.100 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.098+0000 7f888e0e6640 1 -- 172.21.15.98:0/4110313878 >> 172.21.15.98:0/4110313878 conn(0x7f88880d3fb0 msgr2=0x7f88880d2010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:38.100 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.098+0000 7f888e0e6640 1 -- 172.21.15.98:0/4110313878 shutdown_connections 2024-09-16T15:38:38.100 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.098+0000 7f888e0e6640 1 -- 172.21.15.98:0/4110313878 wait complete. 2024-09-16T15:38:38.110 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvol59680 --group_name subvol_grp460 2024-09-16T15:38:38.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.216+0000 7f5c79f94640 1 -- 172.21.15.98:0/946112947 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5c7406cb70 msgr2=0x7f5c7406cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:38.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.216+0000 7f5c79f94640 1 --2- 172.21.15.98:0/946112947 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5c7406cb70 0x7f5c7406cfc0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f5c7406dc50 tx=0x7f5c6c02aa30 comp rx=0 tx=0).stop 2024-09-16T15:38:38.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.216+0000 7f5c79f94640 1 -- 172.21.15.98:0/946112947 shutdown_connections 2024-09-16T15:38:38.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.216+0000 7f5c79f94640 1 --2- 172.21.15.98:0/946112947 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5c7406cb70 0x7f5c7406cfc0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:38.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.216+0000 7f5c79f94640 1 --2- 172.21.15.98:0/946112947 >> v2:172.21.15.135:3300/0 conn(0x7f5c74152e70 0x7f5c7415cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:38.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.216+0000 7f5c79f94640 1 -- 172.21.15.98:0/946112947 >> 172.21.15.98:0/946112947 conn(0x7f5c7406dc80 msgr2=0x7f5c7406e090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:38.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.216+0000 7f5c79f94640 1 -- 172.21.15.98:0/946112947 shutdown_connections 2024-09-16T15:38:38.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.216+0000 7f5c79f94640 1 -- 172.21.15.98:0/946112947 wait complete. 2024-09-16T15:38:38.220 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.217+0000 7f5c79f94640 1 Processor -- start 2024-09-16T15:38:38.220 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.217+0000 7f5c79f94640 1 -- start start 2024-09-16T15:38:38.220 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.218+0000 7f5c79f94640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c7406cb70 0x7f5c741554b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:38.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.218+0000 7f5c79f94640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5c74152e70 0x7f5c7415ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:38.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.218+0000 7f5c79f94640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5c741f7ca0 0x7f5c741f80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:38.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.218+0000 7f5c79f94640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5c740af7b0 con 0x7f5c74152e70 2024-09-16T15:38:38.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.218+0000 7f5c79f94640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5c740af630 con 0x7f5c7406cb70 2024-09-16T15:38:38.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.218+0000 7f5c79f94640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f5c740af930 con 0x7f5c741f7ca0 2024-09-16T15:38:38.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.218+0000 7f5c6bfff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5c74152e70 0x7f5c7415ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:38.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.218+0000 7f5c6bfff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5c74152e70 0x7f5c7415ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42382/0 (socket says 172.21.15.98:42382) 2024-09-16T15:38:38.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.218+0000 7f5c6bfff640 1 -- 172.21.15.98:0/3949585035 learned_addr learned my addr 172.21.15.98:0/3949585035 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:38.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.218+0000 7f5c737fe640 1 --2- 172.21.15.98:0/3949585035 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c7406cb70 0x7f5c741554b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:38.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.218+0000 7f5c73fff640 1 --2- 172.21.15.98:0/3949585035 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5c741f7ca0 0x7f5c741f80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:38.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.219+0000 7f5c6bfff640 1 -- 172.21.15.98:0/3949585035 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5c741f7ca0 msgr2=0x7f5c741f80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:38.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.219+0000 7f5c6bfff640 1 --2- 172.21.15.98:0/3949585035 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5c741f7ca0 0x7f5c741f80f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:38.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.219+0000 7f5c6bfff640 1 -- 172.21.15.98:0/3949585035 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c7406cb70 msgr2=0x7f5c741554b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:38.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.219+0000 7f5c6bfff640 1 --2- 172.21.15.98:0/3949585035 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c7406cb70 0x7f5c741554b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:38.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.219+0000 7f5c6bfff640 1 -- 172.21.15.98:0/3949585035 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c741f8c00 con 0x7f5c74152e70 2024-09-16T15:38:38.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.219+0000 7f5c73fff640 1 --2- 172.21.15.98:0/3949585035 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5c741f7ca0 0x7f5c741f80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T15:38:38.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.219+0000 7f5c6bfff640 1 --2- 172.21.15.98:0/3949585035 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5c74152e70 0x7f5c7415ae80 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c00c410 tx=0x7f5c5c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:38.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.219+0000 7f5c70ff9640 1 -- 172.21.15.98:0/3949585035 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c5c017070 con 0x7f5c74152e70 2024-09-16T15:38:38.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.219+0000 7f5c70ff9640 1 -- 172.21.15.98:0/3949585035 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5c5c0035f0 con 0x7f5c74152e70 2024-09-16T15:38:38.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.219+0000 7f5c79f94640 1 -- 172.21.15.98:0/3949585035 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c741f8920 con 0x7f5c74152e70 2024-09-16T15:38:38.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.219+0000 7f5c70ff9640 1 -- 172.21.15.98:0/3949585035 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c5c003a80 con 0x7f5c74152e70 2024-09-16T15:38:38.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.219+0000 7f5c79f94640 1 -- 172.21.15.98:0/3949585035 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c74154cb0 con 0x7f5c74152e70 2024-09-16T15:38:38.223 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.220+0000 7f5c79f94640 1 -- 172.21.15.98:0/3949585035 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c7406cfc0 con 0x7f5c74152e70 2024-09-16T15:38:38.223 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.220+0000 7f5c70ff9640 1 -- 172.21.15.98:0/3949585035 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7f5c5c01a070 con 0x7f5c74152e70 2024-09-16T15:38:38.223 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.221+0000 7f5c70ff9640 1 --2- 172.21.15.98:0/3949585035 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f5c54078850 0x7f5c5407ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:38.223 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.221+0000 7f5c70ff9640 1 -- 172.21.15.98:0/3949585035 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f5c5c099bd0 con 0x7f5c74152e70 2024-09-16T15:38:38.223 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.221+0000 7f5c737fe640 1 --2- 172.21.15.98:0/3949585035 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f5c54078850 0x7f5c5407ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:38.223 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.222+0000 7f5c737fe640 1 --2- 172.21.15.98:0/3949585035 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f5c54078850 0x7f5c5407ad10 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5c640098e0 tx=0x7f5c64009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:38.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.225+0000 7f5c70ff9640 1 -- 172.21.15.98:0/3949585035 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7f5c5c0010c0 con 0x7f5c74152e70 2024-09-16T15:38:38.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.427+0000 7f5c79f94640 1 -- 172.21.15.98:0/3949585035 --> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvol59680", "group_name": "subvol_grp460", "target": ["mon-mgr", ""]}) -- 0x7f5c741f8630 con 0x7f5c54078850 2024-09-16T15:38:38.455 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.454+0000 7f5c70ff9640 1 -- 172.21.15.98:0/3949585035 <== mgr.4100 v2:172.21.15.135:6800/699234772 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f5c741f8630 con 0x7f5c54078850 2024-09-16T15:38:38.458 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.456+0000 7f5c79f94640 1 -- 172.21.15.98:0/3949585035 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f5c54078850 msgr2=0x7f5c5407ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:38.458 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.456+0000 7f5c79f94640 1 --2- 172.21.15.98:0/3949585035 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f5c54078850 0x7f5c5407ad10 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5c640098e0 tx=0x7f5c64009060 comp rx=0 tx=0).stop 2024-09-16T15:38:38.458 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.456+0000 7f5c79f94640 1 -- 172.21.15.98:0/3949585035 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5c74152e70 msgr2=0x7f5c7415ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:38.458 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.456+0000 7f5c79f94640 1 --2- 172.21.15.98:0/3949585035 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5c74152e70 0x7f5c7415ae80 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c00c410 tx=0x7f5c5c00c8d0 comp rx=0 tx=0).stop 2024-09-16T15:38:38.458 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.456+0000 7f5c79f94640 1 -- 172.21.15.98:0/3949585035 shutdown_connections 2024-09-16T15:38:38.458 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.456+0000 7f5c79f94640 1 --2- 172.21.15.98:0/3949585035 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f5c741f7ca0 0x7f5c741f80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:38.458 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.456+0000 7f5c79f94640 1 --2- 172.21.15.98:0/3949585035 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5c74152e70 0x7f5c7415ae80 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:38.458 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.456+0000 7f5c79f94640 1 --2- 172.21.15.98:0/3949585035 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f5c54078850 0x7f5c5407ad10 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:38.459 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.456+0000 7f5c79f94640 1 --2- 172.21.15.98:0/3949585035 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c7406cb70 0x7f5c741554b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:38.459 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.456+0000 7f5c79f94640 1 -- 172.21.15.98:0/3949585035 >> 172.21.15.98:0/3949585035 conn(0x7f5c7406dc80 msgr2=0x7f5c7414f330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:38.459 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.457+0000 7f5c79f94640 1 -- 172.21.15.98:0/3949585035 shutdown_connections 2024-09-16T15:38:38.459 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.457+0000 7f5c79f94640 1 -- 172.21.15.98:0/3949585035 wait complete. 2024-09-16T15:38:38.468 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvol93321 --group_name subvol_grp460 2024-09-16T15:38:38.575 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.573+0000 7f2e00994640 1 -- 172.21.15.98:0/2725194973 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2dfc070790 msgr2=0x7f2dfc06f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:38.575 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.573+0000 7f2e00994640 1 --2- 172.21.15.98:0/2725194973 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2dfc070790 0x7f2dfc06f090 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f2df4005fd0 tx=0x7f2df402a8b0 comp rx=0 tx=0).stop 2024-09-16T15:38:38.575 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.574+0000 7f2e00994640 1 -- 172.21.15.98:0/2725194973 shutdown_connections 2024-09-16T15:38:38.575 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.574+0000 7f2e00994640 1 --2- 172.21.15.98:0/2725194973 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2dfc070790 0x7f2dfc06f090 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:38.575 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.574+0000 7f2e00994640 1 --2- 172.21.15.98:0/2725194973 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2dfc0703b0 0x7f2dfc0d03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:38.575 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.574+0000 7f2e00994640 1 -- 172.21.15.98:0/2725194973 >> 172.21.15.98:0/2725194973 conn(0x7f2dfc06cb70 msgr2=0x7f2dfc06cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:38.575 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.574+0000 7f2e00994640 1 -- 172.21.15.98:0/2725194973 shutdown_connections 2024-09-16T15:38:38.575 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.574+0000 7f2e00994640 1 -- 172.21.15.98:0/2725194973 wait complete. 2024-09-16T15:38:38.576 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.575+0000 7f2e00994640 1 Processor -- start 2024-09-16T15:38:38.576 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.575+0000 7f2e00994640 1 -- start start 2024-09-16T15:38:38.578 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.576+0000 7f2e00994640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2dfc0703b0 0x7f2dfc158b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:38.578 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.576+0000 7f2e00994640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2dfc070790 0x7f2dfc14eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:38.578 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.576+0000 7f2e00994640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2dfc160300 0x7f2dfc14f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:38.578 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.576+0000 7f2e00994640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2dfc06f750 con 0x7f2dfc070790 2024-09-16T15:38:38.578 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.576+0000 7f2e00994640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2dfc06f5d0 con 0x7f2dfc0703b0 2024-09-16T15:38:38.579 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.576+0000 7f2e00994640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f2dfc06f8d0 con 0x7f2dfc160300 2024-09-16T15:38:38.579 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.576+0000 7f2df9d9b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2dfc070790 0x7f2dfc14eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:38.579 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.576+0000 7f2df9d9b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2dfc070790 0x7f2dfc14eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42410/0 (socket says 172.21.15.98:42410) 2024-09-16T15:38:38.579 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.576+0000 7f2df9d9b640 1 -- 172.21.15.98:0/705904987 learned_addr learned my addr 172.21.15.98:0/705904987 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:38.579 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.576+0000 7f2dfad9d640 1 --2- 172.21.15.98:0/705904987 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2dfc160300 0x7f2dfc14f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:38.579 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.576+0000 7f2dfa59c640 1 --2- 172.21.15.98:0/705904987 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2dfc0703b0 0x7f2dfc158b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:38.579 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.576+0000 7f2df9d9b640 1 -- 172.21.15.98:0/705904987 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2dfc160300 msgr2=0x7f2dfc14f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:38.579 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.576+0000 7f2df9d9b640 1 --2- 172.21.15.98:0/705904987 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2dfc160300 0x7f2dfc14f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:38.579 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.576+0000 7f2df9d9b640 1 -- 172.21.15.98:0/705904987 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2dfc0703b0 msgr2=0x7f2dfc158b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:38.579 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.576+0000 7f2df9d9b640 1 --2- 172.21.15.98:0/705904987 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2dfc0703b0 0x7f2dfc158b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:38.579 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.576+0000 7f2df9d9b640 1 -- 172.21.15.98:0/705904987 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dfc15a170 con 0x7f2dfc070790 2024-09-16T15:38:38.579 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.576+0000 7f2df9d9b640 1 --2- 172.21.15.98:0/705904987 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2dfc070790 0x7f2dfc14eb50 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f2df000c390 tx=0x7f2df000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:38.579 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.576+0000 7f2deaffd640 1 -- 172.21.15.98:0/705904987 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2df0017070 con 0x7f2dfc070790 2024-09-16T15:38:38.580 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.576+0000 7f2deaffd640 1 -- 172.21.15.98:0/705904987 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2df00035f0 con 0x7f2dfc070790 2024-09-16T15:38:38.580 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.576+0000 7f2deaffd640 1 -- 172.21.15.98:0/705904987 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2df0003a20 con 0x7f2dfc070790 2024-09-16T15:38:38.580 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.576+0000 7f2e00994640 1 -- 172.21.15.98:0/705904987 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2dfc15a450 con 0x7f2dfc070790 2024-09-16T15:38:38.580 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.577+0000 7f2e00994640 1 -- 172.21.15.98:0/705904987 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2dfc15aa10 con 0x7f2dfc070790 2024-09-16T15:38:38.581 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.578+0000 7f2e00994640 1 -- 172.21.15.98:0/705904987 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2dfc15ac10 con 0x7f2dfc070790 2024-09-16T15:38:38.581 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.578+0000 7f2deaffd640 1 -- 172.21.15.98:0/705904987 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7f2df001a070 con 0x7f2dfc070790 2024-09-16T15:38:38.581 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.579+0000 7f2deaffd640 1 --2- 172.21.15.98:0/705904987 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f2ddc078850 0x7f2ddc07ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:38.581 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.579+0000 7f2deaffd640 1 -- 172.21.15.98:0/705904987 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f2df0099c00 con 0x7f2dfc070790 2024-09-16T15:38:38.581 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.579+0000 7f2dfa59c640 1 --2- 172.21.15.98:0/705904987 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f2ddc078850 0x7f2ddc07ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:38.581 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.579+0000 7f2dfa59c640 1 --2- 172.21.15.98:0/705904987 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f2ddc078850 0x7f2ddc07ad10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2dec005fd0 tx=0x7f2dec005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:38.584 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.583+0000 7f2deaffd640 1 -- 172.21.15.98:0/705904987 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7f2dfc15ac10 con 0x7f2dfc070790 2024-09-16T15:38:38.784 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.782+0000 7f2e00994640 1 -- 172.21.15.98:0/705904987 --> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvol93321", "group_name": "subvol_grp460", "target": ["mon-mgr", ""]}) -- 0x7f2dfc154c30 con 0x7f2ddc078850 2024-09-16T15:38:38.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.807+0000 7f2deaffd640 1 -- 172.21.15.98:0/705904987 <== mgr.4100 v2:172.21.15.135:6800/699234772 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f2dfc154c30 con 0x7f2ddc078850 2024-09-16T15:38:38.811 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.810+0000 7f2e00994640 1 -- 172.21.15.98:0/705904987 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f2ddc078850 msgr2=0x7f2ddc07ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:38.811 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.810+0000 7f2e00994640 1 --2- 172.21.15.98:0/705904987 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f2ddc078850 0x7f2ddc07ad10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2dec005fd0 tx=0x7f2dec005850 comp rx=0 tx=0).stop 2024-09-16T15:38:38.812 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.810+0000 7f2e00994640 1 -- 172.21.15.98:0/705904987 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2dfc070790 msgr2=0x7f2dfc14eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:38.812 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.810+0000 7f2e00994640 1 --2- 172.21.15.98:0/705904987 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2dfc070790 0x7f2dfc14eb50 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f2df000c390 tx=0x7f2df000c850 comp rx=0 tx=0).stop 2024-09-16T15:38:38.812 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.810+0000 7f2e00994640 1 -- 172.21.15.98:0/705904987 shutdown_connections 2024-09-16T15:38:38.812 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.810+0000 7f2e00994640 1 --2- 172.21.15.98:0/705904987 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f2dfc160300 0x7f2dfc14f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:38.812 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.810+0000 7f2e00994640 1 --2- 172.21.15.98:0/705904987 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2dfc070790 0x7f2dfc14eb50 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:38.812 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.810+0000 7f2e00994640 1 --2- 172.21.15.98:0/705904987 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f2ddc078850 0x7f2ddc07ad10 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:38.812 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.810+0000 7f2e00994640 1 --2- 172.21.15.98:0/705904987 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2dfc0703b0 0x7f2dfc158b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:38.812 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.810+0000 7f2e00994640 1 -- 172.21.15.98:0/705904987 >> 172.21.15.98:0/705904987 conn(0x7f2dfc06cb70 msgr2=0x7f2dfc153ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:38.812 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.810+0000 7f2e00994640 1 -- 172.21.15.98:0/705904987 shutdown_connections 2024-09-16T15:38:38.812 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.810+0000 7f2e00994640 1 -- 172.21.15.98:0/705904987 wait complete. 2024-09-16T15:38:38.822 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvol46192 --group_name subvol_grp460 2024-09-16T15:38:38.928 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.926+0000 7ff780bad640 1 -- 172.21.15.98:0/276015684 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff77c0cc0f0 msgr2=0x7ff77c0cebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:38.928 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.926+0000 7ff780bad640 1 --2- 172.21.15.98:0/276015684 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff77c0cc0f0 0x7ff77c0cebe0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ff764009830 tx=0x7ff76402a480 comp rx=0 tx=0).stop 2024-09-16T15:38:38.928 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.926+0000 7ff780bad640 1 -- 172.21.15.98:0/276015684 shutdown_connections 2024-09-16T15:38:38.928 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.926+0000 7ff780bad640 1 --2- 172.21.15.98:0/276015684 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff77c0cc0f0 0x7ff77c0cebe0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:38.928 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.926+0000 7ff780bad640 1 -- 172.21.15.98:0/276015684 >> 172.21.15.98:0/276015684 conn(0x7ff77c0b18e0 msgr2=0x7ff77c0b1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:38.928 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.926+0000 7ff780bad640 1 -- 172.21.15.98:0/276015684 shutdown_connections 2024-09-16T15:38:38.928 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.926+0000 7ff780bad640 1 -- 172.21.15.98:0/276015684 wait complete. 2024-09-16T15:38:38.930 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.928+0000 7ff780bad640 1 Processor -- start 2024-09-16T15:38:38.930 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.928+0000 7ff780bad640 1 -- start start 2024-09-16T15:38:38.931 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.928+0000 7ff780bad640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff77c070380 0x7ff77c0ad900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:38.931 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.928+0000 7ff780bad640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff77c0cc0f0 0x7ff77c152810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:38.931 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.928+0000 7ff780bad640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff77c15e2f0 0x7ff77c0ae3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:38.931 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.928+0000 7ff780bad640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff77c0cf120 con 0x7ff77c070380 2024-09-16T15:38:38.931 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.928+0000 7ff780bad640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff77c0cced0 con 0x7ff77c0cc0f0 2024-09-16T15:38:38.931 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.928+0000 7ff780bad640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff77c0cf2a0 con 0x7ff77c15e2f0 2024-09-16T15:38:38.931 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.929+0000 7ff77a59c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff77c070380 0x7ff77c0ad900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:38.931 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.929+0000 7ff77a59c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff77c070380 0x7ff77c0ad900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42426/0 (socket says 172.21.15.98:42426) 2024-09-16T15:38:38.931 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.929+0000 7ff77a59c640 1 -- 172.21.15.98:0/180597276 learned_addr learned my addr 172.21.15.98:0/180597276 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:38.931 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.929+0000 7ff77a59c640 1 -- 172.21.15.98:0/180597276 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff77c15e2f0 msgr2=0x7ff77c0ae3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:38.931 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.929+0000 7ff77a59c640 1 --2- 172.21.15.98:0/180597276 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff77c15e2f0 0x7ff77c0ae3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:38.932 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.929+0000 7ff77a59c640 1 -- 172.21.15.98:0/180597276 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff77c0cc0f0 msgr2=0x7ff77c152810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:38.932 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.929+0000 7ff77a59c640 1 --2- 172.21.15.98:0/180597276 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff77c0cc0f0 0x7ff77c152810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:38.932 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.929+0000 7ff77a59c640 1 -- 172.21.15.98:0/180597276 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff77c0af000 con 0x7ff77c070380 2024-09-16T15:38:38.932 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.929+0000 7ff77a59c640 1 --2- 172.21.15.98:0/180597276 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff77c070380 0x7ff77c0ad900 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ff76c00c3f0 tx=0x7ff76c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:38.932 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.929+0000 7ff772ffd640 1 -- 172.21.15.98:0/180597276 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff76c015020 con 0x7ff77c070380 2024-09-16T15:38:38.932 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.929+0000 7ff772ffd640 1 -- 172.21.15.98:0/180597276 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff76c0035f0 con 0x7ff77c070380 2024-09-16T15:38:38.932 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.929+0000 7ff780bad640 1 -- 172.21.15.98:0/180597276 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff77c0ace60 con 0x7ff77c070380 2024-09-16T15:38:38.932 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.929+0000 7ff772ffd640 1 -- 172.21.15.98:0/180597276 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff76c003a40 con 0x7ff77c070380 2024-09-16T15:38:38.932 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.929+0000 7ff780bad640 1 -- 172.21.15.98:0/180597276 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff77c0aed20 con 0x7ff77c070380 2024-09-16T15:38:38.933 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.930+0000 7ff780bad640 1 -- 172.21.15.98:0/180597276 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff77c069360 con 0x7ff77c070380 2024-09-16T15:38:38.933 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.931+0000 7ff772ffd640 1 -- 172.21.15.98:0/180597276 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 101287+0+0 (secure 0 0 0) 0x7ff76c018020 con 0x7ff77c070380 2024-09-16T15:38:38.934 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.931+0000 7ff772ffd640 1 --2- 172.21.15.98:0/180597276 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7ff75c078850 0x7ff75c07ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:38.934 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.932+0000 7ff772ffd640 1 -- 172.21.15.98:0/180597276 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7ff76c09c240 con 0x7ff77c070380 2024-09-16T15:38:38.934 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.932+0000 7ff773fff640 1 --2- 172.21.15.98:0/180597276 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7ff75c078850 0x7ff75c07ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:38.934 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.932+0000 7ff773fff640 1 --2- 172.21.15.98:0/180597276 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7ff75c078850 0x7ff75c07ad10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff764034000 tx=0x7ff7640046c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:38.937 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:38.936+0000 7ff772ffd640 1 -- 172.21.15.98:0/180597276 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7ff76c01f030 con 0x7ff77c070380 2024-09-16T15:38:39.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.132+0000 7ff772ffd640 1 -- 172.21.15.98:0/180597276 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mgrmap(e 6) ==== 101338+0+0 (secure 0 0 0) 0x7ff76c0604b0 con 0x7ff77c070380 2024-09-16T15:38:39.143 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.143+0000 7ff780bad640 1 -- 172.21.15.98:0/180597276 --> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvol46192", "group_name": "subvol_grp460", "target": ["mon-mgr", ""]}) -- 0x7ff77c0cd730 con 0x7ff75c078850 2024-09-16T15:38:39.167 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.167+0000 7ff772ffd640 1 -- 172.21.15.98:0/180597276 <== mgr.4100 v2:172.21.15.135:6800/699234772 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7ff7640041c0 con 0x7ff75c078850 2024-09-16T15:38:39.170 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.169+0000 7ff780bad640 1 -- 172.21.15.98:0/180597276 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7ff75c078850 msgr2=0x7ff75c07ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:39.170 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.169+0000 7ff780bad640 1 --2- 172.21.15.98:0/180597276 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7ff75c078850 0x7ff75c07ad10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff764034000 tx=0x7ff7640046c0 comp rx=0 tx=0).stop 2024-09-16T15:38:39.170 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.169+0000 7ff780bad640 1 -- 172.21.15.98:0/180597276 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff77c070380 msgr2=0x7ff77c0ad900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:39.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.169+0000 7ff780bad640 1 --2- 172.21.15.98:0/180597276 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff77c070380 0x7ff77c0ad900 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ff76c00c3f0 tx=0x7ff76c00c8b0 comp rx=0 tx=0).stop 2024-09-16T15:38:39.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.169+0000 7ff780bad640 1 -- 172.21.15.98:0/180597276 shutdown_connections 2024-09-16T15:38:39.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.169+0000 7ff780bad640 1 --2- 172.21.15.98:0/180597276 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff77c15e2f0 0x7ff77c0ae3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:39.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.169+0000 7ff780bad640 1 --2- 172.21.15.98:0/180597276 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7ff75c078850 0x7ff75c07ad10 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:39.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.169+0000 7ff780bad640 1 --2- 172.21.15.98:0/180597276 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff77c0cc0f0 0x7ff77c152810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:39.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.169+0000 7ff780bad640 1 --2- 172.21.15.98:0/180597276 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff77c070380 0x7ff77c0ad900 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:39.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.169+0000 7ff780bad640 1 -- 172.21.15.98:0/180597276 >> 172.21.15.98:0/180597276 conn(0x7ff77c0b18e0 msgr2=0x7ff77c0727c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:39.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.169+0000 7ff780bad640 1 -- 172.21.15.98:0/180597276 shutdown_connections 2024-09-16T15:38:39.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.169+0000 7ff780bad640 1 -- 172.21.15.98:0/180597276 wait complete. 2024-09-16T15:38:39.181 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol59680 subvol_grp460 2024-09-16T15:38:39.285 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.284+0000 7ff403c23640 1 -- 172.21.15.98:0/584145907 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3e8004d40 msgr2=0x7ff3e80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:39.286 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.284+0000 7ff403c23640 1 --2- 172.21.15.98:0/584145907 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3e8004d40 0x7ff3e80051c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7ff3f400c610 tx=0x7ff3e8005830 comp rx=0 tx=0).stop 2024-09-16T15:38:39.286 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.284+0000 7ff4021c0640 1 -- 172.21.15.98:0/584145907 reap_dead start 2024-09-16T15:38:39.286 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.284+0000 7ff403c23640 1 -- 172.21.15.98:0/584145907 shutdown_connections 2024-09-16T15:38:39.286 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.284+0000 7ff403c23640 1 -- 172.21.15.98:0/584145907 >> 172.21.15.98:0/584145907 conn(0x7ff3fc0b18e0 msgr2=0x7ff3fc0b1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:39.286 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.284+0000 7ff403c23640 1 -- 172.21.15.98:0/584145907 shutdown_connections 2024-09-16T15:38:39.286 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.284+0000 7ff403c23640 1 -- 172.21.15.98:0/584145907 wait complete. 2024-09-16T15:38:39.289 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.285+0000 7ff403c23640 1 Processor -- start 2024-09-16T15:38:39.289 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.285+0000 7ff403c23640 1 -- start start 2024-09-16T15:38:39.289 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.286+0000 7ff403c23640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3e8004d40 0x7ff3fc155720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:39.289 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.286+0000 7ff403c23640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3fc0d01c0 0x7ff3fc14d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:39.289 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.286+0000 7ff403c23640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff3fc0d0620 0x7ff3fc14d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:39.289 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.286+0000 7ff403c23640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff3fc0cd3d0 con 0x7ff3fc0d01c0 2024-09-16T15:38:39.289 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.286+0000 7ff403c23640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff3fc0ccbd0 con 0x7ff3e8004d40 2024-09-16T15:38:39.289 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.286+0000 7ff403c23640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff3fc0cd550 con 0x7ff3fc0d0620 2024-09-16T15:38:39.289 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.286+0000 7ff4011be640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3fc0d01c0 0x7ff3fc14d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:39.289 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.286+0000 7ff4011be640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3fc0d01c0 0x7ff3fc14d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42442/0 (socket says 172.21.15.98:42442) 2024-09-16T15:38:39.289 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.286+0000 7ff4011be640 1 -- 172.21.15.98:0/3723764530 learned_addr learned my addr 172.21.15.98:0/3723764530 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:39.290 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.286+0000 7ff4021c0640 1 --2- 172.21.15.98:0/3723764530 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff3fc0d0620 0x7ff3fc14d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:39.290 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.286+0000 7ff4019bf640 1 --2- 172.21.15.98:0/3723764530 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3e8004d40 0x7ff3fc155720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:39.290 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.287+0000 7ff4011be640 1 -- 172.21.15.98:0/3723764530 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff3fc0d0620 msgr2=0x7ff3fc14d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:39.290 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.287+0000 7ff4011be640 1 --2- 172.21.15.98:0/3723764530 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff3fc0d0620 0x7ff3fc14d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:39.290 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.287+0000 7ff4011be640 1 -- 172.21.15.98:0/3723764530 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3e8004d40 msgr2=0x7ff3fc155720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:39.290 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.287+0000 7ff4011be640 1 --2- 172.21.15.98:0/3723764530 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3e8004d40 0x7ff3fc155720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:39.290 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.287+0000 7ff4011be640 1 -- 172.21.15.98:0/3723764530 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3fc1534d0 con 0x7ff3fc0d01c0 2024-09-16T15:38:39.290 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.287+0000 7ff4019bf640 1 --2- 172.21.15.98:0/3723764530 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3e8004d40 0x7ff3fc155720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T15:38:39.290 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.287+0000 7ff4011be640 1 --2- 172.21.15.98:0/3723764530 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3fc0d01c0 0x7ff3fc14d190 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec011ae0 tx=0x7ff3ec009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:39.290 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.287+0000 7ff3f27fc640 1 -- 172.21.15.98:0/3723764530 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3ec01e070 con 0x7ff3fc0d01c0 2024-09-16T15:38:39.290 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.287+0000 7ff3f27fc640 1 -- 172.21.15.98:0/3723764530 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff3ec00fc70 con 0x7ff3fc0d01c0 2024-09-16T15:38:39.290 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.287+0000 7ff403c23640 1 -- 172.21.15.98:0/3723764530 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3fc1537b0 con 0x7ff3fc0d01c0 2024-09-16T15:38:39.291 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.287+0000 7ff3f27fc640 1 -- 172.21.15.98:0/3723764530 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3ec019410 con 0x7ff3fc0d01c0 2024-09-16T15:38:39.291 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.287+0000 7ff403c23640 1 -- 172.21.15.98:0/3723764530 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3fc153d70 con 0x7ff3fc0d01c0 2024-09-16T15:38:39.291 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.288+0000 7ff403c23640 1 -- 172.21.15.98:0/3723764530 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3fc15fd80 con 0x7ff3fc0d01c0 2024-09-16T15:38:39.292 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.289+0000 7ff3f27fc640 1 -- 172.21.15.98:0/3723764530 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 6) ==== 101338+0+0 (secure 0 0 0) 0x7ff3ec021070 con 0x7ff3fc0d01c0 2024-09-16T15:38:39.292 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.289+0000 7ff3f27fc640 1 --2- 172.21.15.98:0/3723764530 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7ff3e00788e0 0x7ff3e007ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:39.292 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.289+0000 7ff3f27fc640 1 -- 172.21.15.98:0/3723764530 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7ff3ec09b380 con 0x7ff3fc0d01c0 2024-09-16T15:38:39.292 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.289+0000 7ff4019bf640 1 --2- 172.21.15.98:0/3723764530 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7ff3e00788e0 0x7ff3e007ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:39.292 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.290+0000 7ff4019bf640 1 --2- 172.21.15.98:0/3723764530 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7ff3e00788e0 0x7ff3e007ada0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff3f8009c50 tx=0x7ff3f8005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:39.294 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.294+0000 7ff3f27fc640 1 -- 172.21.15.98:0/3723764530 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7ff3ec063210 con 0x7ff3fc0d01c0 2024-09-16T15:38:39.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.493+0000 7ff403c23640 1 -- 172.21.15.98:0/3723764530 --> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol59680", "group_name": "subvol_grp460", "target": ["mon-mgr", ""]}) -- 0x7ff3fc0709f0 con 0x7ff3e00788e0 2024-09-16T15:38:39.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.506+0000 7ff3f27fc640 1 -- 172.21.15.98:0/3723764530 <== mgr.4100 v2:172.21.15.135:6800/699234772 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7ff3fc0709f0 con 0x7ff3e00788e0 2024-09-16T15:38:39.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.508+0000 7ff403c23640 1 -- 172.21.15.98:0/3723764530 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7ff3e00788e0 msgr2=0x7ff3e007ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:39.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.508+0000 7ff403c23640 1 --2- 172.21.15.98:0/3723764530 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7ff3e00788e0 0x7ff3e007ada0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff3f8009c50 tx=0x7ff3f8005f90 comp rx=0 tx=0).stop 2024-09-16T15:38:39.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.508+0000 7ff403c23640 1 -- 172.21.15.98:0/3723764530 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3fc0d01c0 msgr2=0x7ff3fc14d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:39.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.508+0000 7ff403c23640 1 --2- 172.21.15.98:0/3723764530 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3fc0d01c0 0x7ff3fc14d190 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec011ae0 tx=0x7ff3ec009ed0 comp rx=0 tx=0).stop 2024-09-16T15:38:39.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.508+0000 7ff403c23640 1 -- 172.21.15.98:0/3723764530 shutdown_connections 2024-09-16T15:38:39.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.508+0000 7ff403c23640 1 --2- 172.21.15.98:0/3723764530 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff3fc0d0620 0x7ff3fc14d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:39.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.508+0000 7ff403c23640 1 --2- 172.21.15.98:0/3723764530 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3fc0d01c0 0x7ff3fc14d190 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:39.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.508+0000 7ff403c23640 1 --2- 172.21.15.98:0/3723764530 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7ff3e00788e0 0x7ff3e007ada0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:39.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.508+0000 7ff403c23640 1 --2- 172.21.15.98:0/3723764530 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff3e8004d40 0x7ff3fc155720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:39.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.508+0000 7ff403c23640 1 -- 172.21.15.98:0/3723764530 >> 172.21.15.98:0/3723764530 conn(0x7ff3fc0b18e0 msgr2=0x7ff3fc15eaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:39.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.509+0000 7ff403c23640 1 -- 172.21.15.98:0/3723764530 shutdown_connections 2024-09-16T15:38:39.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.509+0000 7ff403c23640 1 -- 172.21.15.98:0/3723764530 wait complete. 2024-09-16T15:38:39.511 INFO:tasks.ceph.mgr.x.smithi135.stderr:2024-09-16T15:38:39.509+0000 7fae6bd59640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T15:38:39.511 INFO:tasks.ceph.mgr.x.smithi135.stderr:2024-09-16T15:38:39.509+0000 7fae6bd59640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T15:38:39.511 INFO:tasks.ceph.mgr.x.smithi135.stderr:2024-09-16T15:38:39.509+0000 7fae6bd59640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T15:38:39.511 INFO:tasks.ceph.mgr.x.smithi135.stderr:2024-09-16T15:38:39.509+0000 7fae6bd59640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T15:38:39.511 INFO:tasks.ceph.mgr.x.smithi135.stderr:2024-09-16T15:38:39.509+0000 7fae6bd59640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T15:38:39.522 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol93321 subvol_grp460 2024-09-16T15:38:39.526 INFO:tasks.ceph.mgr.x.smithi135.stderr:2024-09-16T15:38:39.525+0000 7fae6ad57640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T15:38:39.526 INFO:tasks.ceph.mgr.x.smithi135.stderr:2024-09-16T15:38:39.525+0000 7fae6ad57640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T15:38:39.526 INFO:tasks.ceph.mgr.x.smithi135.stderr:2024-09-16T15:38:39.525+0000 7fae6ad57640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T15:38:39.526 INFO:tasks.ceph.mgr.x.smithi135.stderr:2024-09-16T15:38:39.525+0000 7fae6ad57640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T15:38:39.526 INFO:tasks.ceph.mgr.x.smithi135.stderr:2024-09-16T15:38:39.525+0000 7fae6ad57640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T15:38:39.627 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.625+0000 7fccffbda640 1 -- 172.21.15.98:0/2296308135 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcce40051c0 msgr2=0x7fcce400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:39.628 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.625+0000 7fccffbda640 1 --2- 172.21.15.98:0/2296308135 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcce40051c0 0x7fcce400b9c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fccf0009ed0 tx=0x7fcce4005830 comp rx=0 tx=0).stop 2024-09-16T15:38:39.628 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.625+0000 7fccffbda640 1 -- 172.21.15.98:0/2296308135 shutdown_connections 2024-09-16T15:38:39.628 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.625+0000 7fccffbda640 1 --2- 172.21.15.98:0/2296308135 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcce40051c0 0x7fcce400b9c0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:39.628 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.625+0000 7fccffbda640 1 -- 172.21.15.98:0/2296308135 >> 172.21.15.98:0/2296308135 conn(0x7fccf80d1e30 msgr2=0x7fccf80d2240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:39.628 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.625+0000 7fccffbda640 1 -- 172.21.15.98:0/2296308135 shutdown_connections 2024-09-16T15:38:39.628 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.625+0000 7fccffbda640 1 -- 172.21.15.98:0/2296308135 wait complete. 2024-09-16T15:38:39.629 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.627+0000 7fccffbda640 1 Processor -- start 2024-09-16T15:38:39.629 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.627+0000 7fccffbda640 1 -- start start 2024-09-16T15:38:39.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.627+0000 7fccffbda640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcce40051c0 0x7fccf80aea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:39.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.627+0000 7fccffbda640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fccf8153680 0x7fccf81503b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:39.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.627+0000 7fccffbda640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fccf80af8e0 0x7fccf80afd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:39.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.627+0000 7fccffbda640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fccf80b3240 con 0x7fccf8153680 2024-09-16T15:38:39.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.627+0000 7fccffbda640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fccf80b30c0 con 0x7fcce40051c0 2024-09-16T15:38:39.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.627+0000 7fccffbda640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fccf80d0080 con 0x7fccf80af8e0 2024-09-16T15:38:39.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.627+0000 7fccfd175640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fccf8153680 0x7fccf81503b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:39.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.627+0000 7fccfd175640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fccf8153680 0x7fccf81503b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42456/0 (socket says 172.21.15.98:42456) 2024-09-16T15:38:39.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.627+0000 7fccfd175640 1 -- 172.21.15.98:0/3542698696 learned_addr learned my addr 172.21.15.98:0/3542698696 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:39.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.627+0000 7fccfd976640 1 --2- 172.21.15.98:0/3542698696 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcce40051c0 0x7fccf80aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:39.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.628+0000 7fccfe177640 1 --2- 172.21.15.98:0/3542698696 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fccf80af8e0 0x7fccf80afd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:39.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.628+0000 7fccfd175640 1 -- 172.21.15.98:0/3542698696 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fccf80af8e0 msgr2=0x7fccf80afd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:39.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.628+0000 7fccfd175640 1 --2- 172.21.15.98:0/3542698696 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fccf80af8e0 0x7fccf80afd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:39.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.628+0000 7fccfd175640 1 -- 172.21.15.98:0/3542698696 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcce40051c0 msgr2=0x7fccf80aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:39.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.628+0000 7fccfd175640 1 --2- 172.21.15.98:0/3542698696 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcce40051c0 0x7fccf80aea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:39.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.628+0000 7fccfd175640 1 -- 172.21.15.98:0/3542698696 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccf815c930 con 0x7fccf8153680 2024-09-16T15:38:39.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.628+0000 7fccfd175640 1 --2- 172.21.15.98:0/3542698696 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fccf8153680 0x7fccf81503b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fcce800e5a0 tx=0x7fcce800ea60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:39.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.628+0000 7fccee7fc640 1 -- 172.21.15.98:0/3542698696 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce8015070 con 0x7fccf8153680 2024-09-16T15:38:39.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.628+0000 7fccee7fc640 1 -- 172.21.15.98:0/3542698696 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcce8010980 con 0x7fccf8153680 2024-09-16T15:38:39.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.628+0000 7fccffbda640 1 -- 172.21.15.98:0/3542698696 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccf80af0a0 con 0x7fccf8153680 2024-09-16T15:38:39.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.628+0000 7fccee7fc640 1 -- 172.21.15.98:0/3542698696 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce8010dd0 con 0x7fccf8153680 2024-09-16T15:38:39.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.628+0000 7fccffbda640 1 -- 172.21.15.98:0/3542698696 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccf8151a10 con 0x7fccf8153680 2024-09-16T15:38:39.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.629+0000 7fccffbda640 1 -- 172.21.15.98:0/3542698696 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccf80d05e0 con 0x7fccf8153680 2024-09-16T15:38:39.633 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.630+0000 7fccee7fc640 1 -- 172.21.15.98:0/3542698696 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 6) ==== 101338+0+0 (secure 0 0 0) 0x7fcce8018070 con 0x7fccf8153680 2024-09-16T15:38:39.633 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.630+0000 7fccee7fc640 1 --2- 172.21.15.98:0/3542698696 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fccdc0788e0 0x7fccdc07ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:39.633 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.630+0000 7fccee7fc640 1 -- 172.21.15.98:0/3542698696 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fcce809aba0 con 0x7fccf8153680 2024-09-16T15:38:39.633 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.630+0000 7fccfd976640 1 --2- 172.21.15.98:0/3542698696 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fccdc0788e0 0x7fccdc07ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:39.633 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.631+0000 7fccfd976640 1 --2- 172.21.15.98:0/3542698696 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fccdc0788e0 0x7fccdc07ada0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fccf4006650 tx=0x7fccf4006310 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:39.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.634+0000 7fccee7fc640 1 -- 172.21.15.98:0/3542698696 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7fcce8062b50 con 0x7fccf8153680 2024-09-16T15:38:39.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.834+0000 7fccffbda640 1 -- 172.21.15.98:0/3542698696 --> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol93321", "group_name": "subvol_grp460", "target": ["mon-mgr", ""]}) -- 0x7fccf8070de0 con 0x7fccdc0788e0 2024-09-16T15:38:39.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.854+0000 7fccee7fc640 1 -- 172.21.15.98:0/3542698696 <== mgr.4100 v2:172.21.15.135:6800/699234772 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fccf8070de0 con 0x7fccdc0788e0 2024-09-16T15:38:39.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.856+0000 7fccffbda640 1 -- 172.21.15.98:0/3542698696 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fccdc0788e0 msgr2=0x7fccdc07ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:39.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.856+0000 7fccffbda640 1 --2- 172.21.15.98:0/3542698696 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fccdc0788e0 0x7fccdc07ada0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fccf4006650 tx=0x7fccf4006310 comp rx=0 tx=0).stop 2024-09-16T15:38:39.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.856+0000 7fccffbda640 1 -- 172.21.15.98:0/3542698696 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fccf8153680 msgr2=0x7fccf81503b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:39.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.856+0000 7fccffbda640 1 --2- 172.21.15.98:0/3542698696 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fccf8153680 0x7fccf81503b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fcce800e5a0 tx=0x7fcce800ea60 comp rx=0 tx=0).stop 2024-09-16T15:38:39.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.856+0000 7fccffbda640 1 -- 172.21.15.98:0/3542698696 shutdown_connections 2024-09-16T15:38:39.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.856+0000 7fccffbda640 1 --2- 172.21.15.98:0/3542698696 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fccf80af8e0 0x7fccf80afd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:39.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.856+0000 7fccffbda640 1 --2- 172.21.15.98:0/3542698696 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fccf8153680 0x7fccf81503b0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:39.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.856+0000 7fccffbda640 1 --2- 172.21.15.98:0/3542698696 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fccdc0788e0 0x7fccdc07ada0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:39.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.856+0000 7fccffbda640 1 --2- 172.21.15.98:0/3542698696 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcce40051c0 0x7fccf80aea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:39.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.856+0000 7fccffbda640 1 -- 172.21.15.98:0/3542698696 >> 172.21.15.98:0/3542698696 conn(0x7fccf80d1e30 msgr2=0x7fccf80cd550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:39.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.856+0000 7fccffbda640 1 -- 172.21.15.98:0/3542698696 shutdown_connections 2024-09-16T15:38:39.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.856+0000 7fccffbda640 1 -- 172.21.15.98:0/3542698696 wait complete. 2024-09-16T15:38:39.871 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol46192 subvol_grp460 2024-09-16T15:38:39.976 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.974+0000 7fcd2449b640 1 -- 172.21.15.98:0/693498251 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd1c0d0410 msgr2=0x7fcd1c0d2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:39.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.974+0000 7fcd2449b640 1 --2- 172.21.15.98:0/693498251 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd1c0d0410 0x7fcd1c0d2950 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fcd18009860 tx=0x7fcd1802a540 comp rx=0 tx=0).stop 2024-09-16T15:38:39.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.974+0000 7fcd2449b640 1 -- 172.21.15.98:0/693498251 shutdown_connections 2024-09-16T15:38:39.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.974+0000 7fcd2449b640 1 --2- 172.21.15.98:0/693498251 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcd1c0aea80 0x7fcd1c0aeef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:39.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.974+0000 7fcd2449b640 1 --2- 172.21.15.98:0/693498251 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd1c0d0410 0x7fcd1c0d2950 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:39.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.974+0000 7fcd2449b640 1 -- 172.21.15.98:0/693498251 >> 172.21.15.98:0/693498251 conn(0x7fcd1c0d1e30 msgr2=0x7fcd1c0d2240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:39.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.974+0000 7fcd2449b640 1 -- 172.21.15.98:0/693498251 shutdown_connections 2024-09-16T15:38:39.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.974+0000 7fcd2449b640 1 -- 172.21.15.98:0/693498251 wait complete. 2024-09-16T15:38:39.979 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.975+0000 7fcd2449b640 1 Processor -- start 2024-09-16T15:38:39.979 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.975+0000 7fcd2449b640 1 -- start start 2024-09-16T15:38:39.979 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.976+0000 7fcd2449b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcd1c0aea80 0x7fcd1c158ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:39.979 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.976+0000 7fcd2449b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd1c0b0ef0 0x7fcd1c0c7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:39.979 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.976+0000 7fcd2449b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd1c0d0410 0x7fcd1c06ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:39.979 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.976+0000 7fcd2449b640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fcd1c0af5b0 con 0x7fcd1c0d0410 2024-09-16T15:38:39.980 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.976+0000 7fcd2449b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fcd1c0af430 con 0x7fcd1c0b0ef0 2024-09-16T15:38:39.980 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.976+0000 7fcd2449b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fcd1c0af730 con 0x7fcd1c0aea80 2024-09-16T15:38:39.980 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.976+0000 7fcd22a38640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd1c0d0410 0x7fcd1c06ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:39.980 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.976+0000 7fcd22a38640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd1c0d0410 0x7fcd1c06ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42464/0 (socket says 172.21.15.98:42464) 2024-09-16T15:38:39.980 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.976+0000 7fcd22a38640 1 -- 172.21.15.98:0/1311082606 learned_addr learned my addr 172.21.15.98:0/1311082606 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:39.980 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.976+0000 7fcd21a36640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd1c0b0ef0 0x7fcd1c0c7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:39.980 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.976+0000 7fcd22237640 1 --2- 172.21.15.98:0/1311082606 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcd1c0aea80 0x7fcd1c158ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:39.980 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.977+0000 7fcd22a38640 1 -- 172.21.15.98:0/1311082606 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcd1c0aea80 msgr2=0x7fcd1c158ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:39.980 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.977+0000 7fcd22a38640 1 --2- 172.21.15.98:0/1311082606 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcd1c0aea80 0x7fcd1c158ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:39.980 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.977+0000 7fcd22a38640 1 -- 172.21.15.98:0/1311082606 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd1c0b0ef0 msgr2=0x7fcd1c0c7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:39.980 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.977+0000 7fcd22a38640 1 --2- 172.21.15.98:0/1311082606 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd1c0b0ef0 0x7fcd1c0c7be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:39.980 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.977+0000 7fcd22a38640 1 -- 172.21.15.98:0/1311082606 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd1c0b2890 con 0x7fcd1c0d0410 2024-09-16T15:38:39.980 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.977+0000 7fcd21a36640 1 --2- 172.21.15.98:0/1311082606 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd1c0b0ef0 0x7fcd1c0c7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T15:38:39.980 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.977+0000 7fcd22a38640 1 --2- 172.21.15.98:0/1311082606 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd1c0d0410 0x7fcd1c06ec90 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fcd1400eb10 tx=0x7fcd1400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:39.981 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.977+0000 7fcd12ffd640 1 -- 172.21.15.98:0/1311082606 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd14004b20 con 0x7fcd1c0d0410 2024-09-16T15:38:39.981 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.977+0000 7fcd12ffd640 1 -- 172.21.15.98:0/1311082606 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcd14004ce0 con 0x7fcd1c0d0410 2024-09-16T15:38:39.981 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.977+0000 7fcd12ffd640 1 -- 172.21.15.98:0/1311082606 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd14005280 con 0x7fcd1c0d0410 2024-09-16T15:38:39.981 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.977+0000 7fcd2449b640 1 -- 172.21.15.98:0/1311082606 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd1c0b2b70 con 0x7fcd1c0d0410 2024-09-16T15:38:39.981 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.977+0000 7fcd2449b640 1 -- 172.21.15.98:0/1311082606 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd1c159010 con 0x7fcd1c0d0410 2024-09-16T15:38:39.982 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.978+0000 7fcd2449b640 1 -- 172.21.15.98:0/1311082606 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd1c0afc30 con 0x7fcd1c0d0410 2024-09-16T15:38:39.982 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.978+0000 7fcd12ffd640 1 -- 172.21.15.98:0/1311082606 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 6) ==== 101338+0+0 (secure 0 0 0) 0x7fcd14005420 con 0x7fcd1c0d0410 2024-09-16T15:38:39.982 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.979+0000 7fcd12ffd640 1 --2- 172.21.15.98:0/1311082606 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fcd000788e0 0x7fcd0007ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:39.982 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.979+0000 7fcd12ffd640 1 -- 172.21.15.98:0/1311082606 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fcd1409b560 con 0x7fcd1c0d0410 2024-09-16T15:38:39.982 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.979+0000 7fcd22237640 1 --2- 172.21.15.98:0/1311082606 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fcd000788e0 0x7fcd0007ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:39.982 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.980+0000 7fcd22237640 1 --2- 172.21.15.98:0/1311082606 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fcd000788e0 0x7fcd0007ada0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fcd18034000 tx=0x7fcd18004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:39.985 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:39.983+0000 7fcd12ffd640 1 -- 172.21.15.98:0/1311082606 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7fcd14063510 con 0x7fcd1c0d0410 2024-09-16T15:38:40.187 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.185+0000 7fcd2449b640 1 -- 172.21.15.98:0/1311082606 --> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol46192", "group_name": "subvol_grp460", "target": ["mon-mgr", ""]}) -- 0x7fcd1c076360 con 0x7fcd000788e0 2024-09-16T15:38:40.204 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.202+0000 7fcd12ffd640 1 -- 172.21.15.98:0/1311082606 <== mgr.4100 v2:172.21.15.135:6800/699234772 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fcd1c076360 con 0x7fcd000788e0 2024-09-16T15:38:40.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.205+0000 7fcd2449b640 1 -- 172.21.15.98:0/1311082606 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fcd000788e0 msgr2=0x7fcd0007ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:40.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.205+0000 7fcd2449b640 1 --2- 172.21.15.98:0/1311082606 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fcd000788e0 0x7fcd0007ada0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fcd18034000 tx=0x7fcd18004730 comp rx=0 tx=0).stop 2024-09-16T15:38:40.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.205+0000 7fcd2449b640 1 -- 172.21.15.98:0/1311082606 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd1c0d0410 msgr2=0x7fcd1c06ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:40.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.205+0000 7fcd2449b640 1 --2- 172.21.15.98:0/1311082606 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd1c0d0410 0x7fcd1c06ec90 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fcd1400eb10 tx=0x7fcd1400c2d0 comp rx=0 tx=0).stop 2024-09-16T15:38:40.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.205+0000 7fcd2449b640 1 -- 172.21.15.98:0/1311082606 shutdown_connections 2024-09-16T15:38:40.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.205+0000 7fcd2449b640 1 --2- 172.21.15.98:0/1311082606 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd1c0d0410 0x7fcd1c06ec90 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:40.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.205+0000 7fcd2449b640 1 --2- 172.21.15.98:0/1311082606 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fcd000788e0 0x7fcd0007ada0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:40.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.205+0000 7fcd2449b640 1 --2- 172.21.15.98:0/1311082606 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd1c0b0ef0 0x7fcd1c0c7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:40.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.205+0000 7fcd2449b640 1 --2- 172.21.15.98:0/1311082606 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fcd1c0aea80 0x7fcd1c158ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:40.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.205+0000 7fcd2449b640 1 -- 172.21.15.98:0/1311082606 >> 172.21.15.98:0/1311082606 conn(0x7fcd1c0d1e30 msgr2=0x7fcd1c0ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:40.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.205+0000 7fcd2449b640 1 -- 172.21.15.98:0/1311082606 shutdown_connections 2024-09-16T15:38:40.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.205+0000 7fcd2449b640 1 -- 172.21.15.98:0/1311082606 wait complete. 2024-09-16T15:38:40.221 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup rm cephfs subvol_grp460 2024-09-16T15:38:40.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.321+0000 7f3da91a0640 1 -- 172.21.15.98:0/810097876 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3da40b3370 msgr2=0x7f3da40cebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:40.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.321+0000 7f3da91a0640 1 --2- 172.21.15.98:0/810097876 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3da40b3370 0x7f3da40cebe0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f3da415b4d0 tx=0x7f3d9402a540 comp rx=0 tx=0).stop 2024-09-16T15:38:40.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.322+0000 7f3da91a0640 1 -- 172.21.15.98:0/810097876 shutdown_connections 2024-09-16T15:38:40.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.322+0000 7f3da91a0640 1 --2- 172.21.15.98:0/810097876 >> v2:172.21.15.135:3300/0 conn(0x7f3da415e980 0x7f3da415ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:40.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.322+0000 7f3da91a0640 1 --2- 172.21.15.98:0/810097876 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3da415c080 0x7f3da40cf120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:40.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.322+0000 7f3da91a0640 1 --2- 172.21.15.98:0/810097876 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3da40b3370 0x7f3da40cebe0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:40.325 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.322+0000 7f3da91a0640 1 -- 172.21.15.98:0/810097876 >> 172.21.15.98:0/810097876 conn(0x7f3da40b1840 msgr2=0x7f3da40b1c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:40.325 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.322+0000 7f3da91a0640 1 -- 172.21.15.98:0/810097876 shutdown_connections 2024-09-16T15:38:40.325 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.322+0000 7f3da91a0640 1 -- 172.21.15.98:0/810097876 wait complete. 2024-09-16T15:38:40.327 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.323+0000 7f3da91a0640 1 Processor -- start 2024-09-16T15:38:40.327 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.323+0000 7f3da91a0640 1 -- start start 2024-09-16T15:38:40.327 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.324+0000 7f3da91a0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3da40b3370 0x7f3da4155150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:40.327 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.324+0000 7f3da91a0640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3da415c080 0x7f3da41f7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:40.327 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.324+0000 7f3da91a0640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3da415e980 0x7f3da413b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:40.327 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.324+0000 7f3da91a0640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3da4140770 con 0x7f3da415c080 2024-09-16T15:38:40.327 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.324+0000 7f3da91a0640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3da41405f0 con 0x7f3da40b3370 2024-09-16T15:38:40.328 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.324+0000 7f3da91a0640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f3da41408f0 con 0x7f3da415e980 2024-09-16T15:38:40.328 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.324+0000 7f3d9bfff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3da415c080 0x7f3da41f7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:40.328 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.324+0000 7f3d9bfff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3da415c080 0x7f3da41f7ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42490/0 (socket says 172.21.15.98:42490) 2024-09-16T15:38:40.328 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.324+0000 7f3d9bfff640 1 -- 172.21.15.98:0/2251505299 learned_addr learned my addr 172.21.15.98:0/2251505299 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:40.328 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.324+0000 7f3da2d9d640 1 --2- 172.21.15.98:0/2251505299 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3da40b3370 0x7f3da4155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:40.328 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.324+0000 7f3da359e640 1 --2- 172.21.15.98:0/2251505299 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3da415e980 0x7f3da413b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:40.328 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.324+0000 7f3d9bfff640 1 -- 172.21.15.98:0/2251505299 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3da415e980 msgr2=0x7f3da413b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:40.328 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.324+0000 7f3d9bfff640 1 --2- 172.21.15.98:0/2251505299 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3da415e980 0x7f3da413b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:40.328 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.324+0000 7f3d9bfff640 1 -- 172.21.15.98:0/2251505299 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3da40b3370 msgr2=0x7f3da4155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:40.328 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.324+0000 7f3d9bfff640 1 --2- 172.21.15.98:0/2251505299 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3da40b3370 0x7f3da4155150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:40.328 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.324+0000 7f3d9bfff640 1 -- 172.21.15.98:0/2251505299 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3da41f85d0 con 0x7f3da415c080 2024-09-16T15:38:40.328 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.324+0000 7f3d9bfff640 1 --2- 172.21.15.98:0/2251505299 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3da415c080 0x7f3da41f7ed0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c00c970 tx=0x7f3d8c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:40.328 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.324+0000 7f3d9b7fe640 1 -- 172.21.15.98:0/2251505299 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d8c007bb0 con 0x7f3da415c080 2024-09-16T15:38:40.329 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.324+0000 7f3d9b7fe640 1 -- 172.21.15.98:0/2251505299 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3d8c005020 con 0x7f3da415c080 2024-09-16T15:38:40.329 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.324+0000 7f3da91a0640 1 -- 172.21.15.98:0/2251505299 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3da41f88b0 con 0x7f3da415c080 2024-09-16T15:38:40.329 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.325+0000 7f3d9b7fe640 1 -- 172.21.15.98:0/2251505299 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d8c007e60 con 0x7f3da415c080 2024-09-16T15:38:40.329 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.325+0000 7f3da91a0640 1 -- 172.21.15.98:0/2251505299 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3da41f4ad0 con 0x7f3da415c080 2024-09-16T15:38:40.329 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.325+0000 7f3da91a0640 1 -- 172.21.15.98:0/2251505299 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3da4153bf0 con 0x7f3da415c080 2024-09-16T15:38:40.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.326+0000 7f3d9b7fe640 1 -- 172.21.15.98:0/2251505299 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 6) ==== 101338+0+0 (secure 0 0 0) 0x7f3d8c005470 con 0x7f3da415c080 2024-09-16T15:38:40.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.326+0000 7f3d9b7fe640 1 --2- 172.21.15.98:0/2251505299 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f3d840788e0 0x7f3d8407ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:40.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.327+0000 7f3d9b7fe640 1 -- 172.21.15.98:0/2251505299 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f3d8c09af00 con 0x7f3da415c080 2024-09-16T15:38:40.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.327+0000 7f3da2d9d640 1 --2- 172.21.15.98:0/2251505299 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f3d840788e0 0x7f3d8407ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:40.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.327+0000 7f3da2d9d640 1 --2- 172.21.15.98:0/2251505299 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f3d840788e0 0x7f3d8407ada0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3d94033000 tx=0x7f3d94004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:40.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.331+0000 7f3d9b7fe640 1 -- 172.21.15.98:0/2251505299 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7f3da4153bf0 con 0x7f3da415c080 2024-09-16T15:38:40.531 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.529+0000 7f3da91a0640 1 -- 172.21.15.98:0/2251505299 --> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup rm", "vol_name": "cephfs", "group_name": "subvol_grp460", "target": ["mon-mgr", ""]}) -- 0x7f3da41f48e0 con 0x7f3d840788e0 2024-09-16T15:38:40.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.535+0000 7f3d9b7fe640 1 -- 172.21.15.98:0/2251505299 <== mgr.4100 v2:172.21.15.135:6800/699234772 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f3da41f48e0 con 0x7f3d840788e0 2024-09-16T15:38:40.540 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.537+0000 7f3da91a0640 1 -- 172.21.15.98:0/2251505299 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f3d840788e0 msgr2=0x7f3d8407ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:40.540 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.537+0000 7f3da91a0640 1 --2- 172.21.15.98:0/2251505299 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f3d840788e0 0x7f3d8407ada0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3d94033000 tx=0x7f3d94004730 comp rx=0 tx=0).stop 2024-09-16T15:38:40.540 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.537+0000 7f3da91a0640 1 -- 172.21.15.98:0/2251505299 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3da415c080 msgr2=0x7f3da41f7ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:40.540 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.537+0000 7f3da91a0640 1 --2- 172.21.15.98:0/2251505299 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3da415c080 0x7f3da41f7ed0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c00c970 tx=0x7f3d8c00ce30 comp rx=0 tx=0).stop 2024-09-16T15:38:40.540 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.537+0000 7f3da91a0640 1 -- 172.21.15.98:0/2251505299 shutdown_connections 2024-09-16T15:38:40.540 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.537+0000 7f3da91a0640 1 --2- 172.21.15.98:0/2251505299 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3da415e980 0x7f3da413b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:40.540 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.537+0000 7f3da91a0640 1 --2- 172.21.15.98:0/2251505299 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3da415c080 0x7f3da41f7ed0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:40.540 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.537+0000 7f3da91a0640 1 --2- 172.21.15.98:0/2251505299 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f3d840788e0 0x7f3d8407ada0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:40.540 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.537+0000 7f3da91a0640 1 --2- 172.21.15.98:0/2251505299 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3da40b3370 0x7f3da4155150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:40.540 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.537+0000 7f3da91a0640 1 -- 172.21.15.98:0/2251505299 >> 172.21.15.98:0/2251505299 conn(0x7f3da40b1840 msgr2=0x7f3da413e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:40.540 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.537+0000 7f3da91a0640 1 -- 172.21.15.98:0/2251505299 shutdown_connections 2024-09-16T15:38:40.540 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.538+0000 7f3da91a0640 1 -- 172.21.15.98:0/2251505299 wait complete. 2024-09-16T15:38:40.551 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-09-16T15:38:40.599 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T15:38:40.603 INFO:teuthology.orchestra.run.smithi098.stdout:2 2024-09-16T15:38:40.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T15:38:40.610 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-16T15:38:40.610 DEBUG:teuthology.orchestra.run.smithi098:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T15:38:40.664 DEBUG:teuthology.orchestra.run.smithi135:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T15:38:40.707 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-16T15:38:40.707 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T15:38:40.707 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-16T15:38:40.707 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T15:38:40.724 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-16T15:38:40.724 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T15:38:40.780 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-16T15:38:40.922 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.920+0000 7fc5e49a3640 1 -- 172.21.15.98:0/3239023734 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc5c8004800 msgr2=0x7fc5c8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:40.922 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.920+0000 7fc5e49a3640 1 --2- 172.21.15.98:0/3239023734 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc5c8004800 0x7fc5c8004c80 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fc5d4009b50 tx=0x7fc5c8005830 comp rx=0 tx=0).stop 2024-09-16T15:38:40.922 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.920+0000 7fc5e49a3640 1 -- 172.21.15.98:0/3239023734 shutdown_connections 2024-09-16T15:38:40.922 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.920+0000 7fc5e49a3640 1 --2- 172.21.15.98:0/3239023734 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc5c8004800 0x7fc5c8004c80 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:40.923 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.920+0000 7fc5e49a3640 1 -- 172.21.15.98:0/3239023734 >> 172.21.15.98:0/3239023734 conn(0x7fc5e00b2230 msgr2=0x7fc5e00b2610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:40.923 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.920+0000 7fc5e49a3640 1 -- 172.21.15.98:0/3239023734 shutdown_connections 2024-09-16T15:38:40.923 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.920+0000 7fc5e49a3640 1 -- 172.21.15.98:0/3239023734 wait complete. 2024-09-16T15:38:40.923 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.921+0000 7fc5e49a3640 1 Processor -- start 2024-09-16T15:38:40.923 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.922+0000 7fc5e49a3640 1 -- start start 2024-09-16T15:38:40.926 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.922+0000 7fc5e49a3640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc5c8004800 0x7fc5e00703e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:40.926 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.922+0000 7fc5e49a3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5e0157bd0 0x7fc5e0158050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:40.926 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.922+0000 7fc5e49a3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc5e013a070 0x7fc5e013a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:40.926 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.922+0000 7fc5e49a3640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc5e006d180 con 0x7fc5e013a070 2024-09-16T15:38:40.926 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.922+0000 7fc5e49a3640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc5e006d000 con 0x7fc5e0157bd0 2024-09-16T15:38:40.926 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.922+0000 7fc5e49a3640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fc5e006d300 con 0x7fc5c8004800 2024-09-16T15:38:40.926 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.922+0000 7fc5ded9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc5e013a070 0x7fc5e013a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:40.926 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.922+0000 7fc5ded9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc5e013a070 0x7fc5e013a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42504/0 (socket says 172.21.15.98:42504) 2024-09-16T15:38:40.926 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.922+0000 7fc5ded9d640 1 -- 172.21.15.98:0/1176724606 learned_addr learned my addr 172.21.15.98:0/1176724606 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:40.926 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.923+0000 7fc5de59c640 1 --2- 172.21.15.98:0/1176724606 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc5c8004800 0x7fc5e00703e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:40.926 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.923+0000 7fc5ddd9b640 1 --2- 172.21.15.98:0/1176724606 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5e0157bd0 0x7fc5e0158050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:40.926 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.923+0000 7fc5ded9d640 1 -- 172.21.15.98:0/1176724606 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc5c8004800 msgr2=0x7fc5e00703e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:40.926 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.923+0000 7fc5ded9d640 1 --2- 172.21.15.98:0/1176724606 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc5c8004800 0x7fc5e00703e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:40.927 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.923+0000 7fc5ded9d640 1 -- 172.21.15.98:0/1176724606 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5e0157bd0 msgr2=0x7fc5e0158050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:40.927 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.923+0000 7fc5ded9d640 1 --2- 172.21.15.98:0/1176724606 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5e0157bd0 0x7fc5e0158050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:40.927 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.923+0000 7fc5ded9d640 1 -- 172.21.15.98:0/1176724606 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5e01f3170 con 0x7fc5e013a070 2024-09-16T15:38:40.927 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.923+0000 7fc5ddd9b640 1 --2- 172.21.15.98:0/1176724606 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5e0157bd0 0x7fc5e0158050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T15:38:40.927 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.923+0000 7fc5ded9d640 1 --2- 172.21.15.98:0/1176724606 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc5e013a070 0x7fc5e013a4f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fc5e0073070 tx=0x7fc5d80019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:40.927 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.923+0000 7fc5ceffd640 1 -- 172.21.15.98:0/1176724606 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5d8011870 con 0x7fc5e013a070 2024-09-16T15:38:40.927 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.923+0000 7fc5e49a3640 1 -- 172.21.15.98:0/1176724606 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5e01f3450 con 0x7fc5e013a070 2024-09-16T15:38:40.927 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.923+0000 7fc5ceffd640 1 -- 172.21.15.98:0/1176724606 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc5d8017070 con 0x7fc5e013a070 2024-09-16T15:38:40.927 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.923+0000 7fc5ceffd640 1 -- 172.21.15.98:0/1176724606 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5d8011dc0 con 0x7fc5e013a070 2024-09-16T15:38:40.927 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.923+0000 7fc5e49a3640 1 -- 172.21.15.98:0/1176724606 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5e01573d0 con 0x7fc5e013a070 2024-09-16T15:38:40.927 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.924+0000 7fc5e49a3640 1 -- 172.21.15.98:0/1176724606 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5e00cd260 con 0x7fc5e013a070 2024-09-16T15:38:40.928 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.925+0000 7fc5ceffd640 1 -- 172.21.15.98:0/1176724606 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 6) ==== 101338+0+0 (secure 0 0 0) 0x7fc5d801c460 con 0x7fc5e013a070 2024-09-16T15:38:40.928 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.925+0000 7fc5ceffd640 1 --2- 172.21.15.98:0/1176724606 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fc5c00788e0 0x7fc5c007ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:40.928 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.925+0000 7fc5ceffd640 1 -- 172.21.15.98:0/1176724606 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fc5d809b180 con 0x7fc5e013a070 2024-09-16T15:38:40.928 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.925+0000 7fc5de59c640 1 --2- 172.21.15.98:0/1176724606 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fc5c00788e0 0x7fc5c007ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:40.928 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.926+0000 7fc5de59c640 1 --2- 172.21.15.98:0/1176724606 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fc5c00788e0 0x7fc5c007ada0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc5d0001eb0 tx=0x7fc5d0006040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:40.931 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:40.929+0000 7fc5ceffd640 1 -- 172.21.15.98:0/1176724606 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7fc5d80636f0 con 0x7fc5e013a070 2024-09-16T15:38:41.124 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.122+0000 7fc5e49a3640 1 -- 172.21.15.98:0/1176724606 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc5e00b0dc0 con 0x7fc5e013a070 2024-09-16T15:38:41.124 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.122+0000 7fc5ceffd640 1 -- 172.21.15.98:0/1176724606 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v34) ==== 80+0+0 (secure 0 0 0) 0x7fc5d8062ff0 con 0x7fc5e013a070 2024-09-16T15:38:41.125 INFO:teuthology.orchestra.run.smithi098.stderr:listed 0 entries 2024-09-16T15:38:41.127 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.125+0000 7fc5e49a3640 1 -- 172.21.15.98:0/1176724606 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fc5c00788e0 msgr2=0x7fc5c007ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:41.127 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.125+0000 7fc5e49a3640 1 --2- 172.21.15.98:0/1176724606 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fc5c00788e0 0x7fc5c007ada0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc5d0001eb0 tx=0x7fc5d0006040 comp rx=0 tx=0).stop 2024-09-16T15:38:41.127 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.125+0000 7fc5e49a3640 1 -- 172.21.15.98:0/1176724606 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc5e013a070 msgr2=0x7fc5e013a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:41.127 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.125+0000 7fc5e49a3640 1 --2- 172.21.15.98:0/1176724606 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc5e013a070 0x7fc5e013a4f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fc5e0073070 tx=0x7fc5d80019b0 comp rx=0 tx=0).stop 2024-09-16T15:38:41.128 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.125+0000 7fc5e49a3640 1 -- 172.21.15.98:0/1176724606 shutdown_connections 2024-09-16T15:38:41.128 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.125+0000 7fc5e49a3640 1 --2- 172.21.15.98:0/1176724606 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc5e013a070 0x7fc5e013a4f0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:41.128 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.125+0000 7fc5e49a3640 1 --2- 172.21.15.98:0/1176724606 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fc5c00788e0 0x7fc5c007ada0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:41.128 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.125+0000 7fc5e49a3640 1 --2- 172.21.15.98:0/1176724606 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5e0157bd0 0x7fc5e0158050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:41.128 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.125+0000 7fc5e49a3640 1 --2- 172.21.15.98:0/1176724606 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc5c8004800 0x7fc5e00703e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:41.128 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.125+0000 7fc5e49a3640 1 -- 172.21.15.98:0/1176724606 >> 172.21.15.98:0/1176724606 conn(0x7fc5e00b2230 msgr2=0x7fc5e013e290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:41.128 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.125+0000 7fc5e49a3640 1 -- 172.21.15.98:0/1176724606 shutdown_connections 2024-09-16T15:38:41.128 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.125+0000 7fc5e49a3640 1 -- 172.21.15.98:0/1176724606 wait complete. 2024-09-16T15:38:41.139 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-16T15:38:41.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T15:38:41.140 DEBUG:teuthology.orchestra.run.smithi098:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-16T15:38:41.168 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi098.front.sepia.ceph.com 2024-09-16T15:38:41.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T15:38:41.168 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-16T15:38:41.224 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T15:38:41.224 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-16T15:38:41.224 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T15:38:41.242 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-16T15:38:41.242 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T15:38:41.298 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-16T15:38:41.400 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.398+0000 7fd207775640 1 -- 172.21.15.98:0/211767038 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd2000ccfd0 msgr2=0x7fd2000730b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:41.400 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.398+0000 7fd207775640 1 --2- 172.21.15.98:0/211767038 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd2000ccfd0 0x7fd2000730b0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fd1f8009be0 tx=0x7fd1f802a960 comp rx=0 tx=0).stop 2024-09-16T15:38:41.400 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.398+0000 7fd207775640 1 -- 172.21.15.98:0/211767038 shutdown_connections 2024-09-16T15:38:41.400 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.398+0000 7fd207775640 1 --2- 172.21.15.98:0/211767038 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd2000ccfd0 0x7fd2000730b0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:41.401 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.398+0000 7fd207775640 1 -- 172.21.15.98:0/211767038 >> 172.21.15.98:0/211767038 conn(0x7fd2000b1950 msgr2=0x7fd2000b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:41.401 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.398+0000 7fd207775640 1 -- 172.21.15.98:0/211767038 shutdown_connections 2024-09-16T15:38:41.401 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.398+0000 7fd207775640 1 -- 172.21.15.98:0/211767038 wait complete. 2024-09-16T15:38:41.401 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.399+0000 7fd207775640 1 Processor -- start 2024-09-16T15:38:41.401 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.399+0000 7fd207775640 1 -- start start 2024-09-16T15:38:41.403 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.400+0000 7fd207775640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2000ccfd0 0x7fd200159fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:41.403 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.400+0000 7fd207775640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd2000cf300 0x7fd20013df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:41.403 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.400+0000 7fd207775640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2001445d0 0x7fd2000ade80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:41.403 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.400+0000 7fd207775640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd2000735f0 con 0x7fd2000cf300 2024-09-16T15:38:41.403 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.400+0000 7fd207775640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd2000b4f60 con 0x7fd2000ccfd0 2024-09-16T15:38:41.403 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.400+0000 7fd207775640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fd200073770 con 0x7fd2001445d0 2024-09-16T15:38:41.403 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.400+0000 7fd204d10640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd2000cf300 0x7fd20013df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:41.404 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.400+0000 7fd204d10640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd2000cf300 0x7fd20013df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42510/0 (socket says 172.21.15.98:42510) 2024-09-16T15:38:41.404 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.400+0000 7fd204d10640 1 -- 172.21.15.98:0/2481221202 learned_addr learned my addr 172.21.15.98:0/2481221202 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:41.404 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.400+0000 7fd205511640 1 --2- 172.21.15.98:0/2481221202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2000ccfd0 0x7fd200159fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:41.404 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.400+0000 7fd205d12640 1 --2- 172.21.15.98:0/2481221202 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2001445d0 0x7fd2000ade80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:41.404 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.400+0000 7fd204d10640 1 -- 172.21.15.98:0/2481221202 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2001445d0 msgr2=0x7fd2000ade80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:41.404 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.400+0000 7fd204d10640 1 --2- 172.21.15.98:0/2481221202 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2001445d0 0x7fd2000ade80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:41.404 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.400+0000 7fd204d10640 1 -- 172.21.15.98:0/2481221202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2000ccfd0 msgr2=0x7fd200159fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:41.404 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.400+0000 7fd204d10640 1 --2- 172.21.15.98:0/2481221202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2000ccfd0 0x7fd200159fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:41.404 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.400+0000 7fd204d10640 1 -- 172.21.15.98:0/2481221202 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd20013e790 con 0x7fd2000cf300 2024-09-16T15:38:41.404 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.400+0000 7fd205d12640 1 --2- 172.21.15.98:0/2481221202 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2001445d0 0x7fd2000ade80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T15:38:41.404 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.401+0000 7fd204d10640 1 --2- 172.21.15.98:0/2481221202 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd2000cf300 0x7fd20013df60 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fd1f000c500 tx=0x7fd1f000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:41.404 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.401+0000 7fd1f5ffb640 1 -- 172.21.15.98:0/2481221202 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f00052d0 con 0x7fd2000cf300 2024-09-16T15:38:41.404 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.401+0000 7fd1f5ffb640 1 -- 172.21.15.98:0/2481221202 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd1f0005470 con 0x7fd2000cf300 2024-09-16T15:38:41.404 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.401+0000 7fd207775640 1 -- 172.21.15.98:0/2481221202 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd20015a660 con 0x7fd2000cf300 2024-09-16T15:38:41.405 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.401+0000 7fd1f5ffb640 1 -- 172.21.15.98:0/2481221202 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f0012870 con 0x7fd2000cf300 2024-09-16T15:38:41.405 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.401+0000 7fd207775640 1 -- 172.21.15.98:0/2481221202 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd20015adf0 con 0x7fd2000cf300 2024-09-16T15:38:41.405 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.402+0000 7fd207775640 1 -- 172.21.15.98:0/2481221202 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd200073c20 con 0x7fd2000cf300 2024-09-16T15:38:41.406 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.402+0000 7fd1f5ffb640 1 -- 172.21.15.98:0/2481221202 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 7) ==== 101440+0+0 (secure 0 0 0) 0x7fd1f00035f0 con 0x7fd2000cf300 2024-09-16T15:38:41.406 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.403+0000 7fd1f5ffb640 1 --2- 172.21.15.98:0/2481221202 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fd1e4078a00 0x7fd1e407aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:41.406 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.403+0000 7fd1f5ffb640 1 -- 172.21.15.98:0/2481221202 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fd1f009a8a0 con 0x7fd2000cf300 2024-09-16T15:38:41.406 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.403+0000 7fd205511640 1 --2- 172.21.15.98:0/2481221202 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fd1e4078a00 0x7fd1e407aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:41.406 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.403+0000 7fd205511640 1 --2- 172.21.15.98:0/2481221202 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fd1e4078a00 0x7fd1e407aec0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc000f60 tx=0x7fd1fc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:41.409 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.407+0000 7fd1f5ffb640 1 -- 172.21.15.98:0/2481221202 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7fd1f0062b90 con 0x7fd2000cf300 2024-09-16T15:38:41.595 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.593+0000 7fd207775640 1 -- 172.21.15.98:0/2481221202 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fd200070a20 con 0x7fd2000cf300 2024-09-16T15:38:41.595 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.593+0000 7fd1f5ffb640 1 -- 172.21.15.98:0/2481221202 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v34) ==== 80+0+0 (secure 0 0 0) 0x7fd1f0062490 con 0x7fd2000cf300 2024-09-16T15:38:41.595 INFO:teuthology.orchestra.run.smithi098.stderr:listed 0 entries 2024-09-16T15:38:41.598 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.596+0000 7fd207775640 1 -- 172.21.15.98:0/2481221202 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fd1e4078a00 msgr2=0x7fd1e407aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:41.598 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.596+0000 7fd207775640 1 --2- 172.21.15.98:0/2481221202 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fd1e4078a00 0x7fd1e407aec0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc000f60 tx=0x7fd1fc009040 comp rx=0 tx=0).stop 2024-09-16T15:38:41.598 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.596+0000 7fd207775640 1 -- 172.21.15.98:0/2481221202 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd2000cf300 msgr2=0x7fd20013df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:41.598 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.596+0000 7fd207775640 1 --2- 172.21.15.98:0/2481221202 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd2000cf300 0x7fd20013df60 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fd1f000c500 tx=0x7fd1f000c9c0 comp rx=0 tx=0).stop 2024-09-16T15:38:41.598 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.596+0000 7fd207775640 1 -- 172.21.15.98:0/2481221202 shutdown_connections 2024-09-16T15:38:41.598 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.596+0000 7fd207775640 1 --2- 172.21.15.98:0/2481221202 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd2001445d0 0x7fd2000ade80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:41.598 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.596+0000 7fd207775640 1 --2- 172.21.15.98:0/2481221202 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd2000cf300 0x7fd20013df60 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:41.598 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.596+0000 7fd207775640 1 --2- 172.21.15.98:0/2481221202 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fd1e4078a00 0x7fd1e407aec0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:41.598 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.596+0000 7fd207775640 1 --2- 172.21.15.98:0/2481221202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2000ccfd0 0x7fd200159fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:41.598 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.596+0000 7fd207775640 1 -- 172.21.15.98:0/2481221202 >> 172.21.15.98:0/2481221202 conn(0x7fd2000b1950 msgr2=0x7fd2000d0570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:41.598 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.596+0000 7fd207775640 1 -- 172.21.15.98:0/2481221202 shutdown_connections 2024-09-16T15:38:41.599 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.596+0000 7fd207775640 1 -- 172.21.15.98:0/2481221202 wait complete. 2024-09-16T15:38:41.608 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-16T15:38:41.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T15:38:41.609 DEBUG:teuthology.orchestra.run.smithi135:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-16T15:38:41.639 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi135.front.sepia.ceph.com 2024-09-16T15:38:41.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T15:38:41.640 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-16T15:38:41.696 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T15:38:41.697 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-16T15:38:41.697 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T15:38:41.712 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056023,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497456k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2510 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248724k,nr_inodes=812181,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497456k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-16T15:38:41.712 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T15:38:41.713 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-16T15:38:41.713 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T15:38:41.753 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=1994704,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=3199348k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18836 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1599672k,nr_inodes=399918,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=3199348k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-16T15:38:41.753 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T15:38:41.854 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.852+0000 7f6c13df3640 1 -- 172.21.15.98:0/2764176031 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c0c0b4ca0 msgr2=0x7f6c0c0cf130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:41.854 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.852+0000 7f6c13df3640 1 --2- 172.21.15.98:0/2764176031 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c0c0b4ca0 0x7f6c0c0cf130 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f6c04005fd0 tx=0x7f6c0402a990 comp rx=0 tx=0).stop 2024-09-16T15:38:41.854 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.852+0000 7f6c13df3640 1 -- 172.21.15.98:0/2764176031 shutdown_connections 2024-09-16T15:38:41.854 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.852+0000 7f6c13df3640 1 --2- 172.21.15.98:0/2764176031 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c0c0b4ca0 0x7f6c0c0cf130 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:41.854 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.852+0000 7f6c13df3640 1 --2- 172.21.15.98:0/2764176031 >> v2:172.21.15.135:3300/0 conn(0x7f6c0c1445d0 0x7f6c0c0cebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:41.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.852+0000 7f6c13df3640 1 -- 172.21.15.98:0/2764176031 >> 172.21.15.98:0/2764176031 conn(0x7f6c0c0b1950 msgr2=0x7f6c0c0b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:41.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.852+0000 7f6c13df3640 1 -- 172.21.15.98:0/2764176031 shutdown_connections 2024-09-16T15:38:41.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.852+0000 7f6c13df3640 1 -- 172.21.15.98:0/2764176031 wait complete. 2024-09-16T15:38:41.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.853+0000 7f6c13df3640 1 Processor -- start 2024-09-16T15:38:41.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.853+0000 7f6c13df3640 1 -- start start 2024-09-16T15:38:41.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.854+0000 7f6c13df3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c0c0b4ca0 0x7f6c0c15b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:41.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.854+0000 7f6c13df3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c0c0ccfd0 0x7f6c0c15aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:41.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.854+0000 7f6c13df3640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6c0c1445d0 0x7f6c0c1e8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:41.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.854+0000 7f6c13df3640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6c0c073bc0 con 0x7f6c0c0b4ca0 2024-09-16T15:38:41.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.854+0000 7f6c13df3640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6c0c144be0 con 0x7f6c0c0ccfd0 2024-09-16T15:38:41.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.854+0000 7f6c13df3640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f6c0c15f080 con 0x7f6c0c1445d0 2024-09-16T15:38:41.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.854+0000 7f6c11b8f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c0c0b4ca0 0x7f6c0c15b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:41.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.854+0000 7f6c11b8f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c0c0b4ca0 0x7f6c0c15b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42518/0 (socket says 172.21.15.98:42518) 2024-09-16T15:38:41.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.854+0000 7f6c11b8f640 1 -- 172.21.15.98:0/2043309083 learned_addr learned my addr 172.21.15.98:0/2043309083 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:41.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.854+0000 7f6c1138e640 1 --2- 172.21.15.98:0/2043309083 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c0c0ccfd0 0x7f6c0c15aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:41.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.854+0000 7f6c12390640 1 --2- 172.21.15.98:0/2043309083 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6c0c1445d0 0x7f6c0c1e8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:41.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.854+0000 7f6c11b8f640 1 -- 172.21.15.98:0/2043309083 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6c0c1445d0 msgr2=0x7f6c0c1e8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:41.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.854+0000 7f6c11b8f640 1 --2- 172.21.15.98:0/2043309083 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6c0c1445d0 0x7f6c0c1e8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:41.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.854+0000 7f6c11b8f640 1 -- 172.21.15.98:0/2043309083 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c0c0ccfd0 msgr2=0x7f6c0c15aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:41.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.854+0000 7f6c11b8f640 1 --2- 172.21.15.98:0/2043309083 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c0c0ccfd0 0x7f6c0c15aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:41.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.854+0000 7f6c11b8f640 1 -- 172.21.15.98:0/2043309083 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c0c15e640 con 0x7f6c0c0b4ca0 2024-09-16T15:38:41.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.854+0000 7f6c12390640 1 --2- 172.21.15.98:0/2043309083 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6c0c1445d0 0x7f6c0c1e8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T15:38:41.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.854+0000 7f6c11b8f640 1 --2- 172.21.15.98:0/2043309083 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c0c0b4ca0 0x7f6c0c15b3b0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f6c0800e790 tx=0x7f6c0800ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:41.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.855+0000 7f6c027fc640 1 -- 172.21.15.98:0/2043309083 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c0800eea0 con 0x7f6c0c0b4ca0 2024-09-16T15:38:41.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.855+0000 7f6c027fc640 1 -- 172.21.15.98:0/2043309083 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6c0800cdb0 con 0x7f6c0c0b4ca0 2024-09-16T15:38:41.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.855+0000 7f6c13df3640 1 -- 172.21.15.98:0/2043309083 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c0c1f82f0 con 0x7f6c0c0b4ca0 2024-09-16T15:38:41.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.855+0000 7f6c027fc640 1 -- 172.21.15.98:0/2043309083 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c08010690 con 0x7f6c0c0b4ca0 2024-09-16T15:38:41.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.855+0000 7f6c13df3640 1 -- 172.21.15.98:0/2043309083 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c0c1f8dd0 con 0x7f6c0c0b4ca0 2024-09-16T15:38:41.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.855+0000 7f6c13df3640 1 -- 172.21.15.98:0/2043309083 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c0c1f8110 con 0x7f6c0c0b4ca0 2024-09-16T15:38:41.860 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.856+0000 7f6c027fc640 1 -- 172.21.15.98:0/2043309083 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 7) ==== 101440+0+0 (secure 0 0 0) 0x7f6c08010830 con 0x7f6c0c0b4ca0 2024-09-16T15:38:41.860 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.857+0000 7f6c027fc640 1 --2- 172.21.15.98:0/2043309083 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f6bf0078a00 0x7f6bf007aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:41.860 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.857+0000 7f6c027fc640 1 -- 172.21.15.98:0/2043309083 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f6c0809b5a0 con 0x7f6c0c0b4ca0 2024-09-16T15:38:41.860 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.857+0000 7f6c1138e640 1 --2- 172.21.15.98:0/2043309083 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f6bf0078a00 0x7f6bf007aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:41.860 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.857+0000 7f6c1138e640 1 --2- 172.21.15.98:0/2043309083 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f6bf0078a00 0x7f6bf007aec0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc007fd0 tx=0x7f6bfc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:41.863 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:41.861+0000 7f6c027fc640 1 -- 172.21.15.98:0/2043309083 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7f6c0c1f8110 con 0x7f6c0c0b4ca0 2024-09-16T15:38:42.073 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.071+0000 7f6c13df3640 1 -- 172.21.15.98:0/2043309083 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6c0c070a20 con 0x7f6c0c0b4ca0 2024-09-16T15:38:42.074 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.071+0000 7f6c027fc640 1 -- 172.21.15.98:0/2043309083 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5229 (secure 0 0 0) 0x7f6c080632c0 con 0x7f6c0c0b4ca0 2024-09-16T15:38:42.074 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:38:42.074 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":16,"btime":"2024-09-16T15:38:37:111824+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4804,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/1917138590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":1917138590},{"type":"v1","addr":"172.21.15.135:6836","nonce":1917138590}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4807,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2813663234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2813663234},{"type":"v1","addr":"172.21.15.135:6837","nonce":2813663234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4848,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6834/2449820374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":2449820374},{"type":"v1","addr":"172.21.15.98:6834","nonce":2449820374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T15:38:24.409442+0000","modified":"2024-09-16T15:38:26.524070+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4851},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4851":{"gid":4851,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.98:6835/1806390493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6833","nonce":1806390493},{"type":"v1","addr":"172.21.15.98:6835","nonce":1806390493}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4851,"qdb_cluster":[4851]},"id":2}]} 2024-09-16T15:38:42.074 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 16 2024-09-16T15:38:42.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.073+0000 7f6c13df3640 1 -- 172.21.15.98:0/2043309083 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f6bf0078a00 msgr2=0x7f6bf007aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:42.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.073+0000 7f6c13df3640 1 --2- 172.21.15.98:0/2043309083 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f6bf0078a00 0x7f6bf007aec0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc007fd0 tx=0x7f6bfc009040 comp rx=0 tx=0).stop 2024-09-16T15:38:42.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.073+0000 7f6c13df3640 1 -- 172.21.15.98:0/2043309083 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c0c0b4ca0 msgr2=0x7f6c0c15b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:42.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.073+0000 7f6c13df3640 1 --2- 172.21.15.98:0/2043309083 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c0c0b4ca0 0x7f6c0c15b3b0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f6c0800e790 tx=0x7f6c0800ec50 comp rx=0 tx=0).stop 2024-09-16T15:38:42.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.074+0000 7f6c13df3640 1 -- 172.21.15.98:0/2043309083 shutdown_connections 2024-09-16T15:38:42.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.074+0000 7f6c13df3640 1 --2- 172.21.15.98:0/2043309083 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6c0c1445d0 0x7f6c0c1e8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:42.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.074+0000 7f6c13df3640 1 --2- 172.21.15.98:0/2043309083 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f6bf0078a00 0x7f6bf007aec0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:42.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.074+0000 7f6c13df3640 1 --2- 172.21.15.98:0/2043309083 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c0c0ccfd0 0x7f6c0c15aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:42.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.074+0000 7f6c13df3640 1 --2- 172.21.15.98:0/2043309083 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c0c0b4ca0 0x7f6c0c15b3b0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:42.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.074+0000 7f6c13df3640 1 -- 172.21.15.98:0/2043309083 >> 172.21.15.98:0/2043309083 conn(0x7f6c0c0b1950 msgr2=0x7f6c0c1421f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:42.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.074+0000 7f6c13df3640 1 -- 172.21.15.98:0/2043309083 shutdown_connections 2024-09-16T15:38:42.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.074+0000 7f6c13df3640 1 -- 172.21.15.98:0/2043309083 wait complete. 2024-09-16T15:38:42.087 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T15:38:42.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.190+0000 7ff6f4c57640 1 -- 172.21.15.98:0/3009097695 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff6d8004800 msgr2=0x7ff6d8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:42.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.190+0000 7ff6f4c57640 1 --2- 172.21.15.98:0/3009097695 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff6d8004800 0x7ff6d8004c80 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ff6e4009b20 tx=0x7ff6d8005830 comp rx=0 tx=0).stop 2024-09-16T15:38:42.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.190+0000 7ff6eed9d640 1 -- 172.21.15.98:0/3009097695 reap_dead start 2024-09-16T15:38:42.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.190+0000 7ff6f4c57640 1 -- 172.21.15.98:0/3009097695 shutdown_connections 2024-09-16T15:38:42.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.190+0000 7ff6f4c57640 1 -- 172.21.15.98:0/3009097695 >> 172.21.15.98:0/3009097695 conn(0x7ff6f00d1eb0 msgr2=0x7ff6f00d22c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:42.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.190+0000 7ff6f4c57640 1 -- 172.21.15.98:0/3009097695 shutdown_connections 2024-09-16T15:38:42.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.190+0000 7ff6f4c57640 1 -- 172.21.15.98:0/3009097695 wait complete. 2024-09-16T15:38:42.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.191+0000 7ff6f4c57640 1 Processor -- start 2024-09-16T15:38:42.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.192+0000 7ff6f4c57640 1 -- start start 2024-09-16T15:38:42.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.192+0000 7ff6f4c57640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff6d8004800 0x7ff6f015f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:42.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.192+0000 7ff6f4c57640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff6f00ca840 0x7ff6f0155480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:42.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.192+0000 7ff6f4c57640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6f00b01b0 0x7ff6f00b0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:42.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.192+0000 7ff6f4c57640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff6f00cf3f0 con 0x7ff6d8004800 2024-09-16T15:38:42.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.192+0000 7ff6f4c57640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff6f00cf270 con 0x7ff6f00b01b0 2024-09-16T15:38:42.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.192+0000 7ff6f4c57640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ff6f00cf570 con 0x7ff6f00ca840 2024-09-16T15:38:42.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.192+0000 7ff6ee59c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff6d8004800 0x7ff6f015f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:42.197 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.192+0000 7ff6ee59c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff6d8004800 0x7ff6f015f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42546/0 (socket says 172.21.15.98:42546) 2024-09-16T15:38:42.197 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.192+0000 7ff6ee59c640 1 -- 172.21.15.98:0/75480371 learned_addr learned my addr 172.21.15.98:0/75480371 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:42.197 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.192+0000 7ff6edd9b640 1 --2- 172.21.15.98:0/75480371 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff6f00ca840 0x7ff6f0155480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:42.197 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.192+0000 7ff6eed9d640 1 --2- 172.21.15.98:0/75480371 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6f00b01b0 0x7ff6f00b0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:42.197 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.193+0000 7ff6ee59c640 1 -- 172.21.15.98:0/75480371 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff6f00ca840 msgr2=0x7ff6f0155480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:42.197 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.193+0000 7ff6ee59c640 1 --2- 172.21.15.98:0/75480371 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff6f00ca840 0x7ff6f0155480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:42.197 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.193+0000 7ff6ee59c640 1 -- 172.21.15.98:0/75480371 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6f00b01b0 msgr2=0x7ff6f00b0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:42.197 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.193+0000 7ff6ee59c640 1 --2- 172.21.15.98:0/75480371 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6f00b01b0 0x7ff6f00b0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:42.197 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.193+0000 7ff6ee59c640 1 -- 172.21.15.98:0/75480371 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6f00cafb0 con 0x7ff6d8004800 2024-09-16T15:38:42.197 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.193+0000 7ff6ee59c640 1 --2- 172.21.15.98:0/75480371 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff6d8004800 0x7ff6f015f120 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ff6e0003fd0 tx=0x7ff6e000f7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:42.197 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.193+0000 7ff6deffd640 1 -- 172.21.15.98:0/75480371 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6e0011640 con 0x7ff6d8004800 2024-09-16T15:38:42.197 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.193+0000 7ff6deffd640 1 -- 172.21.15.98:0/75480371 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff6e0016020 con 0x7ff6d8004800 2024-09-16T15:38:42.197 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.193+0000 7ff6f4c57640 1 -- 172.21.15.98:0/75480371 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6f00cb290 con 0x7ff6d8004800 2024-09-16T15:38:42.198 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.193+0000 7ff6deffd640 1 -- 172.21.15.98:0/75480371 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6e0011a80 con 0x7ff6d8004800 2024-09-16T15:38:42.198 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.193+0000 7ff6f4c57640 1 -- 172.21.15.98:0/75480371 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6f00cb850 con 0x7ff6d8004800 2024-09-16T15:38:42.198 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.194+0000 7ff6f4c57640 1 -- 172.21.15.98:0/75480371 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6f00b2d30 con 0x7ff6d8004800 2024-09-16T15:38:42.198 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.195+0000 7ff6deffd640 1 -- 172.21.15.98:0/75480371 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 7) ==== 101440+0+0 (secure 0 0 0) 0x7ff6e0011c20 con 0x7ff6d8004800 2024-09-16T15:38:42.199 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.195+0000 7ff6deffd640 1 --2- 172.21.15.98:0/75480371 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7ff6d0078a00 0x7ff6d007aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:42.199 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.195+0000 7ff6deffd640 1 -- 172.21.15.98:0/75480371 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7ff6e009b630 con 0x7ff6d8004800 2024-09-16T15:38:42.199 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.195+0000 7ff6edd9b640 1 --2- 172.21.15.98:0/75480371 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7ff6d0078a00 0x7ff6d007aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:42.199 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.196+0000 7ff6edd9b640 1 --2- 172.21.15.98:0/75480371 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7ff6d0078a00 0x7ff6d007aec0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff6e4035000 tx=0x7ff6e402d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:42.201 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.199+0000 7ff6deffd640 1 -- 172.21.15.98:0/75480371 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7ff6e0020020 con 0x7ff6d8004800 2024-09-16T15:38:42.413 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.411+0000 7ff6f4c57640 1 -- 172.21.15.98:0/75480371 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff6f00b15f0 con 0x7ff6d8004800 2024-09-16T15:38:42.413 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.411+0000 7ff6deffd640 1 -- 172.21.15.98:0/75480371 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5229 (secure 0 0 0) 0x7ff6e00639a0 con 0x7ff6d8004800 2024-09-16T15:38:42.414 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:38:42.414 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":16,"btime":"2024-09-16T15:38:37:111824+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4804,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/1917138590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":1917138590},{"type":"v1","addr":"172.21.15.135:6836","nonce":1917138590}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4807,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2813663234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2813663234},{"type":"v1","addr":"172.21.15.135:6837","nonce":2813663234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4848,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6834/2449820374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":2449820374},{"type":"v1","addr":"172.21.15.98:6834","nonce":2449820374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T15:38:24.409442+0000","modified":"2024-09-16T15:38:26.524070+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4851},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4851":{"gid":4851,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.98:6835/1806390493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6833","nonce":1806390493},{"type":"v1","addr":"172.21.15.98:6835","nonce":1806390493}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4851,"qdb_cluster":[4851]},"id":2}]} 2024-09-16T15:38:42.414 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 16 2024-09-16T15:38:42.415 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.413+0000 7ff6f4c57640 1 -- 172.21.15.98:0/75480371 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7ff6d0078a00 msgr2=0x7ff6d007aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:42.416 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.413+0000 7ff6f4c57640 1 --2- 172.21.15.98:0/75480371 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7ff6d0078a00 0x7ff6d007aec0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff6e4035000 tx=0x7ff6e402d040 comp rx=0 tx=0).stop 2024-09-16T15:38:42.416 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.413+0000 7ff6f4c57640 1 -- 172.21.15.98:0/75480371 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff6d8004800 msgr2=0x7ff6f015f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:42.416 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.413+0000 7ff6f4c57640 1 --2- 172.21.15.98:0/75480371 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff6d8004800 0x7ff6f015f120 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ff6e0003fd0 tx=0x7ff6e000f7e0 comp rx=0 tx=0).stop 2024-09-16T15:38:42.416 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.413+0000 7ff6f4c57640 1 -- 172.21.15.98:0/75480371 shutdown_connections 2024-09-16T15:38:42.416 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.413+0000 7ff6f4c57640 1 --2- 172.21.15.98:0/75480371 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7ff6d0078a00 0x7ff6d007aec0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:42.416 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.413+0000 7ff6f4c57640 1 --2- 172.21.15.98:0/75480371 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6f00b01b0 0x7ff6f00b0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:42.416 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.413+0000 7ff6f4c57640 1 --2- 172.21.15.98:0/75480371 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ff6f00ca840 0x7ff6f0155480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:42.416 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.413+0000 7ff6f4c57640 1 --2- 172.21.15.98:0/75480371 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff6d8004800 0x7ff6f015f120 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:42.416 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.413+0000 7ff6f4c57640 1 -- 172.21.15.98:0/75480371 >> 172.21.15.98:0/75480371 conn(0x7ff6f00d1eb0 msgr2=0x7ff6f0071700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:42.416 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.414+0000 7ff6f4c57640 1 -- 172.21.15.98:0/75480371 shutdown_connections 2024-09-16T15:38:42.417 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.414+0000 7ff6f4c57640 1 -- 172.21.15.98:0/75480371 wait complete. 2024-09-16T15:38:42.427 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T15:38:42.529 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.526+0000 7fe890247640 1 -- 172.21.15.98:0/651549181 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe88815f5a0 msgr2=0x7fe8880b2440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:42.529 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.526+0000 7fe890247640 1 --2- 172.21.15.98:0/651549181 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe88815f5a0 0x7fe8880b2440 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe88806dac0 tx=0x7fe88402a4d0 comp rx=0 tx=0).stop 2024-09-16T15:38:42.529 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.527+0000 7fe890247640 1 -- 172.21.15.98:0/651549181 shutdown_connections 2024-09-16T15:38:42.529 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.527+0000 7fe890247640 1 --2- 172.21.15.98:0/651549181 >> v2:172.21.15.135:3300/0 conn(0x7fe888073fb0 0x7fe888074420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:42.529 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.527+0000 7fe890247640 1 --2- 172.21.15.98:0/651549181 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe88815f5a0 0x7fe8880b2440 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:42.529 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.527+0000 7fe890247640 1 -- 172.21.15.98:0/651549181 >> 172.21.15.98:0/651549181 conn(0x7fe8880b1950 msgr2=0x7fe8880b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:42.530 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.527+0000 7fe890247640 1 -- 172.21.15.98:0/651549181 shutdown_connections 2024-09-16T15:38:42.530 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.527+0000 7fe890247640 1 -- 172.21.15.98:0/651549181 wait complete. 2024-09-16T15:38:42.532 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.528+0000 7fe890247640 1 Processor -- start 2024-09-16T15:38:42.532 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.528+0000 7fe890247640 1 -- start start 2024-09-16T15:38:42.532 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.529+0000 7fe890247640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe888073fb0 0x7fe88809b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:42.532 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.529+0000 7fe890247640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8880ccf00 0x7fe8880b1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:42.532 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.529+0000 7fe890247640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe88815f5a0 0x7fe8880b2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:42.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.529+0000 7fe890247640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe88806f2e0 con 0x7fe888073fb0 2024-09-16T15:38:42.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.529+0000 7fe890247640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe88806f160 con 0x7fe8880ccf00 2024-09-16T15:38:42.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.529+0000 7fe890247640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fe88806f460 con 0x7fe88815f5a0 2024-09-16T15:38:42.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.529+0000 7fe88dfe3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe888073fb0 0x7fe88809b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:42.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.529+0000 7fe88dfe3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe888073fb0 0x7fe88809b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42560/0 (socket says 172.21.15.98:42560) 2024-09-16T15:38:42.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.529+0000 7fe88dfe3640 1 -- 172.21.15.98:0/648074252 learned_addr learned my addr 172.21.15.98:0/648074252 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:42.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.529+0000 7fe88dfe3640 1 -- 172.21.15.98:0/648074252 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe88815f5a0 msgr2=0x7fe8880b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:42.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.529+0000 7fe88dfe3640 1 --2- 172.21.15.98:0/648074252 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe88815f5a0 0x7fe8880b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:42.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.529+0000 7fe88dfe3640 1 -- 172.21.15.98:0/648074252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8880ccf00 msgr2=0x7fe8880b1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:42.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.529+0000 7fe88dfe3640 1 --2- 172.21.15.98:0/648074252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8880ccf00 0x7fe8880b1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:42.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.529+0000 7fe88dfe3640 1 -- 172.21.15.98:0/648074252 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe88809cc50 con 0x7fe888073fb0 2024-09-16T15:38:42.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.529+0000 7fe88dfe3640 1 --2- 172.21.15.98:0/648074252 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe888073fb0 0x7fe88809b0c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe884034040 tx=0x7fe8840039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:42.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.529+0000 7fe87e7fc640 1 -- 172.21.15.98:0/648074252 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe88403e030 con 0x7fe888073fb0 2024-09-16T15:38:42.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.529+0000 7fe87e7fc640 1 -- 172.21.15.98:0/648074252 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe8840047a0 con 0x7fe888073fb0 2024-09-16T15:38:42.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.529+0000 7fe890247640 1 -- 172.21.15.98:0/648074252 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe88809cf30 con 0x7fe888073fb0 2024-09-16T15:38:42.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.529+0000 7fe87e7fc640 1 -- 172.21.15.98:0/648074252 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe884035040 con 0x7fe888073fb0 2024-09-16T15:38:42.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.529+0000 7fe890247640 1 -- 172.21.15.98:0/648074252 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe88809d4f0 con 0x7fe888073fb0 2024-09-16T15:38:42.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.530+0000 7fe890247640 1 -- 172.21.15.98:0/648074252 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe88806fa10 con 0x7fe888073fb0 2024-09-16T15:38:42.535 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.531+0000 7fe87e7fc640 1 -- 172.21.15.98:0/648074252 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 7) ==== 101440+0+0 (secure 0 0 0) 0x7fe884041030 con 0x7fe888073fb0 2024-09-16T15:38:42.535 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.532+0000 7fe87e7fc640 1 --2- 172.21.15.98:0/648074252 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fe86c078a00 0x7fe86c07aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:42.535 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.532+0000 7fe87e7fc640 1 -- 172.21.15.98:0/648074252 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fe8840bb490 con 0x7fe888073fb0 2024-09-16T15:38:42.535 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.532+0000 7fe88d7e2640 1 --2- 172.21.15.98:0/648074252 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fe86c078a00 0x7fe86c07aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:42.535 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.533+0000 7fe88d7e2640 1 --2- 172.21.15.98:0/648074252 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fe86c078a00 0x7fe86c07aec0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe8881f0530 tx=0x7fe878007990 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:42.538 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.536+0000 7fe87e7fc640 1 -- 172.21.15.98:0/648074252 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7fe884083770 con 0x7fe888073fb0 2024-09-16T15:38:42.716 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.714+0000 7fe890247640 1 -- 172.21.15.98:0/648074252 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe888154b70 con 0x7fe888073fb0 2024-09-16T15:38:42.717 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.715+0000 7fe87e7fc640 1 -- 172.21.15.98:0/648074252 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16681 (secure 0 0 0) 0x7fe884083070 con 0x7fe888073fb0 2024-09-16T15:38:42.717 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:38:42.717 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":34,"fsid":"52a38a45-21d2-4cb0-bb3a-4fb8be3a08df","created":"2024-09-16T15:37:20.387654+0000","modified":"2024-09-16T15:38:26.079177+0000","last_up_change":"2024-09-16T15:37:33.417470+0000","last_in_change":"2024-09-16T15:37:23.430578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T15:37:34.725090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-16T15:38:22.261968+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-16T15:38:23.379099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a2d61df4-2577-47e6-a4ac-c36bbb85ab8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1967099790},{"type":"v1","addr":"172.21.15.98:6825","nonce":1967099790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1967099790},{"type":"v1","addr":"172.21.15.98:6827","nonce":1967099790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":1967099790},{"type":"v1","addr":"172.21.15.98:6831","nonce":1967099790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1967099790},{"type":"v1","addr":"172.21.15.98:6829","nonce":1967099790}]},"public_addr":"172.21.15.98:6825/1967099790","cluster_addr":"172.21.15.98:6827/1967099790","heartbeat_back_addr":"172.21.15.98:6831/1967099790","heartbeat_front_addr":"172.21.15.98:6829/1967099790","state":["exists","up"]},{"osd":1,"uuid":"bb3a68a5-c22f-442b-b292-7c272fe01ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":3571460482},{"type":"v1","addr":"172.21.15.98:6809","nonce":3571460482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":3571460482},{"type":"v1","addr":"172.21.15.98:6811","nonce":3571460482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":3571460482},{"type":"v1","addr":"172.21.15.98:6815","nonce":3571460482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":3571460482},{"type":"v1","addr":"172.21.15.98:6813","nonce":3571460482}]},"public_addr":"172.21.15.98:6809/3571460482","cluster_addr":"172.21.15.98:6811/3571460482","heartbeat_back_addr":"172.21.15.98:6815/3571460482","heartbeat_front_addr":"172.21.15.98:6813/3571460482","state":["exists","up"]},{"osd":2,"uuid":"c8429195-a480-409b-8e5f-8dc4c6abc0a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":2573210695},{"type":"v1","addr":"172.21.15.98:6801","nonce":2573210695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":2573210695},{"type":"v1","addr":"172.21.15.98:6803","nonce":2573210695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":2573210695},{"type":"v1","addr":"172.21.15.98:6807","nonce":2573210695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":2573210695},{"type":"v1","addr":"172.21.15.98:6805","nonce":2573210695}]},"public_addr":"172.21.15.98:6801/2573210695","cluster_addr":"172.21.15.98:6803/2573210695","heartbeat_back_addr":"172.21.15.98:6807/2573210695","heartbeat_front_addr":"172.21.15.98:6805/2573210695","state":["exists","up"]},{"osd":3,"uuid":"0e800d7b-096f-4f65-b3cc-c7cda3870de4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":3951374837},{"type":"v1","addr":"172.21.15.98:6817","nonce":3951374837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":3951374837},{"type":"v1","addr":"172.21.15.98:6819","nonce":3951374837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":3951374837},{"type":"v1","addr":"172.21.15.98:6823","nonce":3951374837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":3951374837},{"type":"v1","addr":"172.21.15.98:6821","nonce":3951374837}]},"public_addr":"172.21.15.98:6817/3951374837","cluster_addr":"172.21.15.98:6819/3951374837","heartbeat_back_addr":"172.21.15.98:6823/3951374837","heartbeat_front_addr":"172.21.15.98:6821/3951374837","state":["exists","up"]},{"osd":4,"uuid":"c7822e9b-8e29-48d9-b92a-e8f9c7bc5247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":724302036},{"type":"v1","addr":"172.21.15.135:6811","nonce":724302036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":724302036},{"type":"v1","addr":"172.21.15.135:6813","nonce":724302036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":724302036},{"type":"v1","addr":"172.21.15.135:6817","nonce":724302036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":724302036},{"type":"v1","addr":"172.21.15.135:6815","nonce":724302036}]},"public_addr":"172.21.15.135:6811/724302036","cluster_addr":"172.21.15.135:6813/724302036","heartbeat_back_addr":"172.21.15.135:6817/724302036","heartbeat_front_addr":"172.21.15.135:6815/724302036","state":["exists","up"]},{"osd":5,"uuid":"35805e02-484a-4404-a78f-aa44f4daa41f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3083482635},{"type":"v1","addr":"172.21.15.135:6803","nonce":3083482635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3083482635},{"type":"v1","addr":"172.21.15.135:6805","nonce":3083482635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3083482635},{"type":"v1","addr":"172.21.15.135:6809","nonce":3083482635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3083482635},{"type":"v1","addr":"172.21.15.135:6807","nonce":3083482635}]},"public_addr":"172.21.15.135:6803/3083482635","cluster_addr":"172.21.15.135:6805/3083482635","heartbeat_back_addr":"172.21.15.135:6809/3083482635","heartbeat_front_addr":"172.21.15.135:6807/3083482635","state":["exists","up"]},{"osd":6,"uuid":"6327ba84-aaeb-41fa-9717-188988ff2c4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3376376340},{"type":"v1","addr":"172.21.15.135:6819","nonce":3376376340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3376376340},{"type":"v1","addr":"172.21.15.135:6821","nonce":3376376340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":3376376340},{"type":"v1","addr":"172.21.15.135:6825","nonce":3376376340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3376376340},{"type":"v1","addr":"172.21.15.135:6823","nonce":3376376340}]},"public_addr":"172.21.15.135:6819/3376376340","cluster_addr":"172.21.15.135:6821/3376376340","heartbeat_back_addr":"172.21.15.135:6825/3376376340","heartbeat_front_addr":"172.21.15.135:6823/3376376340","state":["exists","up"]},{"osd":7,"uuid":"392d0958-dff9-4248-b3d8-a1201c10f354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2559837727},{"type":"v1","addr":"172.21.15.135:6827","nonce":2559837727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2559837727},{"type":"v1","addr":"172.21.15.135:6829","nonce":2559837727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":2559837727},{"type":"v1","addr":"172.21.15.135:6833","nonce":2559837727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2559837727},{"type":"v1","addr":"172.21.15.135:6831","nonce":2559837727}]},"public_addr":"172.21.15.135:6827/2559837727","cluster_addr":"172.21.15.135:6829/2559837727","heartbeat_back_addr":"172.21.15.135:6833/2559837727","heartbeat_front_addr":"172.21.15.135:6831/2559837727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.939904+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.717296+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.785817+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:30.211718+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.973359+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:30.250109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.699327+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:30.173063+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T15:38:42.719 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.717+0000 7fe890247640 1 -- 172.21.15.98:0/648074252 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fe86c078a00 msgr2=0x7fe86c07aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:42.719 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.717+0000 7fe890247640 1 --2- 172.21.15.98:0/648074252 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fe86c078a00 0x7fe86c07aec0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe8881f0530 tx=0x7fe878007990 comp rx=0 tx=0).stop 2024-09-16T15:38:42.719 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.717+0000 7fe890247640 1 -- 172.21.15.98:0/648074252 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe888073fb0 msgr2=0x7fe88809b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:42.719 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.717+0000 7fe890247640 1 --2- 172.21.15.98:0/648074252 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe888073fb0 0x7fe88809b0c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe884034040 tx=0x7fe8840039e0 comp rx=0 tx=0).stop 2024-09-16T15:38:42.719 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.717+0000 7fe890247640 1 -- 172.21.15.98:0/648074252 shutdown_connections 2024-09-16T15:38:42.719 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.717+0000 7fe890247640 1 --2- 172.21.15.98:0/648074252 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe88815f5a0 0x7fe8880b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:42.719 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.717+0000 7fe890247640 1 --2- 172.21.15.98:0/648074252 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fe86c078a00 0x7fe86c07aec0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:42.720 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.717+0000 7fe890247640 1 --2- 172.21.15.98:0/648074252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8880ccf00 0x7fe8880b1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:42.720 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.717+0000 7fe890247640 1 --2- 172.21.15.98:0/648074252 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe888073fb0 0x7fe88809b0c0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:42.720 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.717+0000 7fe890247640 1 -- 172.21.15.98:0/648074252 >> 172.21.15.98:0/648074252 conn(0x7fe8880b1950 msgr2=0x7fe8880ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:42.720 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.717+0000 7fe890247640 1 -- 172.21.15.98:0/648074252 shutdown_connections 2024-09-16T15:38:42.720 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.717+0000 7fe890247640 1 -- 172.21.15.98:0/648074252 wait complete. 2024-09-16T15:38:42.731 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-16T15:38:42.731 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T15:38:42.791 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T15:38:42.795 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T15:38:42.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.832+0000 7fef92d89640 1 -- 172.21.15.98:0/3470927299 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fef8c0737d0 msgr2=0x7fef8c073c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:42.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.832+0000 7fef92d89640 1 --2- 172.21.15.98:0/3470927299 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fef8c0737d0 0x7fef8c073c40 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fef84005fd0 tx=0x7fef8402aa90 comp rx=0 tx=0).stop 2024-09-16T15:38:42.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.832+0000 7fef92d89640 1 -- 172.21.15.98:0/3470927299 shutdown_connections 2024-09-16T15:38:42.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.832+0000 7fef92d89640 1 --2- 172.21.15.98:0/3470927299 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fef8c0737d0 0x7fef8c073c40 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:42.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.832+0000 7fef92d89640 1 --2- 172.21.15.98:0/3470927299 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fef8c15be40 0x7fef8c15f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:42.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.832+0000 7fef92d89640 1 -- 172.21.15.98:0/3470927299 >> 172.21.15.98:0/3470927299 conn(0x7fef8c0d0d40 msgr2=0x7fef8c0d1150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:42.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.832+0000 7fef92d89640 1 -- 172.21.15.98:0/3470927299 shutdown_connections 2024-09-16T15:38:42.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.832+0000 7fef92d89640 1 -- 172.21.15.98:0/3470927299 wait complete. 2024-09-16T15:38:42.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.833+0000 7fef92d89640 1 Processor -- start 2024-09-16T15:38:42.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.833+0000 7fef92d89640 1 -- start start 2024-09-16T15:38:42.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.834+0000 7fef92d89640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef8c0737d0 0x7fef8c06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:42.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.834+0000 7fef92d89640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fef8c15be40 0x7fef8c14ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:42.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.834+0000 7fef92d89640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fef8c15ede0 0x7fef8c1f66a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:42.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.834+0000 7fef92d89640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fef8c0af010 con 0x7fef8c15be40 2024-09-16T15:38:42.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.834+0000 7fef92d89640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fef8c0aee90 con 0x7fef8c0737d0 2024-09-16T15:38:42.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.834+0000 7fef92d89640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fef8c0af190 con 0x7fef8c15ede0 2024-09-16T15:38:42.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.834+0000 7fef8bfff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fef8c15be40 0x7fef8c14ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:42.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.834+0000 7fef8bfff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fef8c15be40 0x7fef8c14ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42578/0 (socket says 172.21.15.98:42578) 2024-09-16T15:38:42.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.834+0000 7fef8bfff640 1 -- 172.21.15.98:0/1738635972 learned_addr learned my addr 172.21.15.98:0/1738635972 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:42.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.835+0000 7fef91326640 1 --2- 172.21.15.98:0/1738635972 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fef8c15ede0 0x7fef8c1f66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:42.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.835+0000 7fef90b25640 1 --2- 172.21.15.98:0/1738635972 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef8c0737d0 0x7fef8c06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:42.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.835+0000 7fef8bfff640 1 -- 172.21.15.98:0/1738635972 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fef8c15ede0 msgr2=0x7fef8c1f66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:42.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.835+0000 7fef8bfff640 1 --2- 172.21.15.98:0/1738635972 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fef8c15ede0 0x7fef8c1f66a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:42.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.835+0000 7fef8bfff640 1 -- 172.21.15.98:0/1738635972 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef8c0737d0 msgr2=0x7fef8c06d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:42.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.835+0000 7fef8bfff640 1 --2- 172.21.15.98:0/1738635972 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef8c0737d0 0x7fef8c06d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:42.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.835+0000 7fef8bfff640 1 -- 172.21.15.98:0/1738635972 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef8c152c90 con 0x7fef8c15be40 2024-09-16T15:38:42.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.835+0000 7fef8bfff640 1 --2- 172.21.15.98:0/1738635972 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fef8c15be40 0x7fef8c14ea50 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fef7400c890 tx=0x7fef7400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:42.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.835+0000 7fef897fa640 1 -- 172.21.15.98:0/1738635972 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef74004220 con 0x7fef8c15be40 2024-09-16T15:38:42.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.835+0000 7fef897fa640 1 -- 172.21.15.98:0/1738635972 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fef740079b0 con 0x7fef8c15be40 2024-09-16T15:38:42.840 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.835+0000 7fef92d89640 1 -- 172.21.15.98:0/1738635972 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef8c152f70 con 0x7fef8c15be40 2024-09-16T15:38:42.840 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.835+0000 7fef897fa640 1 -- 172.21.15.98:0/1738635972 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef74007de0 con 0x7fef8c15be40 2024-09-16T15:38:42.840 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.835+0000 7fef92d89640 1 -- 172.21.15.98:0/1738635972 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef8c153530 con 0x7fef8c15be40 2024-09-16T15:38:42.840 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.836+0000 7fef92d89640 1 -- 172.21.15.98:0/1738635972 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef8c0afe00 con 0x7fef8c15be40 2024-09-16T15:38:42.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.837+0000 7fef897fa640 1 -- 172.21.15.98:0/1738635972 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 7) ==== 101440+0+0 (secure 0 0 0) 0x7fef74005020 con 0x7fef8c15be40 2024-09-16T15:38:42.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.837+0000 7fef897fa640 1 --2- 172.21.15.98:0/1738635972 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fef6c078a00 0x7fef6c07aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:42.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.837+0000 7fef897fa640 1 -- 172.21.15.98:0/1738635972 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fef7409b160 con 0x7fef8c15be40 2024-09-16T15:38:42.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.837+0000 7fef90b25640 1 --2- 172.21.15.98:0/1738635972 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fef6c078a00 0x7fef6c07aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:42.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.838+0000 7fef90b25640 1 --2- 172.21.15.98:0/1738635972 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fef6c078a00 0x7fef6c07aec0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fef7c0015e0 tx=0x7fef7c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:42.843 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:42.841+0000 7fef897fa640 1 -- 172.21.15.98:0/1738635972 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7fef74014030 con 0x7fef8c15be40 2024-09-16T15:38:43.057 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.055+0000 7fef92d89640 1 -- 172.21.15.98:0/1738635972 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fef8c074a70 con 0x7fef8c15be40 2024-09-16T15:38:43.057 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.055+0000 7fef897fa640 1 -- 172.21.15.98:0/1738635972 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5229 (secure 0 0 0) 0x7fef740634d0 con 0x7fef8c15be40 2024-09-16T15:38:43.058 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:38:43.058 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":16,"btime":"2024-09-16T15:38:37:111824+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4804,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/1917138590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":1917138590},{"type":"v1","addr":"172.21.15.135:6836","nonce":1917138590}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4807,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2813663234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2813663234},{"type":"v1","addr":"172.21.15.135:6837","nonce":2813663234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4848,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6834/2449820374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":2449820374},{"type":"v1","addr":"172.21.15.98:6834","nonce":2449820374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T15:38:24.409442+0000","modified":"2024-09-16T15:38:26.524070+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4851},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4851":{"gid":4851,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.98:6835/1806390493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6833","nonce":1806390493},{"type":"v1","addr":"172.21.15.98:6835","nonce":1806390493}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4851,"qdb_cluster":[4851]},"id":2}]} 2024-09-16T15:38:43.058 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 16 2024-09-16T15:38:43.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.058+0000 7fef92d89640 1 -- 172.21.15.98:0/1738635972 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fef6c078a00 msgr2=0x7fef6c07aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:43.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.058+0000 7fef92d89640 1 --2- 172.21.15.98:0/1738635972 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fef6c078a00 0x7fef6c07aec0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fef7c0015e0 tx=0x7fef7c009040 comp rx=0 tx=0).stop 2024-09-16T15:38:43.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.058+0000 7fef92d89640 1 -- 172.21.15.98:0/1738635972 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fef8c15be40 msgr2=0x7fef8c14ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:43.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.058+0000 7fef92d89640 1 --2- 172.21.15.98:0/1738635972 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fef8c15be40 0x7fef8c14ea50 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fef7400c890 tx=0x7fef7400cd50 comp rx=0 tx=0).stop 2024-09-16T15:38:43.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.058+0000 7fef92d89640 1 -- 172.21.15.98:0/1738635972 shutdown_connections 2024-09-16T15:38:43.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.058+0000 7fef92d89640 1 --2- 172.21.15.98:0/1738635972 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fef8c15ede0 0x7fef8c1f66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:43.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.058+0000 7fef92d89640 1 --2- 172.21.15.98:0/1738635972 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fef8c15be40 0x7fef8c14ea50 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:43.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.058+0000 7fef92d89640 1 --2- 172.21.15.98:0/1738635972 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fef6c078a00 0x7fef6c07aec0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:43.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.058+0000 7fef92d89640 1 --2- 172.21.15.98:0/1738635972 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef8c0737d0 0x7fef8c06d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:43.061 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.058+0000 7fef92d89640 1 -- 172.21.15.98:0/1738635972 >> 172.21.15.98:0/1738635972 conn(0x7fef8c0d0d40 msgr2=0x7fef8c15c590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:43.061 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.058+0000 7fef92d89640 1 -- 172.21.15.98:0/1738635972 shutdown_connections 2024-09-16T15:38:43.061 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.058+0000 7fef92d89640 1 -- 172.21.15.98:0/1738635972 wait complete. 2024-09-16T15:38:43.071 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T15:38:43.212 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.210+0000 7fc114232640 1 -- 172.21.15.98:0/3457397776 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc10c0d1610 msgr2=0x7fc10c0cecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:43.213 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.210+0000 7fc114232640 1 --2- 172.21.15.98:0/3457397776 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc10c0d1610 0x7fc10c0cecc0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fc104005fd0 tx=0x7fc10402a530 comp rx=0 tx=0).stop 2024-09-16T15:38:43.213 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.210+0000 7fc114232640 1 -- 172.21.15.98:0/3457397776 shutdown_connections 2024-09-16T15:38:43.213 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.210+0000 7fc114232640 1 --2- 172.21.15.98:0/3457397776 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc10c0d1610 0x7fc10c0cecc0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:43.213 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.210+0000 7fc114232640 1 --2- 172.21.15.98:0/3457397776 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc10c0d2050 0x7fc10c0d10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:43.213 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.210+0000 7fc114232640 1 -- 172.21.15.98:0/3457397776 >> 172.21.15.98:0/3457397776 conn(0x7fc10c0d3fe0 msgr2=0x7fc10c0d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:43.213 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.210+0000 7fc114232640 1 -- 172.21.15.98:0/3457397776 shutdown_connections 2024-09-16T15:38:43.213 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.210+0000 7fc114232640 1 -- 172.21.15.98:0/3457397776 wait complete. 2024-09-16T15:38:43.215 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.212+0000 7fc114232640 1 Processor -- start 2024-09-16T15:38:43.215 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.212+0000 7fc114232640 1 -- start start 2024-09-16T15:38:43.215 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.212+0000 7fc114232640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc10c0d1610 0x7fc10c0cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:43.215 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.212+0000 7fc114232640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc10c0d2050 0x7fc10c1f8730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:43.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.212+0000 7fc114232640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc10c15e0d0 0x7fc10c15f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:43.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.212+0000 7fc114232640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc10c0cf5e0 con 0x7fc10c0d1610 2024-09-16T15:38:43.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.212+0000 7fc114232640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc10c0cf460 con 0x7fc10c0d2050 2024-09-16T15:38:43.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.212+0000 7fc114232640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fc10c0cf760 con 0x7fc10c15e0d0 2024-09-16T15:38:43.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.212+0000 7fc111fce640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc10c0d1610 0x7fc10c0cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:43.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.212+0000 7fc111fce640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc10c0d1610 0x7fc10c0cb0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42598/0 (socket says 172.21.15.98:42598) 2024-09-16T15:38:43.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.212+0000 7fc111fce640 1 -- 172.21.15.98:0/336707151 learned_addr learned my addr 172.21.15.98:0/336707151 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:43.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.213+0000 7fc1117cd640 1 --2- 172.21.15.98:0/336707151 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc10c0d2050 0x7fc10c1f8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:43.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.213+0000 7fc1127cf640 1 --2- 172.21.15.98:0/336707151 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc10c15e0d0 0x7fc10c15f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:43.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.213+0000 7fc111fce640 1 -- 172.21.15.98:0/336707151 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc10c15e0d0 msgr2=0x7fc10c15f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:43.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.213+0000 7fc111fce640 1 --2- 172.21.15.98:0/336707151 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc10c15e0d0 0x7fc10c15f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:43.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.213+0000 7fc111fce640 1 -- 172.21.15.98:0/336707151 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc10c0d2050 msgr2=0x7fc10c1f8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:43.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.213+0000 7fc111fce640 1 --2- 172.21.15.98:0/336707151 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc10c0d2050 0x7fc10c1f8730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:43.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.213+0000 7fc111fce640 1 -- 172.21.15.98:0/336707151 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc10c1f4c10 con 0x7fc10c0d1610 2024-09-16T15:38:43.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.213+0000 7fc1127cf640 1 --2- 172.21.15.98:0/336707151 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc10c15e0d0 0x7fc10c15f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T15:38:43.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.213+0000 7fc111fce640 1 --2- 172.21.15.98:0/336707151 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc10c0d1610 0x7fc10c0cb0b0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc00ba50 tx=0x7fc0fc00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:43.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.213+0000 7fc10a7fc640 1 -- 172.21.15.98:0/336707151 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0fc019070 con 0x7fc10c0d1610 2024-09-16T15:38:43.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.213+0000 7fc10a7fc640 1 -- 172.21.15.98:0/336707151 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc0fc00cd10 con 0x7fc10c0d1610 2024-09-16T15:38:43.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.213+0000 7fc114232640 1 -- 172.21.15.98:0/336707151 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc10c1f4ef0 con 0x7fc10c0d1610 2024-09-16T15:38:43.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.213+0000 7fc10a7fc640 1 -- 172.21.15.98:0/336707151 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0fc0146a0 con 0x7fc10c0d1610 2024-09-16T15:38:43.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.213+0000 7fc114232640 1 -- 172.21.15.98:0/336707151 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc10c1f54b0 con 0x7fc10c0d1610 2024-09-16T15:38:43.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.214+0000 7fc114232640 1 -- 172.21.15.98:0/336707151 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc10c0ccb80 con 0x7fc10c0d1610 2024-09-16T15:38:43.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.215+0000 7fc10a7fc640 1 -- 172.21.15.98:0/336707151 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 7) ==== 101440+0+0 (secure 0 0 0) 0x7fc0fc01c070 con 0x7fc10c0d1610 2024-09-16T15:38:43.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.215+0000 7fc10a7fc640 1 --2- 172.21.15.98:0/336707151 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fc0f8078a00 0x7fc0f807aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:43.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.215+0000 7fc10a7fc640 1 -- 172.21.15.98:0/336707151 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fc0fc09a970 con 0x7fc10c0d1610 2024-09-16T15:38:43.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.216+0000 7fc1117cd640 1 --2- 172.21.15.98:0/336707151 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fc0f8078a00 0x7fc0f807aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:43.219 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.216+0000 7fc1117cd640 1 --2- 172.21.15.98:0/336707151 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fc0f8078a00 0x7fc0f807aec0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc100005fd0 tx=0x7fc100005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:43.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.220+0000 7fc10a7fc640 1 -- 172.21.15.98:0/336707151 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7fc0fc062600 con 0x7fc10c0d1610 2024-09-16T15:38:43.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.428+0000 7fc114232640 1 -- 172.21.15.98:0/336707151 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc10c06f020 con 0x7fc10c0d1610 2024-09-16T15:38:43.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.429+0000 7fc10a7fc640 1 -- 172.21.15.98:0/336707151 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5229 (secure 0 0 0) 0x7fc0fc067030 con 0x7fc10c0d1610 2024-09-16T15:38:43.431 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:38:43.431 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":16,"btime":"2024-09-16T15:38:37:111824+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4804,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/1917138590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":1917138590},{"type":"v1","addr":"172.21.15.135:6836","nonce":1917138590}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4807,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2813663234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2813663234},{"type":"v1","addr":"172.21.15.135:6837","nonce":2813663234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4848,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6834/2449820374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":2449820374},{"type":"v1","addr":"172.21.15.98:6834","nonce":2449820374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T15:38:24.409442+0000","modified":"2024-09-16T15:38:26.524070+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4851},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4851":{"gid":4851,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.98:6835/1806390493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6833","nonce":1806390493},{"type":"v1","addr":"172.21.15.98:6835","nonce":1806390493}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4851,"qdb_cluster":[4851]},"id":2}]} 2024-09-16T15:38:43.431 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 16 2024-09-16T15:38:43.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.430+0000 7fc114232640 1 -- 172.21.15.98:0/336707151 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fc0f8078a00 msgr2=0x7fc0f807aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:43.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.430+0000 7fc114232640 1 --2- 172.21.15.98:0/336707151 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fc0f8078a00 0x7fc0f807aec0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc100005fd0 tx=0x7fc100005850 comp rx=0 tx=0).stop 2024-09-16T15:38:43.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.430+0000 7fc114232640 1 -- 172.21.15.98:0/336707151 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc10c0d1610 msgr2=0x7fc10c0cb0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:43.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.430+0000 7fc114232640 1 --2- 172.21.15.98:0/336707151 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc10c0d1610 0x7fc10c0cb0b0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc00ba50 tx=0x7fc0fc00bf10 comp rx=0 tx=0).stop 2024-09-16T15:38:43.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.431+0000 7fc114232640 1 -- 172.21.15.98:0/336707151 shutdown_connections 2024-09-16T15:38:43.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.431+0000 7fc114232640 1 --2- 172.21.15.98:0/336707151 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc10c15e0d0 0x7fc10c15f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:43.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.431+0000 7fc114232640 1 --2- 172.21.15.98:0/336707151 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fc0f8078a00 0x7fc0f807aec0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:43.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.431+0000 7fc114232640 1 --2- 172.21.15.98:0/336707151 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc10c0d2050 0x7fc10c1f8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:43.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.431+0000 7fc114232640 1 --2- 172.21.15.98:0/336707151 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc10c0d1610 0x7fc10c0cb0b0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:43.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.431+0000 7fc114232640 1 -- 172.21.15.98:0/336707151 >> 172.21.15.98:0/336707151 conn(0x7fc10c0d3fe0 msgr2=0x7fc10c161090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:43.434 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.431+0000 7fc114232640 1 -- 172.21.15.98:0/336707151 shutdown_connections 2024-09-16T15:38:43.434 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.431+0000 7fc114232640 1 -- 172.21.15.98:0/336707151 wait complete. 2024-09-16T15:38:43.443 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T15:38:43.545 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.542+0000 7f1b2618a640 1 -- 172.21.15.98:0/1358185042 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1b200d1050 msgr2=0x7f1b200d23e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:43.545 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.542+0000 7f1b2618a640 1 --2- 172.21.15.98:0/1358185042 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1b200d1050 0x7f1b200d23e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f1b18005fd0 tx=0x7f1b1802aa90 comp rx=0 tx=0).stop 2024-09-16T15:38:43.545 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.542+0000 7f1b2618a640 1 -- 172.21.15.98:0/1358185042 shutdown_connections 2024-09-16T15:38:43.545 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.542+0000 7f1b2618a640 1 --2- 172.21.15.98:0/1358185042 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1b200d1050 0x7f1b200d23e0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:43.545 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.542+0000 7f1b2618a640 1 -- 172.21.15.98:0/1358185042 >> 172.21.15.98:0/1358185042 conn(0x7f1b200d3fa0 msgr2=0x7f1b200d43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:43.545 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.542+0000 7f1b2618a640 1 -- 172.21.15.98:0/1358185042 shutdown_connections 2024-09-16T15:38:43.545 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.542+0000 7f1b2618a640 1 -- 172.21.15.98:0/1358185042 wait complete. 2024-09-16T15:38:43.546 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.543+0000 7f1b2618a640 1 Processor -- start 2024-09-16T15:38:43.546 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.544+0000 7f1b2618a640 1 -- start start 2024-09-16T15:38:43.548 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.544+0000 7f1b2618a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1b200d1050 0x7f1b200c7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:43.548 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.544+0000 7f1b2618a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1b200d4ac0 0x7f1b201f82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:43.548 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.544+0000 7f1b2618a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b2015e090 0x7f1b201f8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:43.548 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.544+0000 7f1b2618a640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1b200cf910 con 0x7f1b200d1050 2024-09-16T15:38:43.548 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.544+0000 7f1b2618a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1b200d2920 con 0x7f1b2015e090 2024-09-16T15:38:43.548 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.544+0000 7f1b2618a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f1b200cfa90 con 0x7f1b200d4ac0 2024-09-16T15:38:43.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.544+0000 7f1b1f7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1b200d1050 0x7f1b200c7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:43.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.545+0000 7f1b1f7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1b200d1050 0x7f1b200c7ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42622/0 (socket says 172.21.15.98:42622) 2024-09-16T15:38:43.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.545+0000 7f1b1f7fe640 1 -- 172.21.15.98:0/1990298383 learned_addr learned my addr 172.21.15.98:0/1990298383 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:43.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.545+0000 7f1b1ffff640 1 --2- 172.21.15.98:0/1990298383 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b2015e090 0x7f1b201f8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:43.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.545+0000 7f1b1effd640 1 --2- 172.21.15.98:0/1990298383 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1b200d4ac0 0x7f1b201f82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:43.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.545+0000 7f1b1f7fe640 1 -- 172.21.15.98:0/1990298383 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1b200d4ac0 msgr2=0x7f1b201f82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:43.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.545+0000 7f1b1f7fe640 1 --2- 172.21.15.98:0/1990298383 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1b200d4ac0 0x7f1b201f82d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:43.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.545+0000 7f1b1f7fe640 1 -- 172.21.15.98:0/1990298383 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b2015e090 msgr2=0x7f1b201f8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:43.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.545+0000 7f1b1f7fe640 1 --2- 172.21.15.98:0/1990298383 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b2015e090 0x7f1b201f8810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:43.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.545+0000 7f1b1f7fe640 1 -- 172.21.15.98:0/1990298383 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b200c8010 con 0x7f1b200d1050 2024-09-16T15:38:43.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.545+0000 7f1b1effd640 1 --2- 172.21.15.98:0/1990298383 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1b200d4ac0 0x7f1b201f82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T15:38:43.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.545+0000 7f1b1f7fe640 1 --2- 172.21.15.98:0/1990298383 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1b200d1050 0x7f1b200c7ad0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f1b1000b3f0 tx=0x7f1b1000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:43.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.545+0000 7f1b07fff640 1 -- 172.21.15.98:0/1990298383 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b10015020 con 0x7f1b200d1050 2024-09-16T15:38:43.550 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.545+0000 7f1b07fff640 1 -- 172.21.15.98:0/1990298383 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1b10011920 con 0x7f1b200d1050 2024-09-16T15:38:43.550 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.545+0000 7f1b07fff640 1 -- 172.21.15.98:0/1990298383 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b10011d70 con 0x7f1b200d1050 2024-09-16T15:38:43.550 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.545+0000 7f1b2618a640 1 -- 172.21.15.98:0/1990298383 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b200c82e0 con 0x7f1b200d1050 2024-09-16T15:38:43.550 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.545+0000 7f1b2618a640 1 -- 172.21.15.98:0/1990298383 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b200c88a0 con 0x7f1b200d1050 2024-09-16T15:38:43.550 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.546+0000 7f1b2618a640 1 -- 172.21.15.98:0/1990298383 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b200cff60 con 0x7f1b200d1050 2024-09-16T15:38:43.551 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.547+0000 7f1b07fff640 1 -- 172.21.15.98:0/1990298383 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 7) ==== 101440+0+0 (secure 0 0 0) 0x7f1b10018020 con 0x7f1b200d1050 2024-09-16T15:38:43.551 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.547+0000 7f1b07fff640 1 --2- 172.21.15.98:0/1990298383 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f1b0c078a00 0x7f1b0c07aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:43.551 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.547+0000 7f1b07fff640 1 -- 172.21.15.98:0/1990298383 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f1b1009a880 con 0x7f1b200d1050 2024-09-16T15:38:43.551 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.548+0000 7f1b1effd640 1 --2- 172.21.15.98:0/1990298383 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f1b0c078a00 0x7f1b0c07aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:43.551 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.548+0000 7f1b1effd640 1 --2- 172.21.15.98:0/1990298383 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f1b0c078a00 0x7f1b0c07aec0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1b200cdba0 tx=0x7f1b14009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:43.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.551+0000 7f1b07fff640 1 -- 172.21.15.98:0/1990298383 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7f1b1001f030 con 0x7f1b200d1050 2024-09-16T15:38:43.731 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.729+0000 7f1b2618a640 1 -- 172.21.15.98:0/1990298383 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1b2015d0f0 con 0x7f1b200d1050 2024-09-16T15:38:43.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.730+0000 7f1b07fff640 1 -- 172.21.15.98:0/1990298383 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16681 (secure 0 0 0) 0x7f1b10062b60 con 0x7f1b200d1050 2024-09-16T15:38:43.733 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:38:43.733 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":34,"fsid":"52a38a45-21d2-4cb0-bb3a-4fb8be3a08df","created":"2024-09-16T15:37:20.387654+0000","modified":"2024-09-16T15:38:26.079177+0000","last_up_change":"2024-09-16T15:37:33.417470+0000","last_in_change":"2024-09-16T15:37:23.430578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T15:37:34.725090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-16T15:38:22.261968+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-16T15:38:23.379099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a2d61df4-2577-47e6-a4ac-c36bbb85ab8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1967099790},{"type":"v1","addr":"172.21.15.98:6825","nonce":1967099790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1967099790},{"type":"v1","addr":"172.21.15.98:6827","nonce":1967099790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":1967099790},{"type":"v1","addr":"172.21.15.98:6831","nonce":1967099790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1967099790},{"type":"v1","addr":"172.21.15.98:6829","nonce":1967099790}]},"public_addr":"172.21.15.98:6825/1967099790","cluster_addr":"172.21.15.98:6827/1967099790","heartbeat_back_addr":"172.21.15.98:6831/1967099790","heartbeat_front_addr":"172.21.15.98:6829/1967099790","state":["exists","up"]},{"osd":1,"uuid":"bb3a68a5-c22f-442b-b292-7c272fe01ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":3571460482},{"type":"v1","addr":"172.21.15.98:6809","nonce":3571460482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":3571460482},{"type":"v1","addr":"172.21.15.98:6811","nonce":3571460482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":3571460482},{"type":"v1","addr":"172.21.15.98:6815","nonce":3571460482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":3571460482},{"type":"v1","addr":"172.21.15.98:6813","nonce":3571460482}]},"public_addr":"172.21.15.98:6809/3571460482","cluster_addr":"172.21.15.98:6811/3571460482","heartbeat_back_addr":"172.21.15.98:6815/3571460482","heartbeat_front_addr":"172.21.15.98:6813/3571460482","state":["exists","up"]},{"osd":2,"uuid":"c8429195-a480-409b-8e5f-8dc4c6abc0a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":2573210695},{"type":"v1","addr":"172.21.15.98:6801","nonce":2573210695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":2573210695},{"type":"v1","addr":"172.21.15.98:6803","nonce":2573210695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":2573210695},{"type":"v1","addr":"172.21.15.98:6807","nonce":2573210695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":2573210695},{"type":"v1","addr":"172.21.15.98:6805","nonce":2573210695}]},"public_addr":"172.21.15.98:6801/2573210695","cluster_addr":"172.21.15.98:6803/2573210695","heartbeat_back_addr":"172.21.15.98:6807/2573210695","heartbeat_front_addr":"172.21.15.98:6805/2573210695","state":["exists","up"]},{"osd":3,"uuid":"0e800d7b-096f-4f65-b3cc-c7cda3870de4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":3951374837},{"type":"v1","addr":"172.21.15.98:6817","nonce":3951374837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":3951374837},{"type":"v1","addr":"172.21.15.98:6819","nonce":3951374837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":3951374837},{"type":"v1","addr":"172.21.15.98:6823","nonce":3951374837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":3951374837},{"type":"v1","addr":"172.21.15.98:6821","nonce":3951374837}]},"public_addr":"172.21.15.98:6817/3951374837","cluster_addr":"172.21.15.98:6819/3951374837","heartbeat_back_addr":"172.21.15.98:6823/3951374837","heartbeat_front_addr":"172.21.15.98:6821/3951374837","state":["exists","up"]},{"osd":4,"uuid":"c7822e9b-8e29-48d9-b92a-e8f9c7bc5247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":724302036},{"type":"v1","addr":"172.21.15.135:6811","nonce":724302036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":724302036},{"type":"v1","addr":"172.21.15.135:6813","nonce":724302036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":724302036},{"type":"v1","addr":"172.21.15.135:6817","nonce":724302036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":724302036},{"type":"v1","addr":"172.21.15.135:6815","nonce":724302036}]},"public_addr":"172.21.15.135:6811/724302036","cluster_addr":"172.21.15.135:6813/724302036","heartbeat_back_addr":"172.21.15.135:6817/724302036","heartbeat_front_addr":"172.21.15.135:6815/724302036","state":["exists","up"]},{"osd":5,"uuid":"35805e02-484a-4404-a78f-aa44f4daa41f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3083482635},{"type":"v1","addr":"172.21.15.135:6803","nonce":3083482635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3083482635},{"type":"v1","addr":"172.21.15.135:6805","nonce":3083482635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3083482635},{"type":"v1","addr":"172.21.15.135:6809","nonce":3083482635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3083482635},{"type":"v1","addr":"172.21.15.135:6807","nonce":3083482635}]},"public_addr":"172.21.15.135:6803/3083482635","cluster_addr":"172.21.15.135:6805/3083482635","heartbeat_back_addr":"172.21.15.135:6809/3083482635","heartbeat_front_addr":"172.21.15.135:6807/3083482635","state":["exists","up"]},{"osd":6,"uuid":"6327ba84-aaeb-41fa-9717-188988ff2c4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3376376340},{"type":"v1","addr":"172.21.15.135:6819","nonce":3376376340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3376376340},{"type":"v1","addr":"172.21.15.135:6821","nonce":3376376340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":3376376340},{"type":"v1","addr":"172.21.15.135:6825","nonce":3376376340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3376376340},{"type":"v1","addr":"172.21.15.135:6823","nonce":3376376340}]},"public_addr":"172.21.15.135:6819/3376376340","cluster_addr":"172.21.15.135:6821/3376376340","heartbeat_back_addr":"172.21.15.135:6825/3376376340","heartbeat_front_addr":"172.21.15.135:6823/3376376340","state":["exists","up"]},{"osd":7,"uuid":"392d0958-dff9-4248-b3d8-a1201c10f354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2559837727},{"type":"v1","addr":"172.21.15.135:6827","nonce":2559837727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2559837727},{"type":"v1","addr":"172.21.15.135:6829","nonce":2559837727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":2559837727},{"type":"v1","addr":"172.21.15.135:6833","nonce":2559837727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2559837727},{"type":"v1","addr":"172.21.15.135:6831","nonce":2559837727}]},"public_addr":"172.21.15.135:6827/2559837727","cluster_addr":"172.21.15.135:6829/2559837727","heartbeat_back_addr":"172.21.15.135:6833/2559837727","heartbeat_front_addr":"172.21.15.135:6831/2559837727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.939904+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.717296+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.785817+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:30.211718+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.973359+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:30.250109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.699327+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:30.173063+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T15:38:43.735 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.733+0000 7f1b2618a640 1 -- 172.21.15.98:0/1990298383 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f1b0c078a00 msgr2=0x7f1b0c07aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:43.735 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.733+0000 7f1b2618a640 1 --2- 172.21.15.98:0/1990298383 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f1b0c078a00 0x7f1b0c07aec0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1b200cdba0 tx=0x7f1b14009040 comp rx=0 tx=0).stop 2024-09-16T15:38:43.735 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.733+0000 7f1b2618a640 1 -- 172.21.15.98:0/1990298383 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1b200d1050 msgr2=0x7f1b200c7ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:43.735 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.733+0000 7f1b2618a640 1 --2- 172.21.15.98:0/1990298383 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1b200d1050 0x7f1b200c7ad0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f1b1000b3f0 tx=0x7f1b1000b8b0 comp rx=0 tx=0).stop 2024-09-16T15:38:43.735 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.733+0000 7f1b2618a640 1 -- 172.21.15.98:0/1990298383 shutdown_connections 2024-09-16T15:38:43.735 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.733+0000 7f1b2618a640 1 --2- 172.21.15.98:0/1990298383 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f1b0c078a00 0x7f1b0c07aec0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:43.735 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.733+0000 7f1b2618a640 1 --2- 172.21.15.98:0/1990298383 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b2015e090 0x7f1b201f8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:43.735 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.733+0000 7f1b2618a640 1 --2- 172.21.15.98:0/1990298383 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1b200d4ac0 0x7f1b201f82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:43.736 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.733+0000 7f1b2618a640 1 --2- 172.21.15.98:0/1990298383 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1b200d1050 0x7f1b200c7ad0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:43.736 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.733+0000 7f1b2618a640 1 -- 172.21.15.98:0/1990298383 >> 172.21.15.98:0/1990298383 conn(0x7f1b200d3fa0 msgr2=0x7f1b200b0fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:43.736 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.733+0000 7f1b2618a640 1 -- 172.21.15.98:0/1990298383 shutdown_connections 2024-09-16T15:38:43.736 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.733+0000 7f1b2618a640 1 -- 172.21.15.98:0/1990298383 wait complete. 2024-09-16T15:38:43.746 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-16T15:38:43.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.847+0000 7f14048fe640 1 -- 172.21.15.98:0/385533950 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f13ec0051c0 msgr2=0x7f13ec00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:43.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.847+0000 7f14048fe640 1 --2- 172.21.15.98:0/385533950 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f13ec0051c0 0x7f13ec00b9c0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f13f8009b50 tx=0x7f13ec005830 comp rx=0 tx=0).stop 2024-09-16T15:38:43.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.847+0000 7f14048fe640 1 -- 172.21.15.98:0/385533950 shutdown_connections 2024-09-16T15:38:43.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.847+0000 7f14048fe640 1 --2- 172.21.15.98:0/385533950 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f13ec0051c0 0x7f13ec00b9c0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:43.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.847+0000 7f14048fe640 1 -- 172.21.15.98:0/385533950 >> 172.21.15.98:0/385533950 conn(0x7f14000d0d40 msgr2=0x7f14000d1120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:43.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.847+0000 7f14048fe640 1 -- 172.21.15.98:0/385533950 shutdown_connections 2024-09-16T15:38:43.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.847+0000 7f14048fe640 1 -- 172.21.15.98:0/385533950 wait complete. 2024-09-16T15:38:43.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.848+0000 7f14048fe640 1 Processor -- start 2024-09-16T15:38:43.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.848+0000 7f14048fe640 1 -- start start 2024-09-16T15:38:43.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.849+0000 7f14048fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13ec0051c0 0x7f1400148d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:43.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.849+0000 7f14048fe640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1400155450 0x7f14001f8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:43.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.849+0000 7f14048fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f14001f8580 0x7f14001f8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:43.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.849+0000 7f14048fe640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f14000cf830 con 0x7f14001f8580 2024-09-16T15:38:43.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.849+0000 7f14048fe640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1400071a70 con 0x7f13ec0051c0 2024-09-16T15:38:43.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.849+0000 7f14048fe640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f14000cf9b0 con 0x7f1400155450 2024-09-16T15:38:43.853 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.849+0000 7f13fed9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f14001f8580 0x7f14001f8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:43.853 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.849+0000 7f13fed9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f14001f8580 0x7f14001f8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42638/0 (socket says 172.21.15.98:42638) 2024-09-16T15:38:43.853 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.849+0000 7f13fed9d640 1 -- 172.21.15.98:0/1993722364 learned_addr learned my addr 172.21.15.98:0/1993722364 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:43.853 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.849+0000 7f13fdd9b640 1 --2- 172.21.15.98:0/1993722364 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1400155450 0x7f14001f8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:43.853 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.849+0000 7f13fe59c640 1 --2- 172.21.15.98:0/1993722364 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13ec0051c0 0x7f1400148d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:43.853 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.849+0000 7f13fed9d640 1 -- 172.21.15.98:0/1993722364 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1400155450 msgr2=0x7f14001f8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:43.853 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.849+0000 7f13fed9d640 1 --2- 172.21.15.98:0/1993722364 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1400155450 0x7f14001f8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:43.853 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.849+0000 7f13fed9d640 1 -- 172.21.15.98:0/1993722364 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13ec0051c0 msgr2=0x7f1400148d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:43.853 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.849+0000 7f13fed9d640 1 --2- 172.21.15.98:0/1993722364 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13ec0051c0 0x7f1400148d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:43.853 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.849+0000 7f13fed9d640 1 -- 172.21.15.98:0/1993722364 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14000b47d0 con 0x7f14001f8580 2024-09-16T15:38:43.853 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.850+0000 7f13fed9d640 1 --2- 172.21.15.98:0/1993722364 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f14001f8580 0x7f14001f8a30 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f13f8009c70 tx=0x7f13f8009720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:43.853 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.850+0000 7f13f6ffd640 1 -- 172.21.15.98:0/1993722364 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13f80035f0 con 0x7f14001f8580 2024-09-16T15:38:43.853 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.850+0000 7f13f6ffd640 1 -- 172.21.15.98:0/1993722364 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f13f8040070 con 0x7f14001f8580 2024-09-16T15:38:43.854 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.850+0000 7f14048fe640 1 -- 172.21.15.98:0/1993722364 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14000b4ab0 con 0x7f14001f8580 2024-09-16T15:38:43.854 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.850+0000 7f13f6ffd640 1 -- 172.21.15.98:0/1993722364 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13f8003a50 con 0x7f14001f8580 2024-09-16T15:38:43.854 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.850+0000 7f14048fe640 1 -- 172.21.15.98:0/1993722364 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14000b5070 con 0x7f14001f8580 2024-09-16T15:38:43.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.851+0000 7f14048fe640 1 -- 172.21.15.98:0/1993722364 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1400073900 con 0x7f14001f8580 2024-09-16T15:38:43.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.851+0000 7f13f6ffd640 1 -- 172.21.15.98:0/1993722364 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 7) ==== 101440+0+0 (secure 0 0 0) 0x7f13f8003bf0 con 0x7f14001f8580 2024-09-16T15:38:43.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.852+0000 7f13f6ffd640 1 --2- 172.21.15.98:0/1993722364 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f13e0078a30 0x7f13e007aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:43.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.852+0000 7f13f6ffd640 1 -- 172.21.15.98:0/1993722364 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f13f80bb330 con 0x7f14001f8580 2024-09-16T15:38:43.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.852+0000 7f13fe59c640 1 --2- 172.21.15.98:0/1993722364 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f13e0078a30 0x7f13e007aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:43.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.853+0000 7f13fe59c640 1 --2- 172.21.15.98:0/1993722364 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f13e0078a30 0x7f13e007aef0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f13f0001370 tx=0x7f13f0006040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:43.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:43.856+0000 7f13f6ffd640 1 -- 172.21.15.98:0/1993722364 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7f13f8082f40 con 0x7f14001f8580 2024-09-16T15:38:44.070 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:44.068+0000 7f14048fe640 1 -- 172.21.15.98:0/1993722364 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f14000c63a0 con 0x7f14001f8580 2024-09-16T15:38:44.070 INFO:tasks.ceph.mon.a.smithi098.stderr:2024-09-16T15:38:44.068+0000 7f7b90b34640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-16T15:38:44.071 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:44.070+0000 7f13f6ffd640 1 -- 172.21.15.98:0/1993722364 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v17) ==== 161+0+0 (secure 0 0 0) 0x7f13f8087970 con 0x7f14001f8580 2024-09-16T15:38:44.072 INFO:teuthology.orchestra.run.smithi098.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-16T15:38:44.075 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:44.072+0000 7f14048fe640 1 -- 172.21.15.98:0/1993722364 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f13e0078a30 msgr2=0x7f13e007aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:44.075 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:44.072+0000 7f14048fe640 1 --2- 172.21.15.98:0/1993722364 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f13e0078a30 0x7f13e007aef0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f13f0001370 tx=0x7f13f0006040 comp rx=0 tx=0).stop 2024-09-16T15:38:44.075 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:44.072+0000 7f14048fe640 1 -- 172.21.15.98:0/1993722364 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f14001f8580 msgr2=0x7f14001f8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:44.075 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:44.072+0000 7f14048fe640 1 --2- 172.21.15.98:0/1993722364 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f14001f8580 0x7f14001f8a30 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f13f8009c70 tx=0x7f13f8009720 comp rx=0 tx=0).stop 2024-09-16T15:38:44.075 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:44.073+0000 7f14048fe640 1 -- 172.21.15.98:0/1993722364 shutdown_connections 2024-09-16T15:38:44.075 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:44.073+0000 7f14048fe640 1 --2- 172.21.15.98:0/1993722364 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f14001f8580 0x7f14001f8a30 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:44.075 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:44.073+0000 7f14048fe640 1 --2- 172.21.15.98:0/1993722364 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1400155450 0x7f14001f8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:44.075 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:44.073+0000 7f14048fe640 1 --2- 172.21.15.98:0/1993722364 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f13e0078a30 0x7f13e007aef0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:44.075 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:44.073+0000 7f14048fe640 1 --2- 172.21.15.98:0/1993722364 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13ec0051c0 0x7f1400148d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:44.075 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:44.073+0000 7f14048fe640 1 -- 172.21.15.98:0/1993722364 >> 172.21.15.98:0/1993722364 conn(0x7f14000d0d40 msgr2=0x7f14000c6ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:44.075 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:44.073+0000 7f14048fe640 1 -- 172.21.15.98:0/1993722364 shutdown_connections 2024-09-16T15:38:44.075 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:44.073+0000 7f14048fe640 1 -- 172.21.15.98:0/1993722364 wait complete. 2024-09-16T15:38:44.086 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-16T15:38:44.112 INFO:tasks.ceph.mds.a.smithi098.stdout:starting mds.a at 2024-09-16T15:38:44.191 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:44.189+0000 7f3f222e6640 1 -- 172.21.15.98:0/1654428747 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f1c0cccd0 msgr2=0x7f3f1c073440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:44.191 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:44.189+0000 7f3f222e6640 1 --2- 172.21.15.98:0/1654428747 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f1c0cccd0 0x7f3f1c073440 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f3f10005fd0 tx=0x7f3f1002a540 comp rx=0 tx=0).stop 2024-09-16T15:38:44.191 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:44.189+0000 7f3f222e6640 1 -- 172.21.15.98:0/1654428747 shutdown_connections 2024-09-16T15:38:44.191 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:44.189+0000 7f3f222e6640 1 --2- 172.21.15.98:0/1654428747 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f1c0cccd0 0x7f3f1c073440 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:44.191 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:44.189+0000 7f3f222e6640 1 -- 172.21.15.98:0/1654428747 >> 172.21.15.98:0/1654428747 conn(0x7f3f1c0b1840 msgr2=0x7f3f1c0b1c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:44.191 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:44.189+0000 7f3f222e6640 1 -- 172.21.15.98:0/1654428747 shutdown_connections 2024-09-16T15:38:44.191 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:44.189+0000 7f3f222e6640 1 -- 172.21.15.98:0/1654428747 wait complete. 2024-09-16T15:38:44.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:44.190+0000 7f3f222e6640 1 Processor -- start 2024-09-16T15:38:44.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:44.190+0000 7f3f222e6640 1 -- start start 2024-09-16T15:38:44.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:44.191+0000 7f3f222e6640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3f1c06efa0 0x7f3f1c0cba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:44.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:44.191+0000 7f3f222e6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3f1c0cccd0 0x7f3f1c0cbf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:44.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:44.191+0000 7f3f222e6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f1c145750 0x7f3f1c131230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:44.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:44.191+0000 7f3f222e6640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3f1c0ce6a0 con 0x7f3f1c145750 2024-09-16T15:38:44.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:44.191+0000 7f3f222e6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3f1c0ce520 con 0x7f3f1c0cccd0 2024-09-16T15:38:44.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:44.191+0000 7f3f222e6640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f3f1c0ce820 con 0x7f3f1c06efa0 2024-09-16T15:38:44.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:44.191+0000 7f3f20883640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f1c145750 0x7f3f1c131230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:44.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:44.191+0000 7f3f20883640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f1c145750 0x7f3f1c131230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42670/0 (socket says 172.21.15.98:42670) 2024-09-16T15:38:44.195 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:44.191+0000 7f3f20883640 1 -- 172.21.15.98:0/341115218 learned_addr learned my addr 172.21.15.98:0/341115218 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:44.195 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:44.191+0000 7f3f1b7fe640 1 --2- 172.21.15.98:0/341115218 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3f1c0cccd0 0x7f3f1c0cbf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:44.195 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:44.191+0000 7f3f1bfff640 1 --2- 172.21.15.98:0/341115218 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3f1c06efa0 0x7f3f1c0cba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:44.195 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:44.191+0000 7f3f20883640 1 -- 172.21.15.98:0/341115218 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3f1c06efa0 msgr2=0x7f3f1c0cba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:44.195 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:44.191+0000 7f3f20883640 1 --2- 172.21.15.98:0/341115218 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3f1c06efa0 0x7f3f1c0cba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:44.195 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:44.191+0000 7f3f20883640 1 -- 172.21.15.98:0/341115218 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3f1c0cccd0 msgr2=0x7f3f1c0cbf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:44.195 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:44.191+0000 7f3f20883640 1 --2- 172.21.15.98:0/341115218 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3f1c0cccd0 0x7f3f1c0cbf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:44.195 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:44.191+0000 7f3f20883640 1 -- 172.21.15.98:0/341115218 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f1c0c4f10 con 0x7f3f1c145750 2024-09-16T15:38:44.195 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:44.191+0000 7f3f20883640 1 --2- 172.21.15.98:0/341115218 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f1c145750 0x7f3f1c131230 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f3f1400c780 tx=0x7f3f1400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:44.195 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:44.192+0000 7f3f18ff9640 1 -- 172.21.15.98:0/341115218 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f14004b60 con 0x7f3f1c145750 2024-09-16T15:38:44.195 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:44.192+0000 7f3f18ff9640 1 -- 172.21.15.98:0/341115218 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3f14004df0 con 0x7f3f1c145750 2024-09-16T15:38:44.195 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:44.192+0000 7f3f222e6640 1 -- 172.21.15.98:0/341115218 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f1c12efd0 con 0x7f3f1c145750 2024-09-16T15:38:44.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:44.192+0000 7f3f18ff9640 1 -- 172.21.15.98:0/341115218 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f1400aa70 con 0x7f3f1c145750 2024-09-16T15:38:44.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:44.192+0000 7f3f222e6640 1 -- 172.21.15.98:0/341115218 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f1c12f590 con 0x7f3f1c145750 2024-09-16T15:38:44.197 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:44.193+0000 7f3f222e6640 1 -- 172.21.15.98:0/341115218 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f1c0cecd0 con 0x7f3f1c145750 2024-09-16T15:38:44.197 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:44.193+0000 7f3f18ff9640 1 -- 172.21.15.98:0/341115218 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 7) ==== 101440+0+0 (secure 0 0 0) 0x7f3f1400ac10 con 0x7f3f1c145750 2024-09-16T15:38:44.197 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:44.194+0000 7f3f18ff9640 1 --2- 172.21.15.98:0/341115218 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f3f08078a00 0x7f3f0807aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:44.197 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:44.194+0000 7f3f18ff9640 1 -- 172.21.15.98:0/341115218 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5795+0+0 (secure 0 0 0) 0x7f3f1409ade0 con 0x7f3f1c145750 2024-09-16T15:38:44.197 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:44.194+0000 7f3f1bfff640 1 --2- 172.21.15.98:0/341115218 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f3f08078a00 0x7f3f0807aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:44.197 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:44.194+0000 7f3f1bfff640 1 --2- 172.21.15.98:0/341115218 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f3f08078a00 0x7f3f0807aec0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c001720 tx=0x7f3f0c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:44.200 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:44.198+0000 7f3f18ff9640 1 -- 172.21.15.98:0/341115218 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7f3f14020070 con 0x7f3f1c145750 2024-09-16T15:38:44.411 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:44.409+0000 7f3f222e6640 1 -- 172.21.15.98:0/341115218 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f3f1c144f70 con 0x7f3f1c145750 2024-09-16T15:38:45.073 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:45.071+0000 7f3f18ff9640 1 -- 172.21.15.98:0/341115218 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v18) ==== 104+0+0 (secure 0 0 0) 0x7f3f14062aa0 con 0x7f3f1c145750 2024-09-16T15:38:45.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:45.074+0000 7f3f222e6640 1 -- 172.21.15.98:0/341115218 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f3f08078a00 msgr2=0x7f3f0807aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:45.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:45.074+0000 7f3f222e6640 1 --2- 172.21.15.98:0/341115218 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f3f08078a00 0x7f3f0807aec0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c001720 tx=0x7f3f0c009040 comp rx=0 tx=0).stop 2024-09-16T15:38:45.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:45.074+0000 7f3f222e6640 1 -- 172.21.15.98:0/341115218 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f1c145750 msgr2=0x7f3f1c131230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:45.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:45.074+0000 7f3f222e6640 1 --2- 172.21.15.98:0/341115218 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f1c145750 0x7f3f1c131230 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f3f1400c780 tx=0x7f3f1400cc40 comp rx=0 tx=0).stop 2024-09-16T15:38:45.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:45.074+0000 7f3f222e6640 1 -- 172.21.15.98:0/341115218 shutdown_connections 2024-09-16T15:38:45.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:45.074+0000 7f3f222e6640 1 --2- 172.21.15.98:0/341115218 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3f1c145750 0x7f3f1c131230 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:45.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:45.074+0000 7f3f222e6640 1 --2- 172.21.15.98:0/341115218 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f3f08078a00 0x7f3f0807aec0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:45.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:45.074+0000 7f3f222e6640 1 --2- 172.21.15.98:0/341115218 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3f1c0cccd0 0x7f3f1c0cbf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:45.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:45.074+0000 7f3f222e6640 1 --2- 172.21.15.98:0/341115218 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3f1c06efa0 0x7f3f1c0cba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:45.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:45.074+0000 7f3f222e6640 1 -- 172.21.15.98:0/341115218 >> 172.21.15.98:0/341115218 conn(0x7f3f1c0b1840 msgr2=0x7f3f1c143e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:45.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:45.074+0000 7f3f222e6640 1 -- 172.21.15.98:0/341115218 shutdown_connections 2024-09-16T15:38:45.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:45.074+0000 7f3f222e6640 1 -- 172.21.15.98:0/341115218 wait complete. 2024-09-16T15:38:45.089 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-16T15:38:45.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:45.236+0000 7fd7c7dbc640 1 -- 172.21.15.98:0/3210303456 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7ac003a30 msgr2=0x7fd7ac003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:45.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:45.236+0000 7fd7c7dbc640 1 --2- 172.21.15.98:0/3210303456 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7ac003a30 0x7fd7ac003e50 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc001660 tx=0x7fd7ac005830 comp rx=0 tx=0).stop 2024-09-16T15:38:45.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:45.236+0000 7fd7c6359640 1 -- 172.21.15.98:0/3210303456 reap_dead start 2024-09-16T15:38:45.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:45.236+0000 7fd7c7dbc640 1 -- 172.21.15.98:0/3210303456 shutdown_connections 2024-09-16T15:38:45.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:45.236+0000 7fd7c7dbc640 1 -- 172.21.15.98:0/3210303456 >> 172.21.15.98:0/3210303456 conn(0x7fd7c00b18e0 msgr2=0x7fd7c00b1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:45.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:45.236+0000 7fd7c7dbc640 1 -- 172.21.15.98:0/3210303456 shutdown_connections 2024-09-16T15:38:45.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:45.236+0000 7fd7c7dbc640 1 -- 172.21.15.98:0/3210303456 wait complete. 2024-09-16T15:38:45.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:45.237+0000 7fd7c7dbc640 1 Processor -- start 2024-09-16T15:38:45.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:45.237+0000 7fd7c7dbc640 1 -- start start 2024-09-16T15:38:45.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:45.238+0000 7fd7c7dbc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7ac003a30 0x7fd7c014e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:45.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:45.238+0000 7fd7c7dbc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7c01560d0 0x7fd7c0154530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:45.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:45.238+0000 7fd7c7dbc640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd7c0154a70 0x7fd7c009ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:45.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:45.238+0000 7fd7c7dbc640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd7c00cdc50 con 0x7fd7c01560d0 2024-09-16T15:38:45.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:45.238+0000 7fd7c7dbc640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd7c00cdad0 con 0x7fd7ac003a30 2024-09-16T15:38:45.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:45.238+0000 7fd7c7dbc640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fd7c00cc650 con 0x7fd7c0154a70 2024-09-16T15:38:45.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:45.238+0000 7fd7c5357640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7c01560d0 0x7fd7c0154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:45.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:45.238+0000 7fd7c5357640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7c01560d0 0x7fd7c0154530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60076/0 (socket says 172.21.15.98:60076) 2024-09-16T15:38:45.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:45.238+0000 7fd7c5357640 1 -- 172.21.15.98:0/1891136052 learned_addr learned my addr 172.21.15.98:0/1891136052 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:45.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:45.238+0000 7fd7c5b58640 1 --2- 172.21.15.98:0/1891136052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7ac003a30 0x7fd7c014e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:45.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:45.238+0000 7fd7c6359640 1 --2- 172.21.15.98:0/1891136052 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd7c0154a70 0x7fd7c009ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:45.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:45.238+0000 7fd7c5357640 1 -- 172.21.15.98:0/1891136052 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd7c0154a70 msgr2=0x7fd7c009ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:45.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:45.238+0000 7fd7c5357640 1 --2- 172.21.15.98:0/1891136052 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd7c0154a70 0x7fd7c009ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:45.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:45.238+0000 7fd7c5357640 1 -- 172.21.15.98:0/1891136052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7ac003a30 msgr2=0x7fd7c014e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:45.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:45.238+0000 7fd7c5357640 1 --2- 172.21.15.98:0/1891136052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7ac003a30 0x7fd7c014e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:45.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:45.238+0000 7fd7c5357640 1 -- 172.21.15.98:0/1891136052 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7c0151920 con 0x7fd7c01560d0 2024-09-16T15:38:45.244 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:45.238+0000 7fd7c5b58640 1 --2- 172.21.15.98:0/1891136052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7ac003a30 0x7fd7c014e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T15:38:45.244 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:45.238+0000 7fd7c6359640 1 --2- 172.21.15.98:0/1891136052 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd7c0154a70 0x7fd7c009ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T15:38:45.244 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:45.238+0000 7fd7c5357640 1 --2- 172.21.15.98:0/1891136052 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7c01560d0 0x7fd7c0154530 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fd7b000e570 tx=0x7fd7b000ea30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:45.244 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:45.239+0000 7fd7b67fc640 1 -- 172.21.15.98:0/1891136052 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b0015070 con 0x7fd7c01560d0 2024-09-16T15:38:45.244 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:45.239+0000 7fd7b67fc640 1 -- 172.21.15.98:0/1891136052 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd7b0010980 con 0x7fd7c01560d0 2024-09-16T15:38:45.244 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:45.239+0000 7fd7c7dbc640 1 -- 172.21.15.98:0/1891136052 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7c0156570 con 0x7fd7c01560d0 2024-09-16T15:38:45.244 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:45.239+0000 7fd7b67fc640 1 -- 172.21.15.98:0/1891136052 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b0010d70 con 0x7fd7c01560d0 2024-09-16T15:38:45.244 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:45.239+0000 7fd7c7dbc640 1 -- 172.21.15.98:0/1891136052 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7c0156850 con 0x7fd7c01560d0 2024-09-16T15:38:45.244 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:45.239+0000 7fd7c7dbc640 1 -- 172.21.15.98:0/1891136052 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7c0069360 con 0x7fd7c01560d0 2024-09-16T15:38:45.244 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:45.240+0000 7fd7b67fc640 1 -- 172.21.15.98:0/1891136052 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 7) ==== 101440+0+0 (secure 0 0 0) 0x7fd7b0018070 con 0x7fd7c01560d0 2024-09-16T15:38:45.244 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:45.241+0000 7fd7b67fc640 1 --2- 172.21.15.98:0/1891136052 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fd7a4078a00 0x7fd7a407aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:45.244 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:45.241+0000 7fd7b67fc640 1 -- 172.21.15.98:0/1891136052 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5795+0+0 (secure 0 0 0) 0x7fd7b009b1a0 con 0x7fd7c01560d0 2024-09-16T15:38:45.245 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:45.241+0000 7fd7c5b58640 1 --2- 172.21.15.98:0/1891136052 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fd7a4078a00 0x7fd7a407aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:45.245 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:45.241+0000 7fd7c5b58640 1 --2- 172.21.15.98:0/1891136052 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fd7a4078a00 0x7fd7a407aec0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc032000 tx=0x7fd7bc001190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:45.246 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:45.245+0000 7fd7b67fc640 1 -- 172.21.15.98:0/1891136052 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7fd7b0063420 con 0x7fd7c01560d0 2024-09-16T15:38:45.423 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:45.421+0000 7fd7c7dbc640 1 -- 172.21.15.98:0/1891136052 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fd7c00ccbb0 con 0x7fd7c01560d0 2024-09-16T15:38:46.148 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:46.146+0000 7fd7b67fc640 1 -- 172.21.15.98:0/1891136052 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v36) ==== 181+0+0 (secure 0 0 0) 0x7fd7b0062d20 con 0x7fd7c01560d0 2024-09-16T15:38:46.148 INFO:teuthology.orchestra.run.smithi098.stderr:pool 'cephfs_metadata' removed 2024-09-16T15:38:46.153 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:46.151+0000 7fd7c7dbc640 1 -- 172.21.15.98:0/1891136052 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fd7a4078a00 msgr2=0x7fd7a407aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:46.154 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:46.151+0000 7fd7c7dbc640 1 --2- 172.21.15.98:0/1891136052 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fd7a4078a00 0x7fd7a407aec0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc032000 tx=0x7fd7bc001190 comp rx=0 tx=0).stop 2024-09-16T15:38:46.154 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:46.151+0000 7fd7c7dbc640 1 -- 172.21.15.98:0/1891136052 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7c01560d0 msgr2=0x7fd7c0154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:46.154 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:46.151+0000 7fd7c7dbc640 1 --2- 172.21.15.98:0/1891136052 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7c01560d0 0x7fd7c0154530 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fd7b000e570 tx=0x7fd7b000ea30 comp rx=0 tx=0).stop 2024-09-16T15:38:46.154 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:46.151+0000 7fd7c7dbc640 1 -- 172.21.15.98:0/1891136052 shutdown_connections 2024-09-16T15:38:46.154 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:46.151+0000 7fd7c7dbc640 1 --2- 172.21.15.98:0/1891136052 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd7c0154a70 0x7fd7c009ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:46.154 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:46.151+0000 7fd7c7dbc640 1 --2- 172.21.15.98:0/1891136052 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7c01560d0 0x7fd7c0154530 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:46.154 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:46.151+0000 7fd7c7dbc640 1 --2- 172.21.15.98:0/1891136052 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fd7a4078a00 0x7fd7a407aec0 secure :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc032000 tx=0x7fd7bc001190 comp rx=0 tx=0).stop 2024-09-16T15:38:46.154 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:46.151+0000 7fd7c7dbc640 1 --2- 172.21.15.98:0/1891136052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7ac003a30 0x7fd7c014e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:46.154 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:46.151+0000 7fd7c7dbc640 1 -- 172.21.15.98:0/1891136052 >> 172.21.15.98:0/1891136052 conn(0x7fd7c00b18e0 msgr2=0x7fd7c00b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:46.154 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:46.151+0000 7fd7c7dbc640 1 -- 172.21.15.98:0/1891136052 shutdown_connections 2024-09-16T15:38:46.154 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:46.151+0000 7fd7c7dbc640 1 -- 172.21.15.98:0/1891136052 wait complete. 2024-09-16T15:38:46.171 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-16T15:38:46.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:46.280+0000 7fb9299a3640 1 -- 172.21.15.98:0/1425027895 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb910004d40 msgr2=0x7fb9100051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:46.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:46.280+0000 7fb9299a3640 1 --2- 172.21.15.98:0/1425027895 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb910004d40 0x7fb9100051c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fb91400c670 tx=0x7fb910005830 comp rx=0 tx=0).stop 2024-09-16T15:38:46.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:46.280+0000 7fb9237fe640 1 -- 172.21.15.98:0/1425027895 reap_dead start 2024-09-16T15:38:46.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:46.280+0000 7fb9299a3640 1 -- 172.21.15.98:0/1425027895 shutdown_connections 2024-09-16T15:38:46.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:46.280+0000 7fb9299a3640 1 -- 172.21.15.98:0/1425027895 >> 172.21.15.98:0/1425027895 conn(0x7fb9240b2960 msgr2=0x7fb9240b2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:46.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:46.280+0000 7fb9299a3640 1 -- 172.21.15.98:0/1425027895 shutdown_connections 2024-09-16T15:38:46.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:46.280+0000 7fb9299a3640 1 -- 172.21.15.98:0/1425027895 wait complete. 2024-09-16T15:38:46.283 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:46.281+0000 7fb9299a3640 1 Processor -- start 2024-09-16T15:38:46.283 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:46.281+0000 7fb9299a3640 1 -- start start 2024-09-16T15:38:46.285 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:46.282+0000 7fb9299a3640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb910004d40 0x7fb924158080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:46.285 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:46.282+0000 7fb9299a3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9241f5a70 0x7fb92414a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:46.285 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:46.282+0000 7fb9299a3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9241f23a0 0x7fb92406cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:46.285 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:46.282+0000 7fb9299a3640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb924071330 con 0x7fb9241f23a0 2024-09-16T15:38:46.285 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:46.282+0000 7fb9299a3640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb924151ff0 con 0x7fb9241f5a70 2024-09-16T15:38:46.285 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:46.282+0000 7fb9299a3640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fb9240714b0 con 0x7fb910004d40 2024-09-16T15:38:46.285 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:46.282+0000 7fb9237fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9241f23a0 0x7fb92406cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:46.286 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:46.282+0000 7fb9237fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9241f23a0 0x7fb92406cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60094/0 (socket says 172.21.15.98:60094) 2024-09-16T15:38:46.286 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:46.282+0000 7fb9237fe640 1 -- 172.21.15.98:0/4113538848 learned_addr learned my addr 172.21.15.98:0/4113538848 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:46.286 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:46.282+0000 7fb922ffd640 1 --2- 172.21.15.98:0/4113538848 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb910004d40 0x7fb924158080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:46.286 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:46.282+0000 7fb9227fc640 1 --2- 172.21.15.98:0/4113538848 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9241f5a70 0x7fb92414a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:46.286 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:46.282+0000 7fb9237fe640 1 -- 172.21.15.98:0/4113538848 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb910004d40 msgr2=0x7fb924158080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:46.286 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:46.282+0000 7fb9237fe640 1 --2- 172.21.15.98:0/4113538848 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb910004d40 0x7fb924158080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:46.286 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:46.282+0000 7fb9237fe640 1 -- 172.21.15.98:0/4113538848 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9241f5a70 msgr2=0x7fb92414a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:46.286 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:46.282+0000 7fb9237fe640 1 --2- 172.21.15.98:0/4113538848 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9241f5a70 0x7fb92414a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:46.286 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:46.282+0000 7fb9237fe640 1 -- 172.21.15.98:0/4113538848 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9241f2dd0 con 0x7fb9241f23a0 2024-09-16T15:38:46.286 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:46.282+0000 7fb9237fe640 1 --2- 172.21.15.98:0/4113538848 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9241f23a0 0x7fb92406cb70 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fb91400c760 tx=0x7fb914001aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:46.286 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:46.282+0000 7fb91bfff640 1 -- 172.21.15.98:0/4113538848 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb914039070 con 0x7fb9241f23a0 2024-09-16T15:38:46.286 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:46.283+0000 7fb91bfff640 1 -- 172.21.15.98:0/4113538848 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb91402bab0 con 0x7fb9241f23a0 2024-09-16T15:38:46.286 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:46.283+0000 7fb9299a3640 1 -- 172.21.15.98:0/4113538848 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9241f30b0 con 0x7fb9241f23a0 2024-09-16T15:38:46.287 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:46.283+0000 7fb91bfff640 1 -- 172.21.15.98:0/4113538848 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb914002030 con 0x7fb9241f23a0 2024-09-16T15:38:46.287 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:46.283+0000 7fb9299a3640 1 -- 172.21.15.98:0/4113538848 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb92414a130 con 0x7fb9241f23a0 2024-09-16T15:38:46.287 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:46.284+0000 7fb9299a3640 1 -- 172.21.15.98:0/4113538848 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9241f32f0 con 0x7fb9241f23a0 2024-09-16T15:38:46.288 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:46.284+0000 7fb91bfff640 1 -- 172.21.15.98:0/4113538848 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 7) ==== 101440+0+0 (secure 0 0 0) 0x7fb91403c070 con 0x7fb9241f23a0 2024-09-16T15:38:46.288 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:46.285+0000 7fb91bfff640 1 --2- 172.21.15.98:0/4113538848 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fb904078a00 0x7fb90407aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:46.288 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:46.285+0000 7fb91bfff640 1 -- 172.21.15.98:0/4113538848 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5357+0+0 (secure 0 0 0) 0x7fb9140ba3d0 con 0x7fb9241f23a0 2024-09-16T15:38:46.288 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:46.285+0000 7fb922ffd640 1 --2- 172.21.15.98:0/4113538848 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fb904078a00 0x7fb90407aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:46.288 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:46.286+0000 7fb922ffd640 1 --2- 172.21.15.98:0/4113538848 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fb904078a00 0x7fb90407aec0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb91c009c50 tx=0x7fb91c005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:46.291 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:46.289+0000 7fb91bfff640 1 -- 172.21.15.98:0/4113538848 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7fb9241f32f0 con 0x7fb9241f23a0 2024-09-16T15:38:46.469 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:46.468+0000 7fb9299a3640 1 -- 172.21.15.98:0/4113538848 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fb9240aeae0 con 0x7fb9241f23a0 2024-09-16T15:38:47.162 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.160+0000 7fb91bfff640 1 -- 172.21.15.98:0/4113538848 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v37) ==== 169+0+0 (secure 0 0 0) 0x7fb914082840 con 0x7fb9241f23a0 2024-09-16T15:38:47.162 INFO:teuthology.orchestra.run.smithi098.stderr:pool 'cephfs_data' removed 2024-09-16T15:38:47.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.163+0000 7fb9299a3640 1 -- 172.21.15.98:0/4113538848 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fb904078a00 msgr2=0x7fb90407aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:47.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.163+0000 7fb9299a3640 1 --2- 172.21.15.98:0/4113538848 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fb904078a00 0x7fb90407aec0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb91c009c50 tx=0x7fb91c005f90 comp rx=0 tx=0).stop 2024-09-16T15:38:47.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.163+0000 7fb9299a3640 1 -- 172.21.15.98:0/4113538848 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9241f23a0 msgr2=0x7fb92406cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:47.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.163+0000 7fb9299a3640 1 --2- 172.21.15.98:0/4113538848 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9241f23a0 0x7fb92406cb70 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fb91400c760 tx=0x7fb914001aa0 comp rx=0 tx=0).stop 2024-09-16T15:38:47.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.164+0000 7fb9299a3640 1 -- 172.21.15.98:0/4113538848 shutdown_connections 2024-09-16T15:38:47.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.164+0000 7fb9299a3640 1 --2- 172.21.15.98:0/4113538848 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9241f23a0 0x7fb92406cb70 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:47.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.164+0000 7fb9299a3640 1 --2- 172.21.15.98:0/4113538848 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fb904078a00 0x7fb90407aec0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:47.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.164+0000 7fb9299a3640 1 --2- 172.21.15.98:0/4113538848 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9241f5a70 0x7fb92414a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:47.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.164+0000 7fb9299a3640 1 --2- 172.21.15.98:0/4113538848 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb910004d40 0x7fb924158080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:47.167 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.164+0000 7fb9299a3640 1 -- 172.21.15.98:0/4113538848 >> 172.21.15.98:0/4113538848 conn(0x7fb9240b2960 msgr2=0x7fb9240ae120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:47.167 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.164+0000 7fb9299a3640 1 -- 172.21.15.98:0/4113538848 shutdown_connections 2024-09-16T15:38:47.167 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.164+0000 7fb9299a3640 1 -- 172.21.15.98:0/4113538848 wait complete. 2024-09-16T15:38:47.179 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 27 2024-09-16T15:38:47.283 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.281+0000 7f8e9442b640 1 -- 172.21.15.98:0/2643370506 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e8c0d2050 msgr2=0x7f8e8c0d10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:47.284 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.281+0000 7f8e9442b640 1 --2- 172.21.15.98:0/2643370506 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e8c0d2050 0x7f8e8c0d10d0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f8e80005fd0 tx=0x7f8e8002a5d0 comp rx=0 tx=0).stop 2024-09-16T15:38:47.284 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.281+0000 7f8e9442b640 1 -- 172.21.15.98:0/2643370506 shutdown_connections 2024-09-16T15:38:47.284 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.281+0000 7f8e9442b640 1 --2- 172.21.15.98:0/2643370506 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e8c0d2050 0x7f8e8c0d10d0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:47.284 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.281+0000 7f8e9442b640 1 -- 172.21.15.98:0/2643370506 >> 172.21.15.98:0/2643370506 conn(0x7f8e8c0d3fe0 msgr2=0x7f8e8c0d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:47.284 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.281+0000 7f8e9442b640 1 -- 172.21.15.98:0/2643370506 shutdown_connections 2024-09-16T15:38:47.284 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.281+0000 7f8e9442b640 1 -- 172.21.15.98:0/2643370506 wait complete. 2024-09-16T15:38:47.284 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.282+0000 7f8e9442b640 1 Processor -- start 2024-09-16T15:38:47.284 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.282+0000 7f8e9442b640 1 -- start start 2024-09-16T15:38:47.286 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.283+0000 7f8e9442b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e8c0d1610 0x7f8e8c14eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:47.286 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.283+0000 7f8e9442b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8e8c0d2050 0x7f8e8c160cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:47.286 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.283+0000 7f8e9442b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e8c15e0d0 0x7f8e8c161200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:47.286 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.283+0000 7f8e9442b640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8e8c0cf870 con 0x7f8e8c0d1610 2024-09-16T15:38:47.286 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.283+0000 7f8e9442b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8e8c0cf6f0 con 0x7f8e8c15e0d0 2024-09-16T15:38:47.286 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.283+0000 7f8e9442b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f8e8c0cf9f0 con 0x7f8e8c0d2050 2024-09-16T15:38:47.287 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.283+0000 7f8e921c7640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e8c0d1610 0x7f8e8c14eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:47.287 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.283+0000 7f8e921c7640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e8c0d1610 0x7f8e8c14eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60102/0 (socket says 172.21.15.98:60102) 2024-09-16T15:38:47.287 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.283+0000 7f8e921c7640 1 -- 172.21.15.98:0/1240688834 learned_addr learned my addr 172.21.15.98:0/1240688834 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:47.287 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.283+0000 7f8e929c8640 1 --2- 172.21.15.98:0/1240688834 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e8c15e0d0 0x7f8e8c161200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:47.287 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.283+0000 7f8e919c6640 1 --2- 172.21.15.98:0/1240688834 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8e8c0d2050 0x7f8e8c160cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:47.287 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.283+0000 7f8e921c7640 1 -- 172.21.15.98:0/1240688834 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8e8c0d2050 msgr2=0x7f8e8c160cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:47.287 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.283+0000 7f8e921c7640 1 --2- 172.21.15.98:0/1240688834 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8e8c0d2050 0x7f8e8c160cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:47.287 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.284+0000 7f8e921c7640 1 -- 172.21.15.98:0/1240688834 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e8c15e0d0 msgr2=0x7f8e8c161200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:47.287 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.284+0000 7f8e921c7640 1 --2- 172.21.15.98:0/1240688834 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e8c15e0d0 0x7f8e8c161200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:47.287 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.284+0000 7f8e921c7640 1 -- 172.21.15.98:0/1240688834 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e8c14f4f0 con 0x7f8e8c0d1610 2024-09-16T15:38:47.287 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.284+0000 7f8e921c7640 1 --2- 172.21.15.98:0/1240688834 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e8c0d1610 0x7f8e8c14eb60 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c00c7d0 tx=0x7f8e7c00cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:47.287 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.284+0000 7f8e8affd640 1 -- 172.21.15.98:0/1240688834 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e7c017070 con 0x7f8e8c0d1610 2024-09-16T15:38:47.287 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.284+0000 7f8e8affd640 1 -- 172.21.15.98:0/1240688834 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8e7c005070 con 0x7f8e8c0d1610 2024-09-16T15:38:47.287 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.284+0000 7f8e9442b640 1 -- 172.21.15.98:0/1240688834 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e8c14f7d0 con 0x7f8e8c0d1610 2024-09-16T15:38:47.288 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.284+0000 7f8e8affd640 1 -- 172.21.15.98:0/1240688834 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e7c0054a0 con 0x7f8e8c0d1610 2024-09-16T15:38:47.288 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.284+0000 7f8e9442b640 1 -- 172.21.15.98:0/1240688834 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e8c14fd90 con 0x7f8e8c0d1610 2024-09-16T15:38:47.288 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.285+0000 7f8e9442b640 1 -- 172.21.15.98:0/1240688834 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e8c0cff10 con 0x7f8e8c0d1610 2024-09-16T15:38:47.289 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.285+0000 7f8e8affd640 1 -- 172.21.15.98:0/1240688834 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 7) ==== 101440+0+0 (secure 0 0 0) 0x7f8e7c01a070 con 0x7f8e8c0d1610 2024-09-16T15:38:47.289 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.286+0000 7f8e8affd640 1 --2- 172.21.15.98:0/1240688834 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f8e78078a00 0x7f8e7807aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:47.289 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.286+0000 7f8e8affd640 1 -- 172.21.15.98:0/1240688834 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f8e7c09a020 con 0x7f8e8c0d1610 2024-09-16T15:38:47.289 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.286+0000 7f8e919c6640 1 --2- 172.21.15.98:0/1240688834 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f8e78078a00 0x7f8e7807aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:47.289 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.286+0000 7f8e919c6640 1 --2- 172.21.15.98:0/1240688834 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f8e78078a00 0x7f8e7807aec0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8e80033000 tx=0x7f8e80004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:47.292 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.290+0000 7f8e8affd640 1 -- 172.21.15.98:0/1240688834 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7f8e7c062690 con 0x7f8e8c0d1610 2024-09-16T15:38:47.467 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.465+0000 7f8e9442b640 1 -- 172.21.15.98:0/1240688834 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "config reset", "num": 27} v 0) -- 0x7f8e8c06e230 con 0x7f8e8c0d1610 2024-09-16T15:38:47.470 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.469+0000 7f8e8affd640 1 -- 172.21.15.98:0/1240688834 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 27}]=0 v29) ==== 71+0+0 (secure 0 0 0) 0x7f8e7c061f90 con 0x7f8e8c0d1610 2024-09-16T15:38:47.473 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.471+0000 7f8e9442b640 1 -- 172.21.15.98:0/1240688834 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f8e78078a00 msgr2=0x7f8e7807aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:47.473 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.471+0000 7f8e9442b640 1 --2- 172.21.15.98:0/1240688834 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f8e78078a00 0x7f8e7807aec0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8e80033000 tx=0x7f8e80004730 comp rx=0 tx=0).stop 2024-09-16T15:38:47.473 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.471+0000 7f8e9442b640 1 -- 172.21.15.98:0/1240688834 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e8c0d1610 msgr2=0x7f8e8c14eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:47.473 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.471+0000 7f8e9442b640 1 --2- 172.21.15.98:0/1240688834 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e8c0d1610 0x7f8e8c14eb60 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c00c7d0 tx=0x7f8e7c00cc90 comp rx=0 tx=0).stop 2024-09-16T15:38:47.473 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.471+0000 7f8e9442b640 1 -- 172.21.15.98:0/1240688834 shutdown_connections 2024-09-16T15:38:47.473 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.471+0000 7f8e9442b640 1 --2- 172.21.15.98:0/1240688834 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f8e78078a00 0x7f8e7807aec0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:47.473 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.471+0000 7f8e9442b640 1 --2- 172.21.15.98:0/1240688834 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e8c15e0d0 0x7f8e8c161200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:47.473 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.471+0000 7f8e9442b640 1 --2- 172.21.15.98:0/1240688834 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8e8c0d2050 0x7f8e8c160cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:47.474 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.471+0000 7f8e9442b640 1 --2- 172.21.15.98:0/1240688834 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e8c0d1610 0x7f8e8c14eb60 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:47.474 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.471+0000 7f8e9442b640 1 -- 172.21.15.98:0/1240688834 >> 172.21.15.98:0/1240688834 conn(0x7f8e8c0d3fe0 msgr2=0x7f8e8c15f650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:47.474 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.471+0000 7f8e9442b640 1 -- 172.21.15.98:0/1240688834 shutdown_connections 2024-09-16T15:38:47.474 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.471+0000 7f8e9442b640 1 -- 172.21.15.98:0/1240688834 wait complete. 2024-09-16T15:38:47.484 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestPerModuleFinsherThread.test_volumes_module_finisher_thread' 2024-09-16T15:38:47.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.582+0000 7f12b7fec640 1 -- 172.21.15.98:0/2489406698 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f12b00ccfd0 msgr2=0x7f12b00730b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:47.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.582+0000 7f12b7fec640 1 --2- 172.21.15.98:0/2489406698 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f12b00ccfd0 0x7f12b00730b0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f12a8009be0 tx=0x7f12a802a8d0 comp rx=0 tx=0).stop 2024-09-16T15:38:47.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.582+0000 7f12b7fec640 1 -- 172.21.15.98:0/2489406698 shutdown_connections 2024-09-16T15:38:47.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.582+0000 7f12b7fec640 1 --2- 172.21.15.98:0/2489406698 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f12b00ccfd0 0x7f12b00730b0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:47.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.583+0000 7f12b7fec640 1 -- 172.21.15.98:0/2489406698 >> 172.21.15.98:0/2489406698 conn(0x7f12b00b1950 msgr2=0x7f12b00b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:47.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.583+0000 7f12b7fec640 1 -- 172.21.15.98:0/2489406698 shutdown_connections 2024-09-16T15:38:47.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.583+0000 7f12b7fec640 1 -- 172.21.15.98:0/2489406698 wait complete. 2024-09-16T15:38:47.586 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.584+0000 7f12b7fec640 1 Processor -- start 2024-09-16T15:38:47.586 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.584+0000 7f12b7fec640 1 -- start start 2024-09-16T15:38:47.588 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.584+0000 7f12b7fec640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f12b00ccfd0 0x7f12b015f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:47.588 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.584+0000 7f12b7fec640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f12b00cf300 0x7f12b00cdae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:47.588 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.584+0000 7f12b7fec640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12b01445d0 0x7f12b00ce020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:47.588 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.584+0000 7f12b7fec640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f12b00735f0 con 0x7f12b00ccfd0 2024-09-16T15:38:47.588 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.585+0000 7f12b7fec640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f12b00b4f60 con 0x7f12b01445d0 2024-09-16T15:38:47.588 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.585+0000 7f12b7fec640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f12b0073770 con 0x7f12b00cf300 2024-09-16T15:38:47.589 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.585+0000 7f12b5d88640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f12b00ccfd0 0x7f12b015f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:47.589 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.585+0000 7f12b5d88640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f12b00ccfd0 0x7f12b015f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60132/0 (socket says 172.21.15.98:60132) 2024-09-16T15:38:47.589 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.585+0000 7f12b5d88640 1 -- 172.21.15.98:0/1680800982 learned_addr learned my addr 172.21.15.98:0/1680800982 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:47.589 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.585+0000 7f12b6589640 1 --2- 172.21.15.98:0/1680800982 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12b01445d0 0x7f12b00ce020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:47.589 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.585+0000 7f12b5587640 1 --2- 172.21.15.98:0/1680800982 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f12b00cf300 0x7f12b00cdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:47.589 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.585+0000 7f12b5d88640 1 -- 172.21.15.98:0/1680800982 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f12b00cf300 msgr2=0x7f12b00cdae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:47.589 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.585+0000 7f12b5d88640 1 --2- 172.21.15.98:0/1680800982 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f12b00cf300 0x7f12b00cdae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:47.589 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.585+0000 7f12b5d88640 1 -- 172.21.15.98:0/1680800982 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12b01445d0 msgr2=0x7f12b00ce020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:47.589 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.585+0000 7f12b5d88640 1 --2- 172.21.15.98:0/1680800982 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12b01445d0 0x7f12b00ce020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:47.589 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.585+0000 7f12b5d88640 1 -- 172.21.15.98:0/1680800982 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12b00c9390 con 0x7f12b00ccfd0 2024-09-16T15:38:47.589 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.585+0000 7f12b5587640 1 --2- 172.21.15.98:0/1680800982 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f12b00cf300 0x7f12b00cdae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T15:38:47.589 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.585+0000 7f12b6589640 1 --2- 172.21.15.98:0/1680800982 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12b01445d0 0x7f12b00ce020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T15:38:47.589 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.585+0000 7f12b5d88640 1 --2- 172.21.15.98:0/1680800982 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f12b00ccfd0 0x7f12b015f380 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f12ac00c3a0 tx=0x7f12ac00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:47.590 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.585+0000 7f12a67fc640 1 -- 172.21.15.98:0/1680800982 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12ac011790 con 0x7f12b00ccfd0 2024-09-16T15:38:47.590 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.585+0000 7f12a67fc640 1 -- 172.21.15.98:0/1680800982 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f12ac017070 con 0x7f12b00ccfd0 2024-09-16T15:38:47.590 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.585+0000 7f12b7fec640 1 -- 172.21.15.98:0/1680800982 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12b00c9670 con 0x7f12b00ccfd0 2024-09-16T15:38:47.590 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.585+0000 7f12a67fc640 1 -- 172.21.15.98:0/1680800982 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12ac011cc0 con 0x7f12b00ccfd0 2024-09-16T15:38:47.590 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.585+0000 7f12b7fec640 1 -- 172.21.15.98:0/1680800982 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12b00c9c30 con 0x7f12b00ccfd0 2024-09-16T15:38:47.590 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.586+0000 7f12b7fec640 1 -- 172.21.15.98:0/1680800982 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12b0073c20 con 0x7f12b00ccfd0 2024-09-16T15:38:47.591 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.587+0000 7f12a67fc640 1 -- 172.21.15.98:0/1680800982 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 7) ==== 101440+0+0 (secure 0 0 0) 0x7f12ac01c460 con 0x7f12b00ccfd0 2024-09-16T15:38:47.591 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.588+0000 7f12a67fc640 1 --2- 172.21.15.98:0/1680800982 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f1294078a00 0x7f129407aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:47.591 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.588+0000 7f12a67fc640 1 -- 172.21.15.98:0/1680800982 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f12ac09a750 con 0x7f12b00ccfd0 2024-09-16T15:38:47.591 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.588+0000 7f12b5587640 1 --2- 172.21.15.98:0/1680800982 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f1294078a00 0x7f129407aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:47.591 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.588+0000 7f12b5587640 1 --2- 172.21.15.98:0/1680800982 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f1294078a00 0x7f129407aec0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f12b00cbe10 tx=0x7f12a0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:47.594 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.592+0000 7f12a67fc640 1 -- 172.21.15.98:0/1680800982 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7f12ac062dc0 con 0x7f12b00ccfd0 2024-09-16T15:38:47.846 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:47.844+0000 7f12b7fec640 1 -- 172.21.15.98:0/1680800982 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestPerModuleFinsherThread.test_volumes_module_finisher_thread"]} v 0) -- 0x7f12b0070a20 con 0x7f12b00ccfd0 2024-09-16T15:38:48.163 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.161+0000 7f12a67fc640 1 -- 172.21.15.98:0/1680800982 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestPerModuleFinsherThread.test_volumes_module_finisher_thread"]}]=0 v84) ==== 167+0+0 (secure 0 0 0) 0x7f12ac0626c0 con 0x7f12b00ccfd0 2024-09-16T15:38:48.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.164+0000 7f12b7fec640 1 -- 172.21.15.98:0/1680800982 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f1294078a00 msgr2=0x7f129407aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:48.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.164+0000 7f12b7fec640 1 --2- 172.21.15.98:0/1680800982 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f1294078a00 0x7f129407aec0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f12b00cbe10 tx=0x7f12a0009040 comp rx=0 tx=0).stop 2024-09-16T15:38:48.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.164+0000 7f12b7fec640 1 -- 172.21.15.98:0/1680800982 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f12b00ccfd0 msgr2=0x7f12b015f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:48.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.164+0000 7f12b7fec640 1 --2- 172.21.15.98:0/1680800982 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f12b00ccfd0 0x7f12b015f380 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f12ac00c3a0 tx=0x7f12ac00c860 comp rx=0 tx=0).stop 2024-09-16T15:38:48.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.164+0000 7f12b7fec640 1 -- 172.21.15.98:0/1680800982 shutdown_connections 2024-09-16T15:38:48.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.164+0000 7f12b7fec640 1 --2- 172.21.15.98:0/1680800982 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f1294078a00 0x7f129407aec0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:48.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.164+0000 7f12b7fec640 1 --2- 172.21.15.98:0/1680800982 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12b01445d0 0x7f12b00ce020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:48.167 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.164+0000 7f12b7fec640 1 --2- 172.21.15.98:0/1680800982 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f12b00cf300 0x7f12b00cdae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:48.167 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.164+0000 7f12b7fec640 1 --2- 172.21.15.98:0/1680800982 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f12b00ccfd0 0x7f12b015f380 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:48.167 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.164+0000 7f12b7fec640 1 -- 172.21.15.98:0/1680800982 >> 172.21.15.98:0/1680800982 conn(0x7f12b00b1950 msgr2=0x7f12b006f690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:48.167 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.164+0000 7f12b7fec640 1 -- 172.21.15.98:0/1680800982 shutdown_connections 2024-09-16T15:38:48.167 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.164+0000 7f12b7fec640 1 -- 172.21.15.98:0/1680800982 wait complete. 2024-09-16T15:38:48.178 INFO:tasks.cephfs_test_runner:test_volumes_module_finisher_thread (tasks.cephfs.test_volumes.TestPerModuleFinsherThread) ... ok 2024-09-16T15:38:48.178 INFO:tasks.cephfs_test_runner: 2024-09-16T15:38:48.178 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-16T15:38:48.178 INFO:tasks.cephfs_test_runner:Ran 1 test in 40.103s 2024-09-16T15:38:48.178 INFO:tasks.cephfs_test_runner: 2024-09-16T15:38:48.178 INFO:tasks.cephfs_test_runner:OK 2024-09-16T15:38:48.179 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-09-16T15:38:48.186 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-16T15:38:48.194 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T15:38:48.296 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.294+0000 7f2740f82640 1 -- 172.21.15.98:0/1857751827 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f273c0b43f0 msgr2=0x7f273c0b47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:48.296 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.294+0000 7f2740f82640 1 --2- 172.21.15.98:0/1857751827 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f273c0b43f0 0x7f273c0b47d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f272c005fd0 tx=0x7f272c02a4b0 comp rx=0 tx=0).stop 2024-09-16T15:38:48.296 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.294+0000 7f2740f82640 1 -- 172.21.15.98:0/1857751827 shutdown_connections 2024-09-16T15:38:48.296 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.294+0000 7f2740f82640 1 --2- 172.21.15.98:0/1857751827 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f273c073bb0 0x7f273c06ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:48.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.294+0000 7f2740f82640 1 --2- 172.21.15.98:0/1857751827 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f273c0b43f0 0x7f273c0b47d0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:48.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.294+0000 7f2740f82640 1 -- 172.21.15.98:0/1857751827 >> 172.21.15.98:0/1857751827 conn(0x7f273c0b1950 msgr2=0x7f273c0b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:48.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.294+0000 7f2740f82640 1 -- 172.21.15.98:0/1857751827 shutdown_connections 2024-09-16T15:38:48.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.294+0000 7f2740f82640 1 -- 172.21.15.98:0/1857751827 wait complete. 2024-09-16T15:38:48.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.295+0000 7f2740f82640 1 Processor -- start 2024-09-16T15:38:48.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.295+0000 7f2740f82640 1 -- start start 2024-09-16T15:38:48.299 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.296+0000 7f2740f82640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f273c073bb0 0x7f273c149240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:48.299 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.296+0000 7f2740f82640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f273c074150 0x7f273c1e5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:48.300 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.296+0000 7f2740f82640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f273c0b43f0 0x7f273c1e5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:48.300 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.296+0000 7f2740f82640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f273c06f3b0 con 0x7f273c073bb0 2024-09-16T15:38:48.300 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.296+0000 7f2740f82640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f273c0704c0 con 0x7f273c074150 2024-09-16T15:38:48.300 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.296+0000 7f2740f82640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f273c06f530 con 0x7f273c0b43f0 2024-09-16T15:38:48.300 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.296+0000 7f273a59c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f273c073bb0 0x7f273c149240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:48.300 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.296+0000 7f273a59c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f273c073bb0 0x7f273c149240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60134/0 (socket says 172.21.15.98:60134) 2024-09-16T15:38:48.300 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.296+0000 7f273a59c640 1 -- 172.21.15.98:0/2764962477 learned_addr learned my addr 172.21.15.98:0/2764962477 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:48.300 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.296+0000 7f2733fff640 1 --2- 172.21.15.98:0/2764962477 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f273c074150 0x7f273c1e5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:48.300 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.296+0000 7f273ad9d640 1 --2- 172.21.15.98:0/2764962477 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f273c0b43f0 0x7f273c1e5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:48.300 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.296+0000 7f273a59c640 1 -- 172.21.15.98:0/2764962477 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f273c0b43f0 msgr2=0x7f273c1e5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:48.300 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.296+0000 7f273a59c640 1 --2- 172.21.15.98:0/2764962477 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f273c0b43f0 0x7f273c1e5780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:48.300 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.296+0000 7f273a59c640 1 -- 172.21.15.98:0/2764962477 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f273c074150 msgr2=0x7f273c1e5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:48.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.296+0000 7f273a59c640 1 --2- 172.21.15.98:0/2764962477 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f273c074150 0x7f273c1e5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:48.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.296+0000 7f273a59c640 1 -- 172.21.15.98:0/2764962477 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f273c149780 con 0x7f273c073bb0 2024-09-16T15:38:48.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.297+0000 7f273a59c640 1 --2- 172.21.15.98:0/2764962477 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f273c073bb0 0x7f273c149240 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f272c000c00 tx=0x7f272c0038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:48.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.297+0000 7f2732ffd640 1 -- 172.21.15.98:0/2764962477 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f272c03f070 con 0x7f273c073bb0 2024-09-16T15:38:48.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.297+0000 7f2732ffd640 1 -- 172.21.15.98:0/2764962477 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f272c0047a0 con 0x7f273c073bb0 2024-09-16T15:38:48.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.297+0000 7f2732ffd640 1 -- 172.21.15.98:0/2764962477 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f272c035030 con 0x7f273c073bb0 2024-09-16T15:38:48.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.297+0000 7f2740f82640 1 -- 172.21.15.98:0/2764962477 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f273c149be0 con 0x7f273c073bb0 2024-09-16T15:38:48.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.297+0000 7f2740f82640 1 -- 172.21.15.98:0/2764962477 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f273c149ea0 con 0x7f273c073bb0 2024-09-16T15:38:48.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.298+0000 7f2740f82640 1 -- 172.21.15.98:0/2764962477 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f273c0760b0 con 0x7f273c073bb0 2024-09-16T15:38:48.302 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.298+0000 7f2732ffd640 1 -- 172.21.15.98:0/2764962477 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 7) ==== 101440+0+0 (secure 0 0 0) 0x7f272c042070 con 0x7f273c073bb0 2024-09-16T15:38:48.302 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.299+0000 7f2732ffd640 1 --2- 172.21.15.98:0/2764962477 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f271c078a00 0x7f271c07aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:48.302 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.299+0000 7f2732ffd640 1 -- 172.21.15.98:0/2764962477 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f272c0bb9a0 con 0x7f273c073bb0 2024-09-16T15:38:48.302 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.299+0000 7f2733fff640 1 --2- 172.21.15.98:0/2764962477 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f271c078a00 0x7f271c07aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:48.302 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.299+0000 7f2733fff640 1 --2- 172.21.15.98:0/2764962477 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f271c078a00 0x7f271c07aec0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f273c0b0380 tx=0x7f2724009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:48.305 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.303+0000 7f2732ffd640 1 -- 172.21.15.98:0/2764962477 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7f273c149780 con 0x7f273c073bb0 2024-09-16T15:38:48.479 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.477+0000 7f2740f82640 1 -- 172.21.15.98:0/2764962477 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f273c0749b0 con 0x7f273c073bb0 2024-09-16T15:38:48.479 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.478+0000 7f2732ffd640 1 -- 172.21.15.98:0/2764962477 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) ==== 74+0+13044 (secure 0 0 0) 0x7f272c0839c0 con 0x7f273c073bb0 2024-09-16T15:38:48.480 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:38:48.480 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":37,"fsid":"52a38a45-21d2-4cb0-bb3a-4fb8be3a08df","created":"2024-09-16T15:37:20.387654+0000","modified":"2024-09-16T15:38:47.156370+0000","last_up_change":"2024-09-16T15:37:33.417470+0000","last_in_change":"2024-09-16T15:37:23.430578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T15:37:34.725090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a2d61df4-2577-47e6-a4ac-c36bbb85ab8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1967099790},{"type":"v1","addr":"172.21.15.98:6825","nonce":1967099790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1967099790},{"type":"v1","addr":"172.21.15.98:6827","nonce":1967099790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":1967099790},{"type":"v1","addr":"172.21.15.98:6831","nonce":1967099790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1967099790},{"type":"v1","addr":"172.21.15.98:6829","nonce":1967099790}]},"public_addr":"172.21.15.98:6825/1967099790","cluster_addr":"172.21.15.98:6827/1967099790","heartbeat_back_addr":"172.21.15.98:6831/1967099790","heartbeat_front_addr":"172.21.15.98:6829/1967099790","state":["exists","up"]},{"osd":1,"uuid":"bb3a68a5-c22f-442b-b292-7c272fe01ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":3571460482},{"type":"v1","addr":"172.21.15.98:6809","nonce":3571460482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":3571460482},{"type":"v1","addr":"172.21.15.98:6811","nonce":3571460482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":3571460482},{"type":"v1","addr":"172.21.15.98:6815","nonce":3571460482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":3571460482},{"type":"v1","addr":"172.21.15.98:6813","nonce":3571460482}]},"public_addr":"172.21.15.98:6809/3571460482","cluster_addr":"172.21.15.98:6811/3571460482","heartbeat_back_addr":"172.21.15.98:6815/3571460482","heartbeat_front_addr":"172.21.15.98:6813/3571460482","state":["exists","up"]},{"osd":2,"uuid":"c8429195-a480-409b-8e5f-8dc4c6abc0a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":2573210695},{"type":"v1","addr":"172.21.15.98:6801","nonce":2573210695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":2573210695},{"type":"v1","addr":"172.21.15.98:6803","nonce":2573210695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":2573210695},{"type":"v1","addr":"172.21.15.98:6807","nonce":2573210695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":2573210695},{"type":"v1","addr":"172.21.15.98:6805","nonce":2573210695}]},"public_addr":"172.21.15.98:6801/2573210695","cluster_addr":"172.21.15.98:6803/2573210695","heartbeat_back_addr":"172.21.15.98:6807/2573210695","heartbeat_front_addr":"172.21.15.98:6805/2573210695","state":["exists","up"]},{"osd":3,"uuid":"0e800d7b-096f-4f65-b3cc-c7cda3870de4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":3951374837},{"type":"v1","addr":"172.21.15.98:6817","nonce":3951374837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":3951374837},{"type":"v1","addr":"172.21.15.98:6819","nonce":3951374837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":3951374837},{"type":"v1","addr":"172.21.15.98:6823","nonce":3951374837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":3951374837},{"type":"v1","addr":"172.21.15.98:6821","nonce":3951374837}]},"public_addr":"172.21.15.98:6817/3951374837","cluster_addr":"172.21.15.98:6819/3951374837","heartbeat_back_addr":"172.21.15.98:6823/3951374837","heartbeat_front_addr":"172.21.15.98:6821/3951374837","state":["exists","up"]},{"osd":4,"uuid":"c7822e9b-8e29-48d9-b92a-e8f9c7bc5247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":724302036},{"type":"v1","addr":"172.21.15.135:6811","nonce":724302036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":724302036},{"type":"v1","addr":"172.21.15.135:6813","nonce":724302036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":724302036},{"type":"v1","addr":"172.21.15.135:6817","nonce":724302036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":724302036},{"type":"v1","addr":"172.21.15.135:6815","nonce":724302036}]},"public_addr":"172.21.15.135:6811/724302036","cluster_addr":"172.21.15.135:6813/724302036","heartbeat_back_addr":"172.21.15.135:6817/724302036","heartbeat_front_addr":"172.21.15.135:6815/724302036","state":["exists","up"]},{"osd":5,"uuid":"35805e02-484a-4404-a78f-aa44f4daa41f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3083482635},{"type":"v1","addr":"172.21.15.135:6803","nonce":3083482635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3083482635},{"type":"v1","addr":"172.21.15.135:6805","nonce":3083482635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3083482635},{"type":"v1","addr":"172.21.15.135:6809","nonce":3083482635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3083482635},{"type":"v1","addr":"172.21.15.135:6807","nonce":3083482635}]},"public_addr":"172.21.15.135:6803/3083482635","cluster_addr":"172.21.15.135:6805/3083482635","heartbeat_back_addr":"172.21.15.135:6809/3083482635","heartbeat_front_addr":"172.21.15.135:6807/3083482635","state":["exists","up"]},{"osd":6,"uuid":"6327ba84-aaeb-41fa-9717-188988ff2c4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3376376340},{"type":"v1","addr":"172.21.15.135:6819","nonce":3376376340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3376376340},{"type":"v1","addr":"172.21.15.135:6821","nonce":3376376340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":3376376340},{"type":"v1","addr":"172.21.15.135:6825","nonce":3376376340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3376376340},{"type":"v1","addr":"172.21.15.135:6823","nonce":3376376340}]},"public_addr":"172.21.15.135:6819/3376376340","cluster_addr":"172.21.15.135:6821/3376376340","heartbeat_back_addr":"172.21.15.135:6825/3376376340","heartbeat_front_addr":"172.21.15.135:6823/3376376340","state":["exists","up"]},{"osd":7,"uuid":"392d0958-dff9-4248-b3d8-a1201c10f354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2559837727},{"type":"v1","addr":"172.21.15.135:6827","nonce":2559837727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2559837727},{"type":"v1","addr":"172.21.15.135:6829","nonce":2559837727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":2559837727},{"type":"v1","addr":"172.21.15.135:6833","nonce":2559837727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2559837727},{"type":"v1","addr":"172.21.15.135:6831","nonce":2559837727}]},"public_addr":"172.21.15.135:6827/2559837727","cluster_addr":"172.21.15.135:6829/2559837727","heartbeat_back_addr":"172.21.15.135:6833/2559837727","heartbeat_front_addr":"172.21.15.135:6831/2559837727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.939904+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.717296+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.785817+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:30.211718+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.973359+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:30.250109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.699327+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:30.173063+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.98:6835/1806390493":"2024-09-17T15:38:44.070008+0000","172.21.15.98:6833/1806390493":"2024-09-17T15:38:44.070008+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T15:38:48.482 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.480+0000 7f2740f82640 1 -- 172.21.15.98:0/2764962477 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f271c078a00 msgr2=0x7f271c07aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:48.482 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.480+0000 7f2740f82640 1 --2- 172.21.15.98:0/2764962477 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f271c078a00 0x7f271c07aec0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f273c0b0380 tx=0x7f2724009040 comp rx=0 tx=0).stop 2024-09-16T15:38:48.482 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.480+0000 7f2740f82640 1 -- 172.21.15.98:0/2764962477 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f273c073bb0 msgr2=0x7f273c149240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:48.482 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.480+0000 7f2740f82640 1 --2- 172.21.15.98:0/2764962477 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f273c073bb0 0x7f273c149240 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f272c000c00 tx=0x7f272c0038a0 comp rx=0 tx=0).stop 2024-09-16T15:38:48.482 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.480+0000 7f2740f82640 1 -- 172.21.15.98:0/2764962477 shutdown_connections 2024-09-16T15:38:48.482 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.480+0000 7f2740f82640 1 --2- 172.21.15.98:0/2764962477 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f273c0b43f0 0x7f273c1e5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:48.482 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.480+0000 7f2740f82640 1 --2- 172.21.15.98:0/2764962477 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f271c078a00 0x7f271c07aec0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:48.482 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.480+0000 7f2740f82640 1 --2- 172.21.15.98:0/2764962477 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f273c074150 0x7f273c1e5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:48.483 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.480+0000 7f2740f82640 1 --2- 172.21.15.98:0/2764962477 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f273c073bb0 0x7f273c149240 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:48.483 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.480+0000 7f2740f82640 1 -- 172.21.15.98:0/2764962477 >> 172.21.15.98:0/2764962477 conn(0x7f273c0b1950 msgr2=0x7f273c0cebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:48.483 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.480+0000 7f2740f82640 1 -- 172.21.15.98:0/2764962477 shutdown_connections 2024-09-16T15:38:48.483 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.480+0000 7f2740f82640 1 -- 172.21.15.98:0/2764962477 wait complete. 2024-09-16T15:38:48.494 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-16T15:37:34.725090+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-16T15:38:48.494 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-16T15:38:48.599 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.597+0000 7fbb0aebd640 1 -- 172.21.15.98:0/2456769166 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb0415f090 msgr2=0x7fbb040cf120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:48.599 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.597+0000 7fbb0aebd640 1 --2- 172.21.15.98:0/2456769166 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb0415f090 0x7fbb040cf120 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fbb0406db10 tx=0x7fbafc02a8b0 comp rx=0 tx=0).stop 2024-09-16T15:38:48.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.597+0000 7fbb0aebd640 1 -- 172.21.15.98:0/2456769166 shutdown_connections 2024-09-16T15:38:48.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.597+0000 7fbb0aebd640 1 --2- 172.21.15.98:0/2456769166 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb0415f090 0x7fbb040cf120 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:48.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.597+0000 7fbb0aebd640 1 --2- 172.21.15.98:0/2456769166 >> v2:172.21.15.135:3300/0 conn(0x7fbb040b3370 0x7fbb040cebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:48.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.597+0000 7fbb0aebd640 1 -- 172.21.15.98:0/2456769166 >> 172.21.15.98:0/2456769166 conn(0x7fbb040b1840 msgr2=0x7fbb040b1c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:48.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.597+0000 7fbb0aebd640 1 -- 172.21.15.98:0/2456769166 shutdown_connections 2024-09-16T15:38:48.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.597+0000 7fbb0aebd640 1 -- 172.21.15.98:0/2456769166 wait complete. 2024-09-16T15:38:48.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.598+0000 7fbb0aebd640 1 Processor -- start 2024-09-16T15:38:48.603 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.598+0000 7fbb0aebd640 1 -- start start 2024-09-16T15:38:48.603 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.599+0000 7fbb0aebd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb040b3370 0x7fbb04154a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:48.603 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.599+0000 7fbb0aebd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbb0415c080 0x7fbb041f2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:48.603 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.599+0000 7fbb0aebd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb0415f090 0x7fbb04140510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:48.603 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.599+0000 7fbb0aebd640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fbb04164e20 con 0x7fbb040b3370 2024-09-16T15:38:48.603 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.599+0000 7fbb0aebd640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbb04164ca0 con 0x7fbb0415f090 2024-09-16T15:38:48.603 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.599+0000 7fbb0aebd640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fbb04164fa0 con 0x7fbb0415c080 2024-09-16T15:38:48.603 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.599+0000 7fbb08c59640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb040b3370 0x7fbb04154a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:48.603 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.599+0000 7fbb08c59640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb040b3370 0x7fbb04154a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60148/0 (socket says 172.21.15.98:60148) 2024-09-16T15:38:48.603 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.599+0000 7fbb08c59640 1 -- 172.21.15.98:0/3700205446 learned_addr learned my addr 172.21.15.98:0/3700205446 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:48.603 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.599+0000 7fbb03fff640 1 --2- 172.21.15.98:0/3700205446 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbb0415c080 0x7fbb041f2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:48.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.599+0000 7fbb0945a640 1 --2- 172.21.15.98:0/3700205446 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb0415f090 0x7fbb04140510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:48.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.599+0000 7fbb08c59640 1 -- 172.21.15.98:0/3700205446 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbb0415c080 msgr2=0x7fbb041f2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:48.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.599+0000 7fbb08c59640 1 --2- 172.21.15.98:0/3700205446 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbb0415c080 0x7fbb041f2fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:48.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.599+0000 7fbb08c59640 1 -- 172.21.15.98:0/3700205446 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb0415f090 msgr2=0x7fbb04140510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:48.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.599+0000 7fbb08c59640 1 --2- 172.21.15.98:0/3700205446 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb0415f090 0x7fbb04140510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:48.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.599+0000 7fbb08c59640 1 -- 172.21.15.98:0/3700205446 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb04155470 con 0x7fbb040b3370 2024-09-16T15:38:48.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.599+0000 7fbb0945a640 1 --2- 172.21.15.98:0/3700205446 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb0415f090 0x7fbb04140510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T15:38:48.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.600+0000 7fbb08c59640 1 --2- 172.21.15.98:0/3700205446 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb040b3370 0x7fbb04154a20 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fbaf400d950 tx=0x7fbaf400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:48.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.600+0000 7fbb017fa640 1 -- 172.21.15.98:0/3700205446 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaf4017070 con 0x7fbb040b3370 2024-09-16T15:38:48.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.600+0000 7fbb017fa640 1 -- 172.21.15.98:0/3700205446 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbaf4009d20 con 0x7fbb040b3370 2024-09-16T15:38:48.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.600+0000 7fbb0aebd640 1 -- 172.21.15.98:0/3700205446 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb041f3a30 con 0x7fbb040b3370 2024-09-16T15:38:48.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.600+0000 7fbb017fa640 1 -- 172.21.15.98:0/3700205446 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaf40106c0 con 0x7fbb040b3370 2024-09-16T15:38:48.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.600+0000 7fbb0aebd640 1 -- 172.21.15.98:0/3700205446 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb041f42d0 con 0x7fbb040b3370 2024-09-16T15:38:48.605 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.601+0000 7fbb0aebd640 1 -- 172.21.15.98:0/3700205446 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb0415e980 con 0x7fbb040b3370 2024-09-16T15:38:48.605 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.601+0000 7fbb017fa640 1 -- 172.21.15.98:0/3700205446 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 7) ==== 101440+0+0 (secure 0 0 0) 0x7fbaf4010860 con 0x7fbb040b3370 2024-09-16T15:38:48.605 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.602+0000 7fbb017fa640 1 --2- 172.21.15.98:0/3700205446 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fbaf0078a00 0x7fbaf007aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:48.605 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.602+0000 7fbb017fa640 1 -- 172.21.15.98:0/3700205446 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7fbaf409ad50 con 0x7fbb040b3370 2024-09-16T15:38:48.605 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.602+0000 7fbb03fff640 1 --2- 172.21.15.98:0/3700205446 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fbaf0078a00 0x7fbaf007aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:48.606 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.602+0000 7fbb03fff640 1 --2- 172.21.15.98:0/3700205446 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fbaf0078a00 0x7fbaf007aec0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbb040af670 tx=0x7fbaf8007e90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:48.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.606+0000 7fbb017fa640 1 -- 172.21.15.98:0/3700205446 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7fbaf409e030 con 0x7fbb040b3370 2024-09-16T15:38:48.783 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.781+0000 7fbb0aebd640 1 -- 172.21.15.98:0/3700205446 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fbb040afb60 con 0x7fbb040b3370 2024-09-16T15:38:48.783 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.781+0000 7fbb017fa640 1 -- 172.21.15.98:0/3700205446 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) ==== 93+0+10 (secure 0 0 0) 0x7fbaf4062cf0 con 0x7fbb040b3370 2024-09-16T15:38:48.783 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 1 2024-09-16T15:38:48.785 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.783+0000 7fbb0aebd640 1 -- 172.21.15.98:0/3700205446 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fbaf0078a00 msgr2=0x7fbaf007aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:48.785 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.783+0000 7fbb0aebd640 1 --2- 172.21.15.98:0/3700205446 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fbaf0078a00 0x7fbaf007aec0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbb040af670 tx=0x7fbaf8007e90 comp rx=0 tx=0).stop 2024-09-16T15:38:48.786 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.783+0000 7fbb0aebd640 1 -- 172.21.15.98:0/3700205446 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb040b3370 msgr2=0x7fbb04154a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:48.786 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.783+0000 7fbb0aebd640 1 --2- 172.21.15.98:0/3700205446 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb040b3370 0x7fbb04154a20 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fbaf400d950 tx=0x7fbaf400de10 comp rx=0 tx=0).stop 2024-09-16T15:38:48.786 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.783+0000 7fbb0aebd640 1 -- 172.21.15.98:0/3700205446 shutdown_connections 2024-09-16T15:38:48.786 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.783+0000 7fbb0aebd640 1 --2- 172.21.15.98:0/3700205446 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fbaf0078a00 0x7fbaf007aec0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:48.786 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.783+0000 7fbb0aebd640 1 --2- 172.21.15.98:0/3700205446 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb0415f090 0x7fbb04140510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:48.786 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.783+0000 7fbb0aebd640 1 --2- 172.21.15.98:0/3700205446 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fbb0415c080 0x7fbb041f2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:48.786 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.783+0000 7fbb0aebd640 1 --2- 172.21.15.98:0/3700205446 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb040b3370 0x7fbb04154a20 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:48.786 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.783+0000 7fbb0aebd640 1 -- 172.21.15.98:0/3700205446 >> 172.21.15.98:0/3700205446 conn(0x7fbb040b1840 msgr2=0x7fbb040b0080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:48.786 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.783+0000 7fbb0aebd640 1 -- 172.21.15.98:0/3700205446 shutdown_connections 2024-09-16T15:38:48.786 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.783+0000 7fbb0aebd640 1 -- 172.21.15.98:0/3700205446 wait complete. 2024-09-16T15:38:48.796 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-16T15:38:48.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.895+0000 7f9fbbebd640 1 -- 172.21.15.98:0/4287672707 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9fa0003a00 msgr2=0x7f9fa0003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:48.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.895+0000 7f9fbbebd640 1 --2- 172.21.15.98:0/4287672707 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9fa0003a00 0x7f9fa0003e20 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f9fb000bb20 tx=0x7f9fa0005830 comp rx=0 tx=0).stop 2024-09-16T15:38:48.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.895+0000 7f9fba45a640 1 -- 172.21.15.98:0/4287672707 reap_dead start 2024-09-16T15:38:48.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.895+0000 7f9fbbebd640 1 -- 172.21.15.98:0/4287672707 shutdown_connections 2024-09-16T15:38:48.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.895+0000 7f9fbbebd640 1 -- 172.21.15.98:0/4287672707 >> 172.21.15.98:0/4287672707 conn(0x7f9fb40b1950 msgr2=0x7f9fb40b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:48.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.895+0000 7f9fbbebd640 1 -- 172.21.15.98:0/4287672707 shutdown_connections 2024-09-16T15:38:48.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.895+0000 7f9fbbebd640 1 -- 172.21.15.98:0/4287672707 wait complete. 2024-09-16T15:38:48.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.896+0000 7f9fbbebd640 1 Processor -- start 2024-09-16T15:38:48.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.897+0000 7f9fbbebd640 1 -- start start 2024-09-16T15:38:48.901 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.897+0000 7f9fbbebd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9fa0003a00 0x7f9fb415acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:48.901 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.897+0000 7f9fbbebd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9fb41f2e60 0x7f9fb4158e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:48.901 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.897+0000 7f9fbbebd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9fb4159340 0x7f9fb415b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:48.901 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.897+0000 7f9fbbebd640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9fb40b25c0 con 0x7f9fa0003a00 2024-09-16T15:38:48.901 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.897+0000 7f9fbbebd640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9fb40b2440 con 0x7f9fb41f2e60 2024-09-16T15:38:48.902 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.897+0000 7f9fbbebd640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f9fb40b2740 con 0x7f9fb4159340 2024-09-16T15:38:48.902 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.897+0000 7f9fb9c59640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9fa0003a00 0x7f9fb415acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:48.902 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.897+0000 7f9fb9c59640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9fa0003a00 0x7f9fb415acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60168/0 (socket says 172.21.15.98:60168) 2024-09-16T15:38:48.902 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.897+0000 7f9fb9c59640 1 -- 172.21.15.98:0/2040856893 learned_addr learned my addr 172.21.15.98:0/2040856893 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:48.902 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.897+0000 7f9fba45a640 1 --2- 172.21.15.98:0/2040856893 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9fb4159340 0x7f9fb415b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:48.902 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.897+0000 7f9fb9458640 1 --2- 172.21.15.98:0/2040856893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9fb41f2e60 0x7f9fb4158e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:48.902 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.898+0000 7f9fb9c59640 1 -- 172.21.15.98:0/2040856893 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9fb4159340 msgr2=0x7f9fb415b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:48.902 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.898+0000 7f9fb9c59640 1 --2- 172.21.15.98:0/2040856893 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9fb4159340 0x7f9fb415b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:48.902 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.898+0000 7f9fb9c59640 1 -- 172.21.15.98:0/2040856893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9fb41f2e60 msgr2=0x7f9fb4158e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:48.902 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.898+0000 7f9fb9c59640 1 --2- 172.21.15.98:0/2040856893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9fb41f2e60 0x7f9fb4158e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:48.903 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.898+0000 7f9fb9c59640 1 -- 172.21.15.98:0/2040856893 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fb4159c50 con 0x7f9fa0003a00 2024-09-16T15:38:48.903 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.898+0000 7f9fb9458640 1 --2- 172.21.15.98:0/2040856893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9fb41f2e60 0x7f9fb4158e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T15:38:48.903 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.898+0000 7f9fb9c59640 1 --2- 172.21.15.98:0/2040856893 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9fa0003a00 0x7f9fb415acf0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f9fb0034040 tx=0x7f9fb0005870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:48.903 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.898+0000 7f9faa7fc640 1 -- 172.21.15.98:0/2040856893 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fb0040070 con 0x7f9fa0003a00 2024-09-16T15:38:48.903 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.898+0000 7f9faa7fc640 1 -- 172.21.15.98:0/2040856893 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9fb0004030 con 0x7f9fa0003a00 2024-09-16T15:38:48.903 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.898+0000 7f9fbbebd640 1 -- 172.21.15.98:0/2040856893 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fb4159f30 con 0x7f9fa0003a00 2024-09-16T15:38:48.903 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.898+0000 7f9faa7fc640 1 -- 172.21.15.98:0/2040856893 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fb0035040 con 0x7f9fa0003a00 2024-09-16T15:38:48.903 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.898+0000 7f9fbbebd640 1 -- 172.21.15.98:0/2040856893 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fb415a4f0 con 0x7f9fa0003a00 2024-09-16T15:38:48.903 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.899+0000 7f9fbbebd640 1 -- 172.21.15.98:0/2040856893 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fb4074460 con 0x7f9fa0003a00 2024-09-16T15:38:48.903 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.900+0000 7f9faa7fc640 1 -- 172.21.15.98:0/2040856893 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 7) ==== 101440+0+0 (secure 0 0 0) 0x7f9fb0038020 con 0x7f9fa0003a00 2024-09-16T15:38:48.904 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.900+0000 7f9faa7fc640 1 --2- 172.21.15.98:0/2040856893 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f9f98078a00 0x7f9f9807aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:48.904 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.900+0000 7f9faa7fc640 1 -- 172.21.15.98:0/2040856893 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f9fb00bb600 con 0x7f9fa0003a00 2024-09-16T15:38:48.904 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.900+0000 7f9fb9458640 1 --2- 172.21.15.98:0/2040856893 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f9f98078a00 0x7f9f9807aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:48.904 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.901+0000 7f9fb9458640 1 --2- 172.21.15.98:0/2040856893 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f9f98078a00 0x7f9f9807aec0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9fa4000c00 tx=0x7f9fa4001540 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:48.906 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:48.904+0000 7f9faa7fc640 1 -- 172.21.15.98:0/2040856893 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7f9fb0083bf0 con 0x7f9fa0003a00 2024-09-16T15:38:49.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:49.129+0000 7f9fbbebd640 1 -- 172.21.15.98:0/2040856893 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f9fb415ee20 con 0x7f9fa0003a00 2024-09-16T15:38:49.136 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:49.134+0000 7f9faa7fc640 1 -- 172.21.15.98:0/2040856893 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v7) ==== 81+0+529129 (secure 0 0 0) 0x7f9fb00834f0 con 0x7f9fa0003a00 2024-09-16T15:38:49.142 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:38:49.143 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-16T15:38:49.143 INFO:teuthology.orchestra.run.smithi098.stdout: "epoch": 7, 2024-09-16T15:38:49.143 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.143 INFO:teuthology.orchestra.run.smithi098.stdout: "active_gid": 4100, 2024-09-16T15:38:49.143 INFO:teuthology.orchestra.run.smithi098.stdout: "active_name": "x", 2024-09-16T15:38:49.143 INFO:teuthology.orchestra.run.smithi098.stdout: "active_addrs": { 2024-09-16T15:38:49.143 INFO:teuthology.orchestra.run.smithi098.stdout: "addrvec": [ 2024-09-16T15:38:49.143 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:49.143 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "v2", 2024-09-16T15:38:49.143 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": "172.21.15.135:6800", 2024-09-16T15:38:49.143 INFO:teuthology.orchestra.run.smithi098.stdout: "nonce": 699234772 2024-09-16T15:38:49.143 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.144 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:49.144 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "v1", 2024-09-16T15:38:49.144 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": "172.21.15.135:6801", 2024-09-16T15:38:49.144 INFO:teuthology.orchestra.run.smithi098.stdout: "nonce": 699234772 2024-09-16T15:38:49.144 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.144 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-16T15:38:49.144 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.144 INFO:teuthology.orchestra.run.smithi098.stdout: "active_addr": "172.21.15.135:6801/699234772", 2024-09-16T15:38:49.144 INFO:teuthology.orchestra.run.smithi098.stdout: "active_change": "2024-09-16T15:37:24.701224+0000", 2024-09-16T15:38:49.144 INFO:teuthology.orchestra.run.smithi098.stdout: "active_mgr_features": 4540719139924082687, 2024-09-16T15:38:49.144 INFO:teuthology.orchestra.run.smithi098.stdout: "available": true, 2024-09-16T15:38:49.144 INFO:teuthology.orchestra.run.smithi098.stdout: "standbys": [ 2024-09-16T15:38:49.144 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:49.145 INFO:teuthology.orchestra.run.smithi098.stdout: "gid": 4106, 2024-09-16T15:38:49.145 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "y", 2024-09-16T15:38:49.145 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr_features": 4540719139924082687, 2024-09-16T15:38:49.145 INFO:teuthology.orchestra.run.smithi098.stdout: "available_modules": [ 2024-09-16T15:38:49.145 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:49.145 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "alerts", 2024-09-16T15:38:49.145 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-16T15:38:49.145 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-16T15:38:49.145 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-16T15:38:49.145 INFO:teuthology.orchestra.run.smithi098.stdout: "interval": { 2024-09-16T15:38:49.145 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "interval", 2024-09-16T15:38:49.145 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-16T15:38:49.145 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.145 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.146 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "60", 2024-09-16T15:38:49.146 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.146 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.146 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.146 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "How frequently to reexamine health status", 2024-09-16T15:38:49.146 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.146 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.146 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.146 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.146 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-16T15:38:49.146 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-16T15:38:49.146 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.146 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.146 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.147 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.147 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.147 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.147 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.147 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.147 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.147 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.147 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.147 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.147 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.147 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.147 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.147 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.148 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.148 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.148 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.148 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-16T15:38:49.148 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-16T15:38:49.148 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.148 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.148 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.148 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.148 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.148 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.148 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.148 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.148 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.149 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.149 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.149 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.149 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-16T15:38:49.149 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-16T15:38:49.149 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.149 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.149 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.149 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-16T15:38:49.149 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.149 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.149 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.149 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.149 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.150 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.150 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.150 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.150 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.150 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.150 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.150 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.150 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.150 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.150 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.150 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-16T15:38:49.150 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-16T15:38:49.150 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.150 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.151 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.151 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.151 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.151 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.151 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.151 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.151 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.151 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.151 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.151 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.151 INFO:teuthology.orchestra.run.smithi098.stdout: "smtp_destination": { 2024-09-16T15:38:49.151 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "smtp_destination", 2024-09-16T15:38:49.151 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.151 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.152 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.152 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.152 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.152 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.152 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.152 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-16T15:38:49.152 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.152 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.152 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.152 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.152 INFO:teuthology.orchestra.run.smithi098.stdout: "smtp_from_name": { 2024-09-16T15:38:49.152 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "smtp_from_name", 2024-09-16T15:38:49.152 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.153 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.153 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.153 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "Ceph", 2024-09-16T15:38:49.153 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.153 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.153 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.153 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Email From: name", 2024-09-16T15:38:49.153 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.153 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.153 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.153 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.153 INFO:teuthology.orchestra.run.smithi098.stdout: "smtp_host": { 2024-09-16T15:38:49.153 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "smtp_host", 2024-09-16T15:38:49.153 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.154 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.154 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.154 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.154 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.154 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.154 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.154 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "SMTP server", 2024-09-16T15:38:49.154 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.154 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.154 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.154 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.154 INFO:teuthology.orchestra.run.smithi098.stdout: "smtp_password": { 2024-09-16T15:38:49.154 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "smtp_password", 2024-09-16T15:38:49.154 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.154 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.155 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.155 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.155 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.155 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.155 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.155 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Password to authenticate with", 2024-09-16T15:38:49.155 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.155 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.155 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.155 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.155 INFO:teuthology.orchestra.run.smithi098.stdout: "smtp_port": { 2024-09-16T15:38:49.155 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "smtp_port", 2024-09-16T15:38:49.155 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.155 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.155 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.155 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "465", 2024-09-16T15:38:49.156 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.156 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.156 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.156 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "SMTP port", 2024-09-16T15:38:49.156 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.156 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.156 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.156 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.156 INFO:teuthology.orchestra.run.smithi098.stdout: "smtp_sender": { 2024-09-16T15:38:49.156 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "smtp_sender", 2024-09-16T15:38:49.156 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.156 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.156 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.157 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.157 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.157 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.157 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.157 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "SMTP envelope sender", 2024-09-16T15:38:49.157 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.157 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.157 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.157 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.157 INFO:teuthology.orchestra.run.smithi098.stdout: "smtp_ssl": { 2024-09-16T15:38:49.157 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "smtp_ssl", 2024-09-16T15:38:49.157 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.157 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.157 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.158 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-16T15:38:49.158 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.158 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.158 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.158 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-16T15:38:49.158 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.158 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.158 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.158 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.158 INFO:teuthology.orchestra.run.smithi098.stdout: "smtp_user": { 2024-09-16T15:38:49.158 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "smtp_user", 2024-09-16T15:38:49.158 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.158 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.158 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.158 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.158 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.159 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.159 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.159 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "User to authenticate as", 2024-09-16T15:38:49.159 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.159 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.159 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.159 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.159 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-16T15:38:49.159 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-16T15:38:49.159 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.159 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-16T15:38:49.159 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.159 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-16T15:38:49.159 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.159 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.159 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.160 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.160 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.160 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.160 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.160 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.160 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.160 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.160 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:49.160 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "balancer", 2024-09-16T15:38:49.160 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-16T15:38:49.160 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-16T15:38:49.160 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-16T15:38:49.160 INFO:teuthology.orchestra.run.smithi098.stdout: "active": { 2024-09-16T15:38:49.160 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "active", 2024-09-16T15:38:49.160 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.161 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.161 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.161 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-16T15:38:49.161 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.161 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.161 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.161 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "automatically balance PGs across cluster", 2024-09-16T15:38:49.161 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.161 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.161 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.161 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.161 INFO:teuthology.orchestra.run.smithi098.stdout: "begin_time": { 2024-09-16T15:38:49.161 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "begin_time", 2024-09-16T15:38:49.161 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.161 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.161 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.162 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0000", 2024-09-16T15:38:49.162 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.162 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.162 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.162 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "beginning time of day to automatically balance", 2024-09-16T15:38:49.162 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-16T15:38:49.162 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.162 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.162 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.162 INFO:teuthology.orchestra.run.smithi098.stdout: "begin_weekday": { 2024-09-16T15:38:49.162 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "begin_weekday", 2024-09-16T15:38:49.162 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "uint", 2024-09-16T15:38:49.162 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.162 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.163 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-16T15:38:49.163 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "0", 2024-09-16T15:38:49.163 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "6", 2024-09-16T15:38:49.163 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.163 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-16T15:38:49.163 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-16T15:38:49.163 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.163 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.163 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.163 INFO:teuthology.orchestra.run.smithi098.stdout: "crush_compat_max_iterations": { 2024-09-16T15:38:49.163 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "crush_compat_max_iterations", 2024-09-16T15:38:49.163 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "uint", 2024-09-16T15:38:49.163 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.163 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.163 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "25", 2024-09-16T15:38:49.164 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "1", 2024-09-16T15:38:49.164 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "250", 2024-09-16T15:38:49.164 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.164 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-16T15:38:49.164 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.164 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.164 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.164 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.164 INFO:teuthology.orchestra.run.smithi098.stdout: "crush_compat_metrics": { 2024-09-16T15:38:49.164 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "crush_compat_metrics", 2024-09-16T15:38:49.164 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.164 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.164 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.164 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "pgs,objects,bytes", 2024-09-16T15:38:49.165 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.165 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.165 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.165 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-16T15:38:49.165 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-16T15:38:49.165 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.165 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.165 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.165 INFO:teuthology.orchestra.run.smithi098.stdout: "crush_compat_step": { 2024-09-16T15:38:49.165 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "crush_compat_step", 2024-09-16T15:38:49.165 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "float", 2024-09-16T15:38:49.165 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.165 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.165 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0.5", 2024-09-16T15:38:49.166 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "0.001", 2024-09-16T15:38:49.166 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "0.999", 2024-09-16T15:38:49.166 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.166 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "aggressiveness of optimization", 2024-09-16T15:38:49.166 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-16T15:38:49.166 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.166 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.166 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.166 INFO:teuthology.orchestra.run.smithi098.stdout: "end_time": { 2024-09-16T15:38:49.166 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "end_time", 2024-09-16T15:38:49.166 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.166 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.166 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.167 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "2359", 2024-09-16T15:38:49.167 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.167 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.167 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.167 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "ending time of day to automatically balance", 2024-09-16T15:38:49.167 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-16T15:38:49.167 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.167 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.167 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.167 INFO:teuthology.orchestra.run.smithi098.stdout: "end_weekday": { 2024-09-16T15:38:49.167 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "end_weekday", 2024-09-16T15:38:49.167 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "uint", 2024-09-16T15:38:49.167 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.167 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.168 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-16T15:38:49.168 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "0", 2024-09-16T15:38:49.168 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "6", 2024-09-16T15:38:49.168 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.168 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-16T15:38:49.168 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-16T15:38:49.168 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.168 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.168 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.168 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-16T15:38:49.168 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-16T15:38:49.168 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.169 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.169 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.169 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.169 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.169 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.169 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.169 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.169 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.169 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.169 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.169 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.169 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.169 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.169 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.170 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.170 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.170 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.170 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.170 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-16T15:38:49.170 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-16T15:38:49.170 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.170 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.170 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.170 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.170 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.170 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.170 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.170 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.170 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.170 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.171 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.171 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.171 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-16T15:38:49.171 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-16T15:38:49.171 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.171 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.171 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.171 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-16T15:38:49.171 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.171 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.171 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.171 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.171 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.171 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.171 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.172 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.172 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.172 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.172 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.172 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.172 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.172 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.172 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.172 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-16T15:38:49.172 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-16T15:38:49.172 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.172 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.172 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.172 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.172 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.173 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.173 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.173 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.173 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.173 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.173 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.173 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.173 INFO:teuthology.orchestra.run.smithi098.stdout: "min_score": { 2024-09-16T15:38:49.173 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "min_score", 2024-09-16T15:38:49.173 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "float", 2024-09-16T15:38:49.173 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.173 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.173 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-16T15:38:49.173 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.173 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.174 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.174 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-16T15:38:49.174 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.174 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.174 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.174 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.174 INFO:teuthology.orchestra.run.smithi098.stdout: "mode": { 2024-09-16T15:38:49.174 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "mode", 2024-09-16T15:38:49.174 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.174 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.174 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.174 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "upmap", 2024-09-16T15:38:49.174 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.174 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.174 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.174 INFO:teuthology.orchestra.run.smithi098.stdout: "crush-compat", 2024-09-16T15:38:49.175 INFO:teuthology.orchestra.run.smithi098.stdout: "none", 2024-09-16T15:38:49.175 INFO:teuthology.orchestra.run.smithi098.stdout: "read", 2024-09-16T15:38:49.175 INFO:teuthology.orchestra.run.smithi098.stdout: "upmap", 2024-09-16T15:38:49.175 INFO:teuthology.orchestra.run.smithi098.stdout: "upmap-read" 2024-09-16T15:38:49.175 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.175 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Balancer mode", 2024-09-16T15:38:49.175 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.175 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.175 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.175 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.175 INFO:teuthology.orchestra.run.smithi098.stdout: "pool_ids": { 2024-09-16T15:38:49.175 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "pool_ids", 2024-09-16T15:38:49.175 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.175 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.175 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.176 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.176 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.176 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.176 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.176 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-16T15:38:49.176 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.176 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.176 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.176 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.176 INFO:teuthology.orchestra.run.smithi098.stdout: "sleep_interval": { 2024-09-16T15:38:49.176 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sleep_interval", 2024-09-16T15:38:49.176 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-16T15:38:49.176 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.176 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.176 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "60", 2024-09-16T15:38:49.177 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.177 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.177 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.177 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-16T15:38:49.177 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.177 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.177 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.177 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.177 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-16T15:38:49.177 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-16T15:38:49.177 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.177 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-16T15:38:49.177 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.177 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-16T15:38:49.177 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.178 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.178 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.178 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.178 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.178 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.178 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.178 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.178 INFO:teuthology.orchestra.run.smithi098.stdout: "upmap_max_deviation": { 2024-09-16T15:38:49.178 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "upmap_max_deviation", 2024-09-16T15:38:49.178 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.178 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.178 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.178 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "5", 2024-09-16T15:38:49.178 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "1", 2024-09-16T15:38:49.179 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.179 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.179 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-16T15:38:49.179 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-16T15:38:49.179 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.179 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.179 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.179 INFO:teuthology.orchestra.run.smithi098.stdout: "upmap_max_optimizations": { 2024-09-16T15:38:49.179 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "upmap_max_optimizations", 2024-09-16T15:38:49.179 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "uint", 2024-09-16T15:38:49.179 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.179 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.179 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "10", 2024-09-16T15:38:49.179 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.179 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.179 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.180 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-16T15:38:49.180 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.180 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.180 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.180 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.180 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.180 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.180 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:49.180 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "cephadm", 2024-09-16T15:38:49.180 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-16T15:38:49.180 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-16T15:38:49.180 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-16T15:38:49.180 INFO:teuthology.orchestra.run.smithi098.stdout: "agent_down_multiplier": { 2024-09-16T15:38:49.180 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "agent_down_multiplier", 2024-09-16T15:38:49.180 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "float", 2024-09-16T15:38:49.181 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.181 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.181 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "3.0", 2024-09-16T15:38:49.181 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.181 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.181 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.181 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-16T15:38:49.181 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.181 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.181 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.181 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.181 INFO:teuthology.orchestra.run.smithi098.stdout: "agent_refresh_rate": { 2024-09-16T15:38:49.181 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "agent_refresh_rate", 2024-09-16T15:38:49.181 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-16T15:38:49.182 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.182 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.182 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "20", 2024-09-16T15:38:49.182 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.182 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.182 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.182 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-16T15:38:49.182 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.182 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.182 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.182 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.182 INFO:teuthology.orchestra.run.smithi098.stdout: "agent_starting_port": { 2024-09-16T15:38:49.182 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "agent_starting_port", 2024-09-16T15:38:49.182 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.182 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.182 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.183 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "4721", 2024-09-16T15:38:49.183 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.183 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.183 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.183 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-16T15:38:49.183 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.183 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.183 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.183 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.183 INFO:teuthology.orchestra.run.smithi098.stdout: "allow_ptrace": { 2024-09-16T15:38:49.183 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "allow_ptrace", 2024-09-16T15:38:49.183 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.183 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.183 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.183 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.184 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.184 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.184 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.184 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-16T15:38:49.184 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-16T15:38:49.184 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.184 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.184 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.184 INFO:teuthology.orchestra.run.smithi098.stdout: "autotune_interval": { 2024-09-16T15:38:49.184 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "autotune_interval", 2024-09-16T15:38:49.184 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-16T15:38:49.184 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.184 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.184 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "600", 2024-09-16T15:38:49.184 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.185 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.185 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.185 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-16T15:38:49.185 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.185 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.185 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.185 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.185 INFO:teuthology.orchestra.run.smithi098.stdout: "autotune_memory_target_ratio": { 2024-09-16T15:38:49.185 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "autotune_memory_target_ratio", 2024-09-16T15:38:49.185 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "float", 2024-09-16T15:38:49.185 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.185 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.185 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0.7", 2024-09-16T15:38:49.185 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.185 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.185 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.186 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-16T15:38:49.186 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.186 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.186 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.186 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.186 INFO:teuthology.orchestra.run.smithi098.stdout: "cephadm_log_destination": { 2024-09-16T15:38:49.186 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "cephadm_log_destination", 2024-09-16T15:38:49.186 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.186 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.186 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.186 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.186 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.186 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.186 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.186 INFO:teuthology.orchestra.run.smithi098.stdout: "file", 2024-09-16T15:38:49.186 INFO:teuthology.orchestra.run.smithi098.stdout: "file,syslog", 2024-09-16T15:38:49.187 INFO:teuthology.orchestra.run.smithi098.stdout: "syslog" 2024-09-16T15:38:49.187 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.187 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-16T15:38:49.187 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.187 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.187 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.187 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.187 INFO:teuthology.orchestra.run.smithi098.stdout: "cgroups_split": { 2024-09-16T15:38:49.187 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "cgroups_split", 2024-09-16T15:38:49.187 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.187 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.187 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.187 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-16T15:38:49.187 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.188 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.188 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.188 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-16T15:38:49.188 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.188 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.188 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.188 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.188 INFO:teuthology.orchestra.run.smithi098.stdout: "config_checks_enabled": { 2024-09-16T15:38:49.188 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "config_checks_enabled", 2024-09-16T15:38:49.188 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.188 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.188 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.188 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.188 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.188 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.188 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.189 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-16T15:38:49.189 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.189 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.189 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.189 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.189 INFO:teuthology.orchestra.run.smithi098.stdout: "config_dashboard": { 2024-09-16T15:38:49.189 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "config_dashboard", 2024-09-16T15:38:49.189 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.189 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.189 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.189 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-16T15:38:49.189 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.189 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.189 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.189 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-16T15:38:49.190 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.190 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.190 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.190 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.190 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_alertmanager": { 2024-09-16T15:38:49.190 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_alertmanager", 2024-09-16T15:38:49.190 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.190 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.190 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.190 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-16T15:38:49.190 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.190 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.190 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.190 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Prometheus container image", 2024-09-16T15:38:49.190 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.190 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.191 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.191 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.191 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_base": { 2024-09-16T15:38:49.191 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_base", 2024-09-16T15:38:49.191 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.191 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.191 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.191 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-16T15:38:49.191 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.191 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.191 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.191 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Container image name, without the tag", 2024-09-16T15:38:49.191 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.191 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.191 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.191 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.192 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_elasticsearch": { 2024-09-16T15:38:49.192 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_elasticsearch", 2024-09-16T15:38:49.192 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.192 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.192 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.192 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-16T15:38:49.192 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.192 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.192 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.192 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "elasticsearch container image", 2024-09-16T15:38:49.192 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.192 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.192 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.192 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.192 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_grafana": { 2024-09-16T15:38:49.193 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_grafana", 2024-09-16T15:38:49.193 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.193 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.193 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.193 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-09-16T15:38:49.193 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.193 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.193 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.193 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Prometheus container image", 2024-09-16T15:38:49.193 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.193 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.193 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.193 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.193 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_haproxy": { 2024-09-16T15:38:49.193 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_haproxy", 2024-09-16T15:38:49.194 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.194 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.194 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.194 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-16T15:38:49.194 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.194 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.194 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.194 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "HAproxy container image", 2024-09-16T15:38:49.194 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.194 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.194 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.194 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.194 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_jaeger_agent": { 2024-09-16T15:38:49.194 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_jaeger_agent", 2024-09-16T15:38:49.194 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.195 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.195 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.195 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-16T15:38:49.195 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.195 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.195 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.195 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Jaeger agent container image", 2024-09-16T15:38:49.195 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.195 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.195 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.195 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.195 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_jaeger_collector": { 2024-09-16T15:38:49.195 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_jaeger_collector", 2024-09-16T15:38:49.195 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.195 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.196 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.196 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-16T15:38:49.196 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.196 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.196 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.196 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Jaeger collector container image", 2024-09-16T15:38:49.196 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.196 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.196 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.196 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.196 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_jaeger_query": { 2024-09-16T15:38:49.196 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_jaeger_query", 2024-09-16T15:38:49.196 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.196 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.196 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.197 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-16T15:38:49.197 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.197 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.197 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.197 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Jaeger query container image", 2024-09-16T15:38:49.197 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.197 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.197 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.197 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.197 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_keepalived": { 2024-09-16T15:38:49.197 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_keepalived", 2024-09-16T15:38:49.197 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.197 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.197 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.197 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-16T15:38:49.198 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.198 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.198 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.198 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Keepalived container image", 2024-09-16T15:38:49.198 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.198 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.198 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.198 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.198 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_loki": { 2024-09-16T15:38:49.198 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_loki", 2024-09-16T15:38:49.198 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.198 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.198 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.198 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-16T15:38:49.198 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.198 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.199 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.199 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Loki container image", 2024-09-16T15:38:49.199 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.199 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.199 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.199 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.199 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_nginx": { 2024-09-16T15:38:49.199 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_nginx", 2024-09-16T15:38:49.199 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.199 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.199 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.199 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-16T15:38:49.199 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.199 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.200 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.200 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Nginx container image", 2024-09-16T15:38:49.200 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.200 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.200 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.200 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.200 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_node_exporter": { 2024-09-16T15:38:49.200 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_node_exporter", 2024-09-16T15:38:49.200 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.200 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.200 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.200 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-16T15:38:49.200 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.200 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.200 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.200 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Prometheus container image", 2024-09-16T15:38:49.201 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.201 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.201 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.201 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.201 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_nvmeof": { 2024-09-16T15:38:49.201 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_nvmeof", 2024-09-16T15:38:49.201 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.201 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.201 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.201 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-16T15:38:49.201 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.201 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.201 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.201 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Nvme-of container image", 2024-09-16T15:38:49.201 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.202 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.202 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.202 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.202 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_oauth2_proxy": { 2024-09-16T15:38:49.202 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_oauth2_proxy", 2024-09-16T15:38:49.202 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.202 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.202 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.202 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-16T15:38:49.202 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.202 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.202 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.202 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "oauth2-proxy container image", 2024-09-16T15:38:49.202 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.202 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.203 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.203 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.203 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_prometheus": { 2024-09-16T15:38:49.203 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_prometheus", 2024-09-16T15:38:49.203 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.203 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.203 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.203 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-16T15:38:49.203 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.203 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.203 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.203 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Prometheus container image", 2024-09-16T15:38:49.203 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.203 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.203 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.204 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.204 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_promtail": { 2024-09-16T15:38:49.204 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_promtail", 2024-09-16T15:38:49.204 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.204 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.204 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.204 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-16T15:38:49.204 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.204 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.204 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.204 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Promtail container image", 2024-09-16T15:38:49.204 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.204 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.204 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.204 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.205 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_samba": { 2024-09-16T15:38:49.205 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_samba", 2024-09-16T15:38:49.205 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.205 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.205 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.205 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-16T15:38:49.205 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.205 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.205 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.205 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Samba/SMB container image", 2024-09-16T15:38:49.205 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.205 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.205 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.205 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.205 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_samba_metrics": { 2024-09-16T15:38:49.206 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_samba_metrics", 2024-09-16T15:38:49.206 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.206 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.206 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.206 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-16T15:38:49.206 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.206 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.206 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.206 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-16T15:38:49.206 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.206 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.206 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.207 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.207 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_snmp_gateway": { 2024-09-16T15:38:49.207 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_snmp_gateway", 2024-09-16T15:38:49.207 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.207 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.207 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.207 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-16T15:38:49.207 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.207 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.207 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.207 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "SNMP Gateway container image", 2024-09-16T15:38:49.207 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.207 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.207 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.207 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.208 INFO:teuthology.orchestra.run.smithi098.stdout: "container_init": { 2024-09-16T15:38:49.208 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_init", 2024-09-16T15:38:49.208 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.208 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.208 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.208 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-16T15:38:49.208 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.208 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.208 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.208 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Run podman/docker with `--init`", 2024-09-16T15:38:49.208 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.208 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.208 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.208 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.209 INFO:teuthology.orchestra.run.smithi098.stdout: "daemon_cache_timeout": { 2024-09-16T15:38:49.209 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "daemon_cache_timeout", 2024-09-16T15:38:49.209 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-16T15:38:49.209 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.209 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.209 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "600", 2024-09-16T15:38:49.209 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.209 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.209 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.209 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-16T15:38:49.209 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.209 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.209 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.209 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.209 INFO:teuthology.orchestra.run.smithi098.stdout: "default_cephadm_command_timeout": { 2024-09-16T15:38:49.210 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "default_cephadm_command_timeout", 2024-09-16T15:38:49.210 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.210 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.210 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.210 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "900", 2024-09-16T15:38:49.210 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.210 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.210 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.210 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-16T15:38:49.210 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.210 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.210 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.210 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.210 INFO:teuthology.orchestra.run.smithi098.stdout: "default_registry": { 2024-09-16T15:38:49.210 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "default_registry", 2024-09-16T15:38:49.210 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.211 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.211 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.211 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "docker.io", 2024-09-16T15:38:49.211 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.211 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.211 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.211 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-16T15:38:49.211 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.211 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.211 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.211 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.211 INFO:teuthology.orchestra.run.smithi098.stdout: "device_cache_timeout": { 2024-09-16T15:38:49.211 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "device_cache_timeout", 2024-09-16T15:38:49.211 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-16T15:38:49.211 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.212 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.212 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "1800", 2024-09-16T15:38:49.212 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.212 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.212 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.212 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "seconds to cache device inventory", 2024-09-16T15:38:49.212 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.212 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.212 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.212 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.212 INFO:teuthology.orchestra.run.smithi098.stdout: "device_enhanced_scan": { 2024-09-16T15:38:49.212 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "device_enhanced_scan", 2024-09-16T15:38:49.212 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.212 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.212 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.213 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.213 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.213 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.213 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.213 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-16T15:38:49.213 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.213 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.213 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.213 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.213 INFO:teuthology.orchestra.run.smithi098.stdout: "facts_cache_timeout": { 2024-09-16T15:38:49.213 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "facts_cache_timeout", 2024-09-16T15:38:49.213 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-16T15:38:49.213 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.214 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.214 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "60", 2024-09-16T15:38:49.214 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.214 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.214 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.214 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "seconds to cache host facts data", 2024-09-16T15:38:49.214 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.214 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.214 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.214 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.214 INFO:teuthology.orchestra.run.smithi098.stdout: "grafana_dashboards_path": { 2024-09-16T15:38:49.214 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "grafana_dashboards_path", 2024-09-16T15:38:49.214 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.214 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.214 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.215 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-16T15:38:49.215 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.215 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.215 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.215 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-16T15:38:49.215 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.215 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.215 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.215 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.215 INFO:teuthology.orchestra.run.smithi098.stdout: "host_check_interval": { 2024-09-16T15:38:49.215 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "host_check_interval", 2024-09-16T15:38:49.215 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-16T15:38:49.215 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.216 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.216 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "600", 2024-09-16T15:38:49.216 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.216 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.216 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.216 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "how frequently to perform a host check", 2024-09-16T15:38:49.216 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.216 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.216 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.216 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.216 INFO:teuthology.orchestra.run.smithi098.stdout: "hw_monitoring": { 2024-09-16T15:38:49.216 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "hw_monitoring", 2024-09-16T15:38:49.216 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.216 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.217 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.217 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.217 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.217 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.217 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.217 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-16T15:38:49.217 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.217 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.217 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.217 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.217 INFO:teuthology.orchestra.run.smithi098.stdout: "inventory_list_all": { 2024-09-16T15:38:49.217 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "inventory_list_all", 2024-09-16T15:38:49.217 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.217 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.218 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.218 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.218 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.218 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.218 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.218 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-16T15:38:49.218 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.218 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.218 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.218 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.218 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-16T15:38:49.218 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-16T15:38:49.218 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.218 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.219 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.219 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.219 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.219 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.219 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.219 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.219 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.219 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.219 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.219 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.219 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.219 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.219 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.219 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.219 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.220 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.220 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.220 INFO:teuthology.orchestra.run.smithi098.stdout: "log_refresh_metadata": { 2024-09-16T15:38:49.220 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_refresh_metadata", 2024-09-16T15:38:49.220 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.220 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.220 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.220 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.220 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.220 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.220 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.220 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-16T15:38:49.220 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.220 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.220 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.221 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.221 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-16T15:38:49.221 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-16T15:38:49.221 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.221 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.221 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.221 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-16T15:38:49.221 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.221 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.221 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.221 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-16T15:38:49.221 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.221 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.221 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.222 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.222 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-16T15:38:49.222 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-16T15:38:49.222 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.222 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.222 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.222 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-16T15:38:49.222 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.222 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.222 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.222 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.222 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.222 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.222 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.222 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.223 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.223 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.223 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.223 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.223 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.223 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.223 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.223 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-16T15:38:49.223 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-16T15:38:49.223 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.223 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.223 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.223 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.223 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.223 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.224 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.224 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.224 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.224 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.224 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.224 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.224 INFO:teuthology.orchestra.run.smithi098.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-16T15:38:49.224 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-16T15:38:49.224 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.224 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.224 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.224 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.224 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.225 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.225 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.225 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-16T15:38:49.225 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.225 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.225 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.225 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.225 INFO:teuthology.orchestra.run.smithi098.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-16T15:38:49.225 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-16T15:38:49.225 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.225 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.225 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.225 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "*", 2024-09-16T15:38:49.225 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.226 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.226 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.226 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-16T15:38:49.226 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.226 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.226 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.226 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.226 INFO:teuthology.orchestra.run.smithi098.stdout: "max_count_per_host": { 2024-09-16T15:38:49.226 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "max_count_per_host", 2024-09-16T15:38:49.226 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.226 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.226 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.226 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "10", 2024-09-16T15:38:49.226 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.226 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.227 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.227 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "max number of daemons per service per host", 2024-09-16T15:38:49.227 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.227 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.227 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.227 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.227 INFO:teuthology.orchestra.run.smithi098.stdout: "max_osd_draining_count": { 2024-09-16T15:38:49.227 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "max_osd_draining_count", 2024-09-16T15:38:49.227 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.227 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.227 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.227 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "10", 2024-09-16T15:38:49.227 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.228 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.228 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.228 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-16T15:38:49.228 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.228 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.228 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.228 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.228 INFO:teuthology.orchestra.run.smithi098.stdout: "migration_current": { 2024-09-16T15:38:49.228 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "migration_current", 2024-09-16T15:38:49.228 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.228 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.228 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.228 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.228 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.229 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.229 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.229 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "internal - do not modify", 2024-09-16T15:38:49.229 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.229 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.229 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.229 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.229 INFO:teuthology.orchestra.run.smithi098.stdout: "mode": { 2024-09-16T15:38:49.229 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "mode", 2024-09-16T15:38:49.229 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.229 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.229 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.229 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "root", 2024-09-16T15:38:49.229 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.230 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.230 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.230 INFO:teuthology.orchestra.run.smithi098.stdout: "cephadm-package", 2024-09-16T15:38:49.230 INFO:teuthology.orchestra.run.smithi098.stdout: "root" 2024-09-16T15:38:49.230 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.230 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "mode for remote execution of cephadm", 2024-09-16T15:38:49.230 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.230 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.230 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.230 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.230 INFO:teuthology.orchestra.run.smithi098.stdout: "oob_default_addr": { 2024-09-16T15:38:49.230 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "oob_default_addr", 2024-09-16T15:38:49.230 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.230 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.230 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.231 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "169.254.1.1", 2024-09-16T15:38:49.231 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.231 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.231 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.231 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-16T15:38:49.231 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.231 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.231 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.231 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.231 INFO:teuthology.orchestra.run.smithi098.stdout: "prometheus_alerts_path": { 2024-09-16T15:38:49.231 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "prometheus_alerts_path", 2024-09-16T15:38:49.231 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.231 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.231 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.231 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-16T15:38:49.231 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.232 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.232 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.232 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-16T15:38:49.232 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.232 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.232 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.232 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.232 INFO:teuthology.orchestra.run.smithi098.stdout: "registry_insecure": { 2024-09-16T15:38:49.232 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "registry_insecure", 2024-09-16T15:38:49.232 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.232 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.232 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.232 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.232 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.233 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.233 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.233 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-16T15:38:49.233 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.233 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.233 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.233 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.233 INFO:teuthology.orchestra.run.smithi098.stdout: "registry_password": { 2024-09-16T15:38:49.233 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "registry_password", 2024-09-16T15:38:49.233 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.233 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.233 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.233 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.233 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.233 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.234 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.234 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-16T15:38:49.234 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.234 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.234 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.234 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.234 INFO:teuthology.orchestra.run.smithi098.stdout: "registry_url": { 2024-09-16T15:38:49.234 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "registry_url", 2024-09-16T15:38:49.234 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.234 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.234 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.234 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.234 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.234 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.234 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.234 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-16T15:38:49.235 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.235 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.235 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.235 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.235 INFO:teuthology.orchestra.run.smithi098.stdout: "registry_username": { 2024-09-16T15:38:49.235 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "registry_username", 2024-09-16T15:38:49.235 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.235 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.235 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.235 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.235 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.235 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.235 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.235 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-16T15:38:49.235 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.235 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.236 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.236 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.236 INFO:teuthology.orchestra.run.smithi098.stdout: "secure_monitoring_stack": { 2024-09-16T15:38:49.236 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "secure_monitoring_stack", 2024-09-16T15:38:49.236 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.236 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.236 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.236 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.236 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.236 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.236 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.236 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-16T15:38:49.236 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.236 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.236 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.237 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.237 INFO:teuthology.orchestra.run.smithi098.stdout: "service_discovery_port": { 2024-09-16T15:38:49.237 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "service_discovery_port", 2024-09-16T15:38:49.237 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.237 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.237 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.237 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "8765", 2024-09-16T15:38:49.237 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.237 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.237 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.237 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "cephadm service discovery port", 2024-09-16T15:38:49.237 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.237 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.237 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.238 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.238 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-16T15:38:49.238 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-16T15:38:49.238 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.238 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-16T15:38:49.238 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.238 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-16T15:38:49.238 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.238 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.238 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.238 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.238 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.238 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.238 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.238 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.239 INFO:teuthology.orchestra.run.smithi098.stdout: "ssh_config_file": { 2024-09-16T15:38:49.239 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "ssh_config_file", 2024-09-16T15:38:49.239 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.239 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.239 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.239 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.239 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.239 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.239 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.239 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-16T15:38:49.239 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.239 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.239 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.239 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.239 INFO:teuthology.orchestra.run.smithi098.stdout: "ssh_keepalive_count_max": { 2024-09-16T15:38:49.239 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "ssh_keepalive_count_max", 2024-09-16T15:38:49.240 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.240 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.240 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.240 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "3", 2024-09-16T15:38:49.240 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.240 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.240 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.240 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-16T15:38:49.240 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.240 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.240 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.240 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.240 INFO:teuthology.orchestra.run.smithi098.stdout: "ssh_keepalive_interval": { 2024-09-16T15:38:49.240 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "ssh_keepalive_interval", 2024-09-16T15:38:49.240 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.241 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.241 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.241 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "7", 2024-09-16T15:38:49.241 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.241 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.241 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.241 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-16T15:38:49.241 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.241 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.241 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.241 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.241 INFO:teuthology.orchestra.run.smithi098.stdout: "use_agent": { 2024-09-16T15:38:49.241 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "use_agent", 2024-09-16T15:38:49.241 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.241 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.241 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.242 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.242 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.242 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.242 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.242 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-16T15:38:49.242 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.242 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.242 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.242 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.242 INFO:teuthology.orchestra.run.smithi098.stdout: "use_repo_digest": { 2024-09-16T15:38:49.242 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "use_repo_digest", 2024-09-16T15:38:49.242 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.242 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.242 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.242 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-16T15:38:49.242 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.243 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.243 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.243 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-16T15:38:49.243 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.243 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.243 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.243 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.243 INFO:teuthology.orchestra.run.smithi098.stdout: "warn_on_failed_host_check": { 2024-09-16T15:38:49.243 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "warn_on_failed_host_check", 2024-09-16T15:38:49.243 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.243 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.243 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.243 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-16T15:38:49.243 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.243 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.243 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.244 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "raise a health warning if the host check fails", 2024-09-16T15:38:49.244 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.244 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.244 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.244 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.244 INFO:teuthology.orchestra.run.smithi098.stdout: "warn_on_stray_daemons": { 2024-09-16T15:38:49.244 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "warn_on_stray_daemons", 2024-09-16T15:38:49.244 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.244 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.244 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.244 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-16T15:38:49.244 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.244 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.244 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.244 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-16T15:38:49.245 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.245 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.245 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.245 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.245 INFO:teuthology.orchestra.run.smithi098.stdout: "warn_on_stray_hosts": { 2024-09-16T15:38:49.245 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "warn_on_stray_hosts", 2024-09-16T15:38:49.245 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.245 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.245 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.245 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-16T15:38:49.245 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.245 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.245 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.245 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-16T15:38:49.245 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.245 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.246 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.246 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.246 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.246 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.246 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:49.246 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "crash", 2024-09-16T15:38:49.246 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-16T15:38:49.246 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-16T15:38:49.246 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-16T15:38:49.246 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-16T15:38:49.246 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-16T15:38:49.246 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.246 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.246 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.247 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.247 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.247 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.247 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.247 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.247 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.247 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.247 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.247 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.247 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.247 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.247 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.247 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.247 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.248 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.248 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.248 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-16T15:38:49.248 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-16T15:38:49.248 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.248 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.248 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.248 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.248 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.248 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.248 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.248 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.248 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.248 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.248 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.248 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.249 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-16T15:38:49.249 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-16T15:38:49.249 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.249 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.249 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.249 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-16T15:38:49.249 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.249 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.249 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.249 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.249 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.249 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.249 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.249 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.250 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.250 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.250 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.250 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.250 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.250 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.250 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.250 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-16T15:38:49.250 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-16T15:38:49.250 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.250 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.250 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.250 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.250 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.251 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.251 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.251 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.251 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.251 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.251 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.251 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.251 INFO:teuthology.orchestra.run.smithi098.stdout: "retain_interval": { 2024-09-16T15:38:49.251 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "retain_interval", 2024-09-16T15:38:49.251 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-16T15:38:49.251 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.251 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.251 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "31536000", 2024-09-16T15:38:49.251 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.252 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.252 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.252 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-16T15:38:49.252 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.252 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.252 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.252 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.252 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-16T15:38:49.252 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-16T15:38:49.252 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.252 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-16T15:38:49.252 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.252 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-16T15:38:49.252 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.253 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.253 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.253 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.253 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.253 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.253 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.253 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.253 INFO:teuthology.orchestra.run.smithi098.stdout: "warn_recent_interval": { 2024-09-16T15:38:49.253 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "warn_recent_interval", 2024-09-16T15:38:49.253 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-16T15:38:49.253 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.253 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.253 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "1209600", 2024-09-16T15:38:49.253 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.254 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.254 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.254 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-16T15:38:49.254 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.254 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.254 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.254 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.254 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.254 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.254 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:49.254 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "dashboard", 2024-09-16T15:38:49.254 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-16T15:38:49.254 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-16T15:38:49.254 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-16T15:38:49.254 INFO:teuthology.orchestra.run.smithi098.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-16T15:38:49.255 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-16T15:38:49.255 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.255 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.255 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.255 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "10", 2024-09-16T15:38:49.255 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.255 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.255 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.255 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.255 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.255 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.255 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.255 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.255 INFO:teuthology.orchestra.run.smithi098.stdout: "ALERTMANAGER_API_HOST": { 2024-09-16T15:38:49.256 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-16T15:38:49.256 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.256 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.256 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.256 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.256 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.256 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.256 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.256 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.256 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.256 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.256 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.256 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.256 INFO:teuthology.orchestra.run.smithi098.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-16T15:38:49.257 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-16T15:38:49.257 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.257 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.257 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.257 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-16T15:38:49.257 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.257 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.257 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.257 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.257 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.257 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.257 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.257 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.257 INFO:teuthology.orchestra.run.smithi098.stdout: "AUDIT_API_ENABLED": { 2024-09-16T15:38:49.258 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "AUDIT_API_ENABLED", 2024-09-16T15:38:49.258 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.258 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.258 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.258 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.258 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.258 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.258 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.258 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.258 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.258 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.258 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.258 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.258 INFO:teuthology.orchestra.run.smithi098.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-16T15:38:49.259 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-16T15:38:49.259 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.259 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.259 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.259 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-16T15:38:49.259 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.259 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.259 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.259 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.259 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.259 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.259 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.259 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.259 INFO:teuthology.orchestra.run.smithi098.stdout: "ENABLE_BROWSABLE_API": { 2024-09-16T15:38:49.259 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-16T15:38:49.260 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.260 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.260 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.260 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-16T15:38:49.260 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.260 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.260 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.260 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.260 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.260 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.260 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.260 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.260 INFO:teuthology.orchestra.run.smithi098.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-16T15:38:49.260 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-16T15:38:49.261 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.261 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.261 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.261 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-16T15:38:49.261 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.261 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.261 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.261 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.261 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.261 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.261 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.261 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.261 INFO:teuthology.orchestra.run.smithi098.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-16T15:38:49.261 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-16T15:38:49.262 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.262 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.262 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.262 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-16T15:38:49.262 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.262 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.262 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.262 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.262 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.262 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.262 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.262 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.262 INFO:teuthology.orchestra.run.smithi098.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-16T15:38:49.262 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-16T15:38:49.262 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.263 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.263 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.263 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-16T15:38:49.263 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.263 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.263 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.263 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.263 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.263 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.263 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.263 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.263 INFO:teuthology.orchestra.run.smithi098.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-16T15:38:49.263 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-16T15:38:49.263 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.263 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.263 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.264 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-16T15:38:49.264 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.264 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.264 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.264 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.264 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.264 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.264 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.264 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.264 INFO:teuthology.orchestra.run.smithi098.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-16T15:38:49.264 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-16T15:38:49.264 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.264 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.264 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.265 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-16T15:38:49.265 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.265 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.265 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.265 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.265 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.265 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.265 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.265 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.265 INFO:teuthology.orchestra.run.smithi098.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-16T15:38:49.265 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-16T15:38:49.265 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.265 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.265 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.265 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-16T15:38:49.265 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.266 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.266 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.266 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.266 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.266 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.266 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.266 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.266 INFO:teuthology.orchestra.run.smithi098.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-16T15:38:49.266 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-16T15:38:49.266 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.266 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.266 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.266 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-16T15:38:49.266 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.266 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.267 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.267 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.267 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.267 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.267 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.267 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.267 INFO:teuthology.orchestra.run.smithi098.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-16T15:38:49.267 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-16T15:38:49.267 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.267 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.267 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.267 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.267 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.267 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.267 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.268 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.268 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.268 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.268 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.268 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.268 INFO:teuthology.orchestra.run.smithi098.stdout: "GRAFANA_API_PASSWORD": { 2024-09-16T15:38:49.268 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-16T15:38:49.268 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.268 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.268 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.268 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "admin", 2024-09-16T15:38:49.268 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.268 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.268 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.269 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.269 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.269 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.269 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.269 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.269 INFO:teuthology.orchestra.run.smithi098.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-16T15:38:49.269 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-16T15:38:49.269 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.269 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.269 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.269 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-16T15:38:49.269 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.269 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.269 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.269 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.269 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.270 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.270 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.270 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.270 INFO:teuthology.orchestra.run.smithi098.stdout: "GRAFANA_API_URL": { 2024-09-16T15:38:49.270 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "GRAFANA_API_URL", 2024-09-16T15:38:49.270 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.270 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.270 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.270 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.270 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.270 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.270 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.270 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.270 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.270 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.271 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.271 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.271 INFO:teuthology.orchestra.run.smithi098.stdout: "GRAFANA_API_USERNAME": { 2024-09-16T15:38:49.271 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-16T15:38:49.271 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.271 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.271 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.271 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "admin", 2024-09-16T15:38:49.271 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.271 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.271 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.271 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.271 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.271 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.271 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.272 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.272 INFO:teuthology.orchestra.run.smithi098.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-16T15:38:49.272 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-16T15:38:49.272 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.272 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.272 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.272 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.272 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.272 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.272 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.272 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.272 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.272 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.272 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.272 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.273 INFO:teuthology.orchestra.run.smithi098.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-16T15:38:49.273 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-16T15:38:49.273 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.273 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.273 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.273 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.273 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.273 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.273 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.273 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.273 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.273 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.274 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.274 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.274 INFO:teuthology.orchestra.run.smithi098.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-16T15:38:49.274 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-16T15:38:49.274 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.274 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.274 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.274 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-16T15:38:49.274 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.274 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.274 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.274 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.274 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.274 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.274 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.275 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.275 INFO:teuthology.orchestra.run.smithi098.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-16T15:38:49.275 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-16T15:38:49.275 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.275 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.275 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.275 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.275 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.275 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.275 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.275 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.275 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.275 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.275 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.276 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.276 INFO:teuthology.orchestra.run.smithi098.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-16T15:38:49.276 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-16T15:38:49.276 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.276 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.276 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.276 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "[]", 2024-09-16T15:38:49.276 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.276 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.276 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.276 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.276 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.276 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.276 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.277 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.277 INFO:teuthology.orchestra.run.smithi098.stdout: "MULTICLUSTER_CONFIG": { 2024-09-16T15:38:49.277 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-16T15:38:49.277 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.277 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.277 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.277 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "{}", 2024-09-16T15:38:49.277 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.277 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.277 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.277 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.277 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.277 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.278 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.278 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.278 INFO:teuthology.orchestra.run.smithi098.stdout: "PROMETHEUS_API_HOST": { 2024-09-16T15:38:49.278 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-16T15:38:49.278 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.278 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.278 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.278 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.278 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.278 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.278 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.278 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.278 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.278 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.279 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.279 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.279 INFO:teuthology.orchestra.run.smithi098.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-16T15:38:49.279 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-16T15:38:49.279 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.279 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.279 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.279 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-16T15:38:49.279 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.279 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.279 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.279 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.279 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.280 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.280 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.280 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.280 INFO:teuthology.orchestra.run.smithi098.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-16T15:38:49.280 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-16T15:38:49.280 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.280 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.280 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.280 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.280 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.280 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.280 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.280 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.280 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.280 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.281 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.281 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.281 INFO:teuthology.orchestra.run.smithi098.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-16T15:38:49.281 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-16T15:38:49.281 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.281 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.281 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.281 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.281 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.281 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.281 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.281 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.281 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.281 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.281 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.282 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.282 INFO:teuthology.orchestra.run.smithi098.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-16T15:38:49.282 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-16T15:38:49.282 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.282 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.282 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.282 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-16T15:38:49.282 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.282 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.282 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.282 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.282 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.282 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.282 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.282 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.283 INFO:teuthology.orchestra.run.smithi098.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-16T15:38:49.283 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-16T15:38:49.283 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.283 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.283 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.283 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-16T15:38:49.283 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.283 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.283 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.283 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.283 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.283 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.283 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.283 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.283 INFO:teuthology.orchestra.run.smithi098.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-16T15:38:49.284 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-16T15:38:49.284 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.284 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.284 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.284 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.284 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.284 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.284 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.284 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.284 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.284 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.284 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.284 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.284 INFO:teuthology.orchestra.run.smithi098.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-16T15:38:49.284 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-16T15:38:49.285 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.285 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.285 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.285 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.285 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.285 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.285 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.285 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.285 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.285 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.285 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.285 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.285 INFO:teuthology.orchestra.run.smithi098.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-16T15:38:49.285 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-16T15:38:49.285 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.286 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.286 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.286 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.286 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.286 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.286 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.286 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.286 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.286 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.286 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.286 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.286 INFO:teuthology.orchestra.run.smithi098.stdout: "PWD_POLICY_ENABLED": { 2024-09-16T15:38:49.286 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-16T15:38:49.286 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.286 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.287 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.287 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-16T15:38:49.287 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.287 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.287 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.287 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.287 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.287 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.287 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.287 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.287 INFO:teuthology.orchestra.run.smithi098.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-16T15:38:49.287 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-16T15:38:49.287 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.287 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.288 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.288 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-16T15:38:49.288 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.288 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.288 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.288 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.288 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.288 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.288 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.288 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.288 INFO:teuthology.orchestra.run.smithi098.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-16T15:38:49.288 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-16T15:38:49.288 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.289 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.289 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.289 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "10", 2024-09-16T15:38:49.289 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.289 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.289 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.289 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.289 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.289 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.289 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.289 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.289 INFO:teuthology.orchestra.run.smithi098.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-16T15:38:49.289 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-16T15:38:49.289 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.290 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.290 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.290 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "8", 2024-09-16T15:38:49.290 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.290 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.290 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.290 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.290 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.290 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.290 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.290 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.290 INFO:teuthology.orchestra.run.smithi098.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-16T15:38:49.290 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-16T15:38:49.290 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.291 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.291 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.291 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "45", 2024-09-16T15:38:49.291 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.291 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.291 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.291 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.291 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.291 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.291 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.291 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.291 INFO:teuthology.orchestra.run.smithi098.stdout: "RGW_API_ACCESS_KEY": { 2024-09-16T15:38:49.291 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-16T15:38:49.291 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.292 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.292 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.292 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.292 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.292 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.292 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.292 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.292 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.292 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.292 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.292 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.292 INFO:teuthology.orchestra.run.smithi098.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-16T15:38:49.292 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-16T15:38:49.292 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.293 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.293 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.293 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "admin", 2024-09-16T15:38:49.293 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.293 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.293 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.293 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.293 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.293 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.293 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.293 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.293 INFO:teuthology.orchestra.run.smithi098.stdout: "RGW_API_SECRET_KEY": { 2024-09-16T15:38:49.293 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-16T15:38:49.293 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.293 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.294 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.294 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.294 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.294 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.294 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.294 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.294 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.294 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.294 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.294 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.294 INFO:teuthology.orchestra.run.smithi098.stdout: "RGW_API_SSL_VERIFY": { 2024-09-16T15:38:49.294 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-16T15:38:49.294 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.294 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.294 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.294 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-16T15:38:49.295 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.295 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.295 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.295 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.295 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.295 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.295 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.295 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.295 INFO:teuthology.orchestra.run.smithi098.stdout: "UNSAFE_TLS_v1_2": { 2024-09-16T15:38:49.295 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-16T15:38:49.295 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.295 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.295 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.295 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.295 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.296 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.296 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.296 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.296 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.296 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.296 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.296 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.296 INFO:teuthology.orchestra.run.smithi098.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-16T15:38:49.296 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-16T15:38:49.296 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.296 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.296 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.296 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-16T15:38:49.296 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.296 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.296 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.297 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.297 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.297 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.297 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.297 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.297 INFO:teuthology.orchestra.run.smithi098.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-16T15:38:49.297 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-16T15:38:49.297 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.297 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.297 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.297 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "10", 2024-09-16T15:38:49.297 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.297 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.297 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.298 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.298 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.298 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.298 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.298 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.298 INFO:teuthology.orchestra.run.smithi098.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-16T15:38:49.298 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-16T15:38:49.298 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.298 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.298 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.298 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "5", 2024-09-16T15:38:49.298 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.298 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.298 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.298 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.298 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.299 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.299 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.299 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.299 INFO:teuthology.orchestra.run.smithi098.stdout: "cross_origin_url": { 2024-09-16T15:38:49.299 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "cross_origin_url", 2024-09-16T15:38:49.299 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.299 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.299 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.299 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.299 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.299 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.299 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.299 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.299 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.299 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.299 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.300 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.300 INFO:teuthology.orchestra.run.smithi098.stdout: "crt_file": { 2024-09-16T15:38:49.300 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "crt_file", 2024-09-16T15:38:49.300 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.300 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.300 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.300 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.300 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.300 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.300 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.300 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.300 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.300 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.300 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.300 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.300 INFO:teuthology.orchestra.run.smithi098.stdout: "debug": { 2024-09-16T15:38:49.301 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "debug", 2024-09-16T15:38:49.301 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.301 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.301 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.301 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.301 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.301 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.301 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.301 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Enable/disable debug options", 2024-09-16T15:38:49.301 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.301 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.301 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.301 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.301 INFO:teuthology.orchestra.run.smithi098.stdout: "jwt_token_ttl": { 2024-09-16T15:38:49.301 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "jwt_token_ttl", 2024-09-16T15:38:49.302 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.302 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.302 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.302 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "28800", 2024-09-16T15:38:49.302 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.302 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.302 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.302 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.302 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.302 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.302 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.302 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.302 INFO:teuthology.orchestra.run.smithi098.stdout: "key_file": { 2024-09-16T15:38:49.302 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "key_file", 2024-09-16T15:38:49.302 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.303 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.303 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.303 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.303 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.303 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.303 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.303 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.303 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.303 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.303 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.303 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.303 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-16T15:38:49.303 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-16T15:38:49.303 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.304 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.304 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.304 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.304 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.304 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.304 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.304 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.304 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.304 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.304 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.304 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.304 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.304 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.304 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.304 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.304 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.305 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.305 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.305 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-16T15:38:49.305 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-16T15:38:49.305 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.305 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.305 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.305 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.305 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.305 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.305 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.305 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.305 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.305 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.305 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.306 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.306 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-16T15:38:49.306 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-16T15:38:49.306 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.306 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.306 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.306 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-16T15:38:49.306 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.306 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.306 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.306 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.306 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.306 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.306 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.306 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.307 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.307 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.307 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.307 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.307 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.307 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.307 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.307 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-16T15:38:49.307 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-16T15:38:49.307 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.307 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.307 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.307 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.307 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.307 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.307 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.308 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.308 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.308 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.308 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.308 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.308 INFO:teuthology.orchestra.run.smithi098.stdout: "motd": { 2024-09-16T15:38:49.308 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "motd", 2024-09-16T15:38:49.308 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.308 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.308 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.308 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.308 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.308 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.308 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.309 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "The message of the day", 2024-09-16T15:38:49.309 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.309 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.309 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.309 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.309 INFO:teuthology.orchestra.run.smithi098.stdout: "redirect_resolve_ip_addr": { 2024-09-16T15:38:49.309 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "redirect_resolve_ip_addr", 2024-09-16T15:38:49.309 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.309 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.309 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.309 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.309 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.309 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.309 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.309 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.309 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.310 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.310 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.310 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.310 INFO:teuthology.orchestra.run.smithi098.stdout: "server_addr": { 2024-09-16T15:38:49.310 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "server_addr", 2024-09-16T15:38:49.310 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.310 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.310 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.310 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "::", 2024-09-16T15:38:49.310 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.310 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.310 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.310 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.310 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.310 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.311 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.311 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.311 INFO:teuthology.orchestra.run.smithi098.stdout: "server_port": { 2024-09-16T15:38:49.311 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "server_port", 2024-09-16T15:38:49.311 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.311 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.311 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.311 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "8080", 2024-09-16T15:38:49.311 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.311 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.311 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.311 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.311 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.311 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.311 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.311 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.312 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-16T15:38:49.312 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-16T15:38:49.312 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.312 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-16T15:38:49.312 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.312 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-16T15:38:49.312 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.312 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.312 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.312 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.312 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.312 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.312 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.312 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.312 INFO:teuthology.orchestra.run.smithi098.stdout: "ssl": { 2024-09-16T15:38:49.312 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "ssl", 2024-09-16T15:38:49.313 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.313 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.313 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.313 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-16T15:38:49.313 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.313 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.313 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.313 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.313 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.313 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.313 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.313 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.313 INFO:teuthology.orchestra.run.smithi098.stdout: "ssl_server_port": { 2024-09-16T15:38:49.313 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "ssl_server_port", 2024-09-16T15:38:49.313 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.314 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.314 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.314 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "8443", 2024-09-16T15:38:49.314 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.314 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.314 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.314 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.314 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.314 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.314 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.314 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.314 INFO:teuthology.orchestra.run.smithi098.stdout: "standby_behaviour": { 2024-09-16T15:38:49.314 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "standby_behaviour", 2024-09-16T15:38:49.314 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.314 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.315 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.315 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "redirect", 2024-09-16T15:38:49.315 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.315 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.315 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.315 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.315 INFO:teuthology.orchestra.run.smithi098.stdout: "redirect" 2024-09-16T15:38:49.315 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.315 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.315 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.315 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.315 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.315 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.315 INFO:teuthology.orchestra.run.smithi098.stdout: "standby_error_status_code": { 2024-09-16T15:38:49.315 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "standby_error_status_code", 2024-09-16T15:38:49.316 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.316 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.316 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.316 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "500", 2024-09-16T15:38:49.316 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "400", 2024-09-16T15:38:49.316 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "599", 2024-09-16T15:38:49.316 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.316 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.316 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.316 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.316 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.316 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.316 INFO:teuthology.orchestra.run.smithi098.stdout: "url_prefix": { 2024-09-16T15:38:49.316 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "url_prefix", 2024-09-16T15:38:49.316 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.317 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.317 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.317 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.317 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.317 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.317 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.317 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.317 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.317 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.317 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.317 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.317 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.317 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.318 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:49.318 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "devicehealth", 2024-09-16T15:38:49.318 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-16T15:38:49.318 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-16T15:38:49.318 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-16T15:38:49.318 INFO:teuthology.orchestra.run.smithi098.stdout: "enable_monitoring": { 2024-09-16T15:38:49.318 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "enable_monitoring", 2024-09-16T15:38:49.318 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.318 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.318 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.318 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-16T15:38:49.318 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.318 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.318 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.319 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "monitor device health metrics", 2024-09-16T15:38:49.319 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.319 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.319 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.319 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.319 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-16T15:38:49.319 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-16T15:38:49.319 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.319 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.319 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.319 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.319 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.319 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.319 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.319 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.320 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.320 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.320 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.320 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.320 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.320 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.320 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.320 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.320 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.320 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.320 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.320 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-16T15:38:49.320 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-16T15:38:49.320 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.320 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.320 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.321 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.321 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.321 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.321 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.321 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.321 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.321 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.321 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.321 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.321 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-16T15:38:49.321 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-16T15:38:49.321 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.321 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.321 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.322 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-16T15:38:49.322 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.322 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.322 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.322 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.322 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.322 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.322 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.322 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.322 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.322 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.322 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.322 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.322 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.322 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.322 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.323 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-16T15:38:49.323 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-16T15:38:49.323 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.323 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.323 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.323 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.323 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.323 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.323 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.323 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.323 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.323 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.323 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.323 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.324 INFO:teuthology.orchestra.run.smithi098.stdout: "mark_out_threshold": { 2024-09-16T15:38:49.324 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "mark_out_threshold", 2024-09-16T15:38:49.324 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-16T15:38:49.324 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.324 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.324 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "2419200", 2024-09-16T15:38:49.324 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.324 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.324 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.324 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-16T15:38:49.324 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.324 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.324 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.324 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.324 INFO:teuthology.orchestra.run.smithi098.stdout: "pool_name": { 2024-09-16T15:38:49.324 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "pool_name", 2024-09-16T15:38:49.325 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.325 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.325 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.325 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "device_health_metrics", 2024-09-16T15:38:49.325 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.325 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.325 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.325 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-16T15:38:49.325 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.325 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.325 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.325 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.325 INFO:teuthology.orchestra.run.smithi098.stdout: "retention_period": { 2024-09-16T15:38:49.325 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "retention_period", 2024-09-16T15:38:49.325 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-16T15:38:49.326 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.326 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.326 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "15552000", 2024-09-16T15:38:49.326 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.326 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.326 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.326 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "how long to retain device health metrics", 2024-09-16T15:38:49.326 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.326 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.326 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.326 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.326 INFO:teuthology.orchestra.run.smithi098.stdout: "scrape_frequency": { 2024-09-16T15:38:49.326 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "scrape_frequency", 2024-09-16T15:38:49.326 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-16T15:38:49.326 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.326 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.327 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "86400", 2024-09-16T15:38:49.327 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.327 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.327 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.327 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-16T15:38:49.327 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.327 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.327 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.327 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.327 INFO:teuthology.orchestra.run.smithi098.stdout: "self_heal": { 2024-09-16T15:38:49.327 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "self_heal", 2024-09-16T15:38:49.327 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.327 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.327 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.327 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-16T15:38:49.328 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.328 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.328 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.328 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-16T15:38:49.328 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.328 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.328 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.328 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.328 INFO:teuthology.orchestra.run.smithi098.stdout: "sleep_interval": { 2024-09-16T15:38:49.328 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sleep_interval", 2024-09-16T15:38:49.328 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-16T15:38:49.328 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.328 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.329 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "600", 2024-09-16T15:38:49.329 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.329 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.329 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.329 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "how frequently to wake up and check device health", 2024-09-16T15:38:49.329 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.329 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.329 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.329 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.329 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-16T15:38:49.329 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-16T15:38:49.329 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.329 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-16T15:38:49.329 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.329 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-16T15:38:49.330 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.330 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.330 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.330 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.330 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.330 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.330 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.330 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.330 INFO:teuthology.orchestra.run.smithi098.stdout: "warn_threshold": { 2024-09-16T15:38:49.330 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "warn_threshold", 2024-09-16T15:38:49.330 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-16T15:38:49.330 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.330 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.330 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "7257600", 2024-09-16T15:38:49.331 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.331 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.331 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.331 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-16T15:38:49.331 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.331 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.331 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.331 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.331 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.331 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.331 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:49.331 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "diskprediction_local", 2024-09-16T15:38:49.331 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-16T15:38:49.331 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-16T15:38:49.331 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-16T15:38:49.331 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-16T15:38:49.332 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-16T15:38:49.332 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.332 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.332 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.332 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.332 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.332 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.332 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.332 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.332 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.332 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.332 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.332 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.332 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.332 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.332 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.333 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.333 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.333 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.333 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.333 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-16T15:38:49.333 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-16T15:38:49.333 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.333 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.333 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.333 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.333 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.333 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.333 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.333 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.333 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.333 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.334 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.334 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.334 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-16T15:38:49.334 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-16T15:38:49.334 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.334 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.334 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.334 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-16T15:38:49.334 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.334 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.334 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.334 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.334 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.334 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.334 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.334 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.335 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.335 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.335 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.335 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.335 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.335 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.335 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.335 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-16T15:38:49.335 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-16T15:38:49.335 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.335 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.335 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.335 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.335 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.335 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.335 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.336 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.336 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.336 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.336 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.336 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.336 INFO:teuthology.orchestra.run.smithi098.stdout: "predict_interval": { 2024-09-16T15:38:49.336 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "predict_interval", 2024-09-16T15:38:49.336 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.336 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.336 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.336 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "86400", 2024-09-16T15:38:49.336 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.336 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.336 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.336 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.337 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.337 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.337 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.337 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.337 INFO:teuthology.orchestra.run.smithi098.stdout: "predictor_model": { 2024-09-16T15:38:49.337 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "predictor_model", 2024-09-16T15:38:49.337 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.337 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.337 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.337 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "prophetstor", 2024-09-16T15:38:49.337 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.337 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.337 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.337 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.337 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.338 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.338 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.338 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.338 INFO:teuthology.orchestra.run.smithi098.stdout: "sleep_interval": { 2024-09-16T15:38:49.338 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sleep_interval", 2024-09-16T15:38:49.338 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.338 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.338 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.338 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "600", 2024-09-16T15:38:49.338 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.338 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.338 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.338 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.338 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.338 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.339 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.339 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.339 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-16T15:38:49.339 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-16T15:38:49.339 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.339 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-16T15:38:49.339 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.339 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-16T15:38:49.339 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.339 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.339 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.339 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.339 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.339 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.340 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.340 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.340 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.340 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.340 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:49.340 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "influx", 2024-09-16T15:38:49.340 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": false, 2024-09-16T15:38:49.340 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "influxdb python module not found", 2024-09-16T15:38:49.340 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-16T15:38:49.340 INFO:teuthology.orchestra.run.smithi098.stdout: "batch_size": { 2024-09-16T15:38:49.340 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "batch_size", 2024-09-16T15:38:49.340 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.340 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.340 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.340 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "5000", 2024-09-16T15:38:49.341 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.341 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.341 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.341 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-16T15:38:49.341 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.341 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.341 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.341 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.341 INFO:teuthology.orchestra.run.smithi098.stdout: "database": { 2024-09-16T15:38:49.341 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "database", 2024-09-16T15:38:49.341 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.341 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.341 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.341 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "ceph", 2024-09-16T15:38:49.341 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.341 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.342 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.342 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-16T15:38:49.342 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.342 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.342 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.342 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.342 INFO:teuthology.orchestra.run.smithi098.stdout: "hostname": { 2024-09-16T15:38:49.342 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "hostname", 2024-09-16T15:38:49.342 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.342 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.342 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.342 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.342 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.342 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.342 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.342 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "InfluxDB server hostname", 2024-09-16T15:38:49.343 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.343 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.343 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.343 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.343 INFO:teuthology.orchestra.run.smithi098.stdout: "interval": { 2024-09-16T15:38:49.343 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "interval", 2024-09-16T15:38:49.343 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-16T15:38:49.343 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.343 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.343 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "30", 2024-09-16T15:38:49.343 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "5", 2024-09-16T15:38:49.343 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.343 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.343 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-16T15:38:49.343 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.344 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.344 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.344 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.344 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-16T15:38:49.344 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-16T15:38:49.344 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.344 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.344 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.344 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.344 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.344 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.344 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.344 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.344 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.344 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.344 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.345 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.345 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.345 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.345 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.345 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.345 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.345 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.345 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.345 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-16T15:38:49.345 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-16T15:38:49.345 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.345 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.345 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.345 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.345 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.345 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.346 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.346 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.346 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.346 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.346 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.346 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.346 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-16T15:38:49.346 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-16T15:38:49.346 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.346 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.346 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.346 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-16T15:38:49.346 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.346 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.346 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.346 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.347 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.347 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.347 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.347 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.347 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.347 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.347 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.347 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.347 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.347 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.347 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.347 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-16T15:38:49.347 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-16T15:38:49.347 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.347 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.348 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.348 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.348 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.348 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.348 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.348 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.348 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.348 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.348 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.348 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.348 INFO:teuthology.orchestra.run.smithi098.stdout: "password": { 2024-09-16T15:38:49.348 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "password", 2024-09-16T15:38:49.348 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.348 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.348 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.349 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.349 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.349 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.349 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.349 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "password of InfluxDB server user", 2024-09-16T15:38:49.349 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.349 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.349 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.349 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.349 INFO:teuthology.orchestra.run.smithi098.stdout: "port": { 2024-09-16T15:38:49.349 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "port", 2024-09-16T15:38:49.349 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.349 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.349 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.349 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "8086", 2024-09-16T15:38:49.349 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.350 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.350 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.350 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "InfluxDB server port", 2024-09-16T15:38:49.350 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.350 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.350 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.350 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.350 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-16T15:38:49.350 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-16T15:38:49.350 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.350 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-16T15:38:49.350 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.350 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-16T15:38:49.350 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.350 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.350 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.351 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.351 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.351 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.351 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.351 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.351 INFO:teuthology.orchestra.run.smithi098.stdout: "ssl": { 2024-09-16T15:38:49.351 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "ssl", 2024-09-16T15:38:49.351 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.351 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.351 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.351 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "false", 2024-09-16T15:38:49.351 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.351 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.352 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.352 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-16T15:38:49.352 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.352 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.352 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.352 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.352 INFO:teuthology.orchestra.run.smithi098.stdout: "threads": { 2024-09-16T15:38:49.352 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "threads", 2024-09-16T15:38:49.352 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.352 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.352 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.352 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "5", 2024-09-16T15:38:49.352 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "1", 2024-09-16T15:38:49.352 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "32", 2024-09-16T15:38:49.353 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.353 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-16T15:38:49.353 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.353 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.353 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.353 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.353 INFO:teuthology.orchestra.run.smithi098.stdout: "username": { 2024-09-16T15:38:49.353 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "username", 2024-09-16T15:38:49.353 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.353 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.353 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.353 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.353 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.353 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.354 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.354 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "username of InfluxDB server user", 2024-09-16T15:38:49.354 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.354 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.354 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.354 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.354 INFO:teuthology.orchestra.run.smithi098.stdout: "verify_ssl": { 2024-09-16T15:38:49.354 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "verify_ssl", 2024-09-16T15:38:49.354 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.354 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.354 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.354 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "true", 2024-09-16T15:38:49.354 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.354 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.354 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.354 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-16T15:38:49.355 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.355 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.355 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.355 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.355 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.355 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.355 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:49.355 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "insights", 2024-09-16T15:38:49.355 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-16T15:38:49.355 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-16T15:38:49.355 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-16T15:38:49.355 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-16T15:38:49.355 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-16T15:38:49.355 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.355 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.355 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.356 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.356 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.356 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.356 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.356 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.356 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.356 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.356 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.356 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.356 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.356 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.356 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.356 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.356 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.356 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.357 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.357 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-16T15:38:49.357 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-16T15:38:49.357 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.357 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.357 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.357 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.357 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.357 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.357 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.357 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.357 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.357 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.357 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.358 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.358 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-16T15:38:49.358 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-16T15:38:49.358 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.358 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.358 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.358 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-16T15:38:49.358 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.358 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.358 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.358 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.358 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.358 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.358 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.358 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.358 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.359 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.359 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.359 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.359 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.359 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.359 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.359 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-16T15:38:49.359 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-16T15:38:49.359 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.359 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.359 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.359 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.359 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.359 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.359 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.360 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.360 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.360 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.360 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.360 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.360 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-16T15:38:49.360 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-16T15:38:49.360 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.360 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-16T15:38:49.360 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.360 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-16T15:38:49.360 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.360 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.360 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.360 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.361 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.361 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.361 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.361 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.361 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.361 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.361 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:49.361 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "iostat", 2024-09-16T15:38:49.361 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-16T15:38:49.361 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-16T15:38:49.361 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-16T15:38:49.361 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-16T15:38:49.361 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-16T15:38:49.361 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.361 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.362 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.362 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.362 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.362 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.362 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.362 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.362 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.362 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.362 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.362 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.362 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.362 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.363 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.363 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.363 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.363 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.363 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.363 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-16T15:38:49.363 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-16T15:38:49.363 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.363 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.363 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.363 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.363 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.363 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.363 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.364 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.364 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.364 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.364 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.364 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.364 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-16T15:38:49.364 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-16T15:38:49.364 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.364 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.364 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.364 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-16T15:38:49.364 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.365 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.365 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.365 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.365 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.365 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.365 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.365 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.365 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.365 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.365 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.365 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.365 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.365 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.365 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.366 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-16T15:38:49.366 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-16T15:38:49.366 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.366 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.366 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.366 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.366 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.366 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.366 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.366 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.366 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.366 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.366 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.367 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.367 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-16T15:38:49.367 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-16T15:38:49.367 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.367 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-16T15:38:49.367 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.367 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-16T15:38:49.367 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.367 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.367 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.367 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.367 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.367 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.367 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.368 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.368 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.368 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.368 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:49.368 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "localpool", 2024-09-16T15:38:49.368 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-16T15:38:49.368 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-16T15:38:49.368 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-16T15:38:49.368 INFO:teuthology.orchestra.run.smithi098.stdout: "failure_domain": { 2024-09-16T15:38:49.368 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "failure_domain", 2024-09-16T15:38:49.368 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.368 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.368 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.368 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "host", 2024-09-16T15:38:49.368 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.369 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.369 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.369 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "failure domain for any created local pool", 2024-09-16T15:38:49.369 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-16T15:38:49.369 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.369 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.369 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.369 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-16T15:38:49.369 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-16T15:38:49.369 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.369 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.369 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.369 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.369 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.369 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.369 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.370 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.370 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.370 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.370 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.370 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.370 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.370 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.370 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.370 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.370 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.370 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.370 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.370 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-16T15:38:49.370 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-16T15:38:49.371 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.371 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.371 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.371 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.371 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.371 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.371 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.371 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.371 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.371 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.371 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.371 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.371 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-16T15:38:49.371 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-16T15:38:49.372 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.372 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.372 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.372 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-16T15:38:49.372 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.372 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.372 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.372 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.372 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.372 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.372 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.372 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.372 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.372 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.372 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.372 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.373 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.373 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.373 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.373 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-16T15:38:49.373 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-16T15:38:49.373 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.373 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.373 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.373 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.373 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.373 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.373 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.373 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.373 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.373 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.373 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.374 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.374 INFO:teuthology.orchestra.run.smithi098.stdout: "min_size": { 2024-09-16T15:38:49.374 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "min_size", 2024-09-16T15:38:49.374 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.374 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.374 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.374 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.374 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.374 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.374 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.374 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "default min_size for any created local pool", 2024-09-16T15:38:49.374 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-16T15:38:49.374 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.374 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.374 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.375 INFO:teuthology.orchestra.run.smithi098.stdout: "num_rep": { 2024-09-16T15:38:49.375 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "num_rep", 2024-09-16T15:38:49.375 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.375 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.375 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.375 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "3", 2024-09-16T15:38:49.375 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.375 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.375 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.375 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "default replica count for any created local pool", 2024-09-16T15:38:49.375 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.375 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.375 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.375 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.375 INFO:teuthology.orchestra.run.smithi098.stdout: "pg_num": { 2024-09-16T15:38:49.376 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "pg_num", 2024-09-16T15:38:49.376 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.376 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.376 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.376 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "128", 2024-09-16T15:38:49.376 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.376 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.376 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.376 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "default pg_num for any created local pool", 2024-09-16T15:38:49.376 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.376 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.376 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.376 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.376 INFO:teuthology.orchestra.run.smithi098.stdout: "prefix": { 2024-09-16T15:38:49.377 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "prefix", 2024-09-16T15:38:49.377 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.377 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.377 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.377 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.377 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.377 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.377 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.377 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "name prefix for any created local pool", 2024-09-16T15:38:49.377 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.377 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.377 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.377 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.378 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-16T15:38:49.378 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-16T15:38:49.378 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.378 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-16T15:38:49.378 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.378 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-16T15:38:49.378 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.378 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.378 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.378 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.378 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.379 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.379 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.379 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.379 INFO:teuthology.orchestra.run.smithi098.stdout: "subtree": { 2024-09-16T15:38:49.379 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "subtree", 2024-09-16T15:38:49.379 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.379 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.379 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.379 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "rack", 2024-09-16T15:38:49.379 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.379 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.379 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.379 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-16T15:38:49.379 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-16T15:38:49.380 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.380 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.380 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.380 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.380 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.380 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:49.380 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "mds_autoscaler", 2024-09-16T15:38:49.380 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-16T15:38:49.380 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-16T15:38:49.380 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-16T15:38:49.380 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-16T15:38:49.380 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-16T15:38:49.380 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.380 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.381 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.381 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.381 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.381 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.381 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.381 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.381 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.381 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.381 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.381 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.381 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.381 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.381 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.381 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.382 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.382 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.382 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.382 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-16T15:38:49.382 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-16T15:38:49.382 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.382 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.382 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.382 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.382 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.382 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.382 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.382 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.382 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.383 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.383 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.383 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.383 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-16T15:38:49.383 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-16T15:38:49.383 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.383 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.383 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.383 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-16T15:38:49.383 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.383 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.383 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.383 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.383 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.384 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.384 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.384 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.384 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.384 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.384 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.384 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.384 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.384 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.384 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.384 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-16T15:38:49.384 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-16T15:38:49.384 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.384 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.384 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.385 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.385 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.385 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.385 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.385 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.385 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.385 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.385 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.385 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.385 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-16T15:38:49.385 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-16T15:38:49.385 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.385 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-16T15:38:49.385 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.386 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-16T15:38:49.386 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.386 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.386 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.386 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.386 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.386 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.386 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.386 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.386 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.386 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.386 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:49.386 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "mirroring", 2024-09-16T15:38:49.386 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-16T15:38:49.386 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-16T15:38:49.387 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-16T15:38:49.387 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-16T15:38:49.387 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-16T15:38:49.387 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.387 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.387 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.387 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.387 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.387 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.387 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.387 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.387 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.387 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.387 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.388 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.388 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.388 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.388 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.388 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.388 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.388 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.388 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.388 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-16T15:38:49.388 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-16T15:38:49.388 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.388 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.388 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.389 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.389 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.389 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.389 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.389 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.389 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.389 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.389 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.389 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.389 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-16T15:38:49.389 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-16T15:38:49.389 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.389 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.389 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.390 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-16T15:38:49.390 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.390 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.390 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.390 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.390 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.390 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.390 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.390 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.390 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.390 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.390 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.390 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.390 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.391 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.391 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.391 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-16T15:38:49.391 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-16T15:38:49.391 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.391 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.391 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.391 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.391 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.391 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.391 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.391 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.391 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.391 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.392 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.392 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.392 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-16T15:38:49.392 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-16T15:38:49.392 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.392 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-16T15:38:49.392 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.392 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-16T15:38:49.392 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.392 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.392 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.392 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.392 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.392 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.392 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.393 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.393 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.393 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.393 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:49.393 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "nfs", 2024-09-16T15:38:49.393 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-16T15:38:49.393 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-16T15:38:49.393 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-16T15:38:49.393 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-16T15:38:49.393 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-16T15:38:49.393 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.393 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.393 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.393 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.393 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.394 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.394 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.394 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.394 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.394 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.394 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.394 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.394 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.394 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.394 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.394 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.394 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.394 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.394 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.394 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-16T15:38:49.394 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-16T15:38:49.395 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.395 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.395 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.395 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.395 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.395 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.395 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.395 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.395 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.395 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.395 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.395 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.395 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-16T15:38:49.396 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-16T15:38:49.396 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.396 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.396 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.396 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-16T15:38:49.396 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.396 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.396 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.396 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.396 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.396 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.396 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.396 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.396 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.397 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.397 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.397 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.397 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.397 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.397 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.397 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-16T15:38:49.397 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-16T15:38:49.397 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.397 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.397 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.397 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.397 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.397 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.397 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.398 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.398 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.398 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.398 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.398 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.398 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-16T15:38:49.398 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-16T15:38:49.398 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.398 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-16T15:38:49.398 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.398 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-16T15:38:49.398 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.398 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.398 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.398 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.399 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.399 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.399 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.399 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.399 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.399 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.399 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:49.399 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "orchestrator", 2024-09-16T15:38:49.399 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-16T15:38:49.399 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-16T15:38:49.399 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-16T15:38:49.399 INFO:teuthology.orchestra.run.smithi098.stdout: "fail_fs": { 2024-09-16T15:38:49.399 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "fail_fs", 2024-09-16T15:38:49.399 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.399 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.400 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.400 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.400 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.400 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.400 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.400 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-16T15:38:49.400 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.400 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.400 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.400 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.400 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-16T15:38:49.400 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-16T15:38:49.400 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.400 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.401 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.401 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.401 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.401 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.401 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.401 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.401 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.401 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.401 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.401 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.401 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.401 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.401 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.401 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.401 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.402 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.402 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.402 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-16T15:38:49.402 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-16T15:38:49.402 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.402 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.402 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.402 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.402 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.402 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.402 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.402 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.402 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.402 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.402 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.403 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.403 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-16T15:38:49.403 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-16T15:38:49.403 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.403 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.403 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.403 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-16T15:38:49.403 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.403 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.403 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.403 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.403 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.403 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.403 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.403 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.404 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.404 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.404 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.404 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.404 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.404 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.404 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.404 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-16T15:38:49.404 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-16T15:38:49.404 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.404 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.404 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.404 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.404 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.404 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.404 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.405 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.405 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.405 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.405 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.405 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.405 INFO:teuthology.orchestra.run.smithi098.stdout: "orchestrator": { 2024-09-16T15:38:49.405 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "orchestrator", 2024-09-16T15:38:49.405 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.405 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.405 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.405 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.405 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.405 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.406 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.406 INFO:teuthology.orchestra.run.smithi098.stdout: "cephadm", 2024-09-16T15:38:49.406 INFO:teuthology.orchestra.run.smithi098.stdout: "rook", 2024-09-16T15:38:49.406 INFO:teuthology.orchestra.run.smithi098.stdout: "test_orchestrator" 2024-09-16T15:38:49.406 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.406 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Orchestrator backend", 2024-09-16T15:38:49.406 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.406 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.406 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.406 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.406 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-16T15:38:49.406 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-16T15:38:49.406 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.407 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-16T15:38:49.407 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.407 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-16T15:38:49.407 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.407 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.407 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.407 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.407 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.407 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.407 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.407 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.407 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.407 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.407 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:49.408 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "osd_perf_query", 2024-09-16T15:38:49.408 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-16T15:38:49.408 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-16T15:38:49.408 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-16T15:38:49.408 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-16T15:38:49.408 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-16T15:38:49.408 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.408 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.408 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.408 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.408 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.408 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.408 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.409 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.409 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.409 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.409 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.409 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.409 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.409 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.409 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.409 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.409 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.409 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.409 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.409 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-16T15:38:49.409 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-16T15:38:49.410 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.410 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.410 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.410 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.410 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.410 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.410 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.410 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.410 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.410 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.410 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.410 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.410 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-16T15:38:49.410 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-16T15:38:49.411 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.411 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.411 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.411 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-16T15:38:49.411 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.411 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.411 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.411 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.411 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.411 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.411 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.411 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.411 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.411 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.411 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.412 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.412 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.412 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.412 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.412 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-16T15:38:49.412 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-16T15:38:49.412 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.412 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.412 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.412 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.412 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.412 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.412 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.412 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.413 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.413 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.413 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.413 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.413 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-16T15:38:49.413 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-16T15:38:49.413 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.413 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-16T15:38:49.413 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.413 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-16T15:38:49.413 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.413 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.413 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.413 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.413 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.414 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.414 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.414 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.414 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.414 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.414 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:49.414 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "osd_support", 2024-09-16T15:38:49.414 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-16T15:38:49.414 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-16T15:38:49.414 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-16T15:38:49.414 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-16T15:38:49.414 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-16T15:38:49.414 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.414 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.414 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.415 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.415 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.415 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.415 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.415 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.415 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.415 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.415 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.415 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.415 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.415 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.415 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.415 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.415 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.415 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.416 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.416 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-16T15:38:49.416 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-16T15:38:49.416 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.416 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.416 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.416 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.416 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.416 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.416 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.416 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.416 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.416 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.416 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.416 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.417 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-16T15:38:49.417 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-16T15:38:49.417 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.417 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.417 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.417 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-16T15:38:49.417 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.417 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.417 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.417 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.417 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.417 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.417 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.417 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.417 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.418 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.418 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.418 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.418 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.418 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.418 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.418 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-16T15:38:49.418 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-16T15:38:49.418 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.418 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.418 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.418 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.418 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.418 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.419 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.419 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.419 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.419 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.419 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.419 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.419 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-16T15:38:49.419 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-16T15:38:49.419 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.419 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-16T15:38:49.419 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.419 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-16T15:38:49.419 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.419 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.420 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.420 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.420 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.420 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.420 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.420 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.420 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.420 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.420 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:49.420 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "pg_autoscaler", 2024-09-16T15:38:49.420 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-16T15:38:49.420 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-16T15:38:49.420 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-16T15:38:49.420 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-16T15:38:49.420 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-16T15:38:49.421 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.421 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.421 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.421 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.421 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.421 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.421 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.421 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.421 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.421 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.421 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.421 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.421 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.421 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.421 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.422 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.422 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.422 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.422 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.422 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-16T15:38:49.422 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-16T15:38:49.422 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.422 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.422 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.422 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.422 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.422 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.422 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.422 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.422 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.423 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.423 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.423 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.423 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-16T15:38:49.423 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-16T15:38:49.423 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.423 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.423 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.423 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-16T15:38:49.423 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.423 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.423 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.423 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.423 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.424 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.424 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.424 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.424 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.424 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.424 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.424 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.424 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.424 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.424 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.424 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-16T15:38:49.424 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-16T15:38:49.424 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.424 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.424 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.424 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.425 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.425 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.425 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.425 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.425 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.425 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.425 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.425 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.425 INFO:teuthology.orchestra.run.smithi098.stdout: "sleep_interval": { 2024-09-16T15:38:49.425 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sleep_interval", 2024-09-16T15:38:49.425 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-16T15:38:49.425 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.425 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.425 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "60", 2024-09-16T15:38:49.425 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.426 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.426 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.426 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.426 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.426 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.426 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.426 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.426 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-16T15:38:49.426 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-16T15:38:49.426 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.426 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-16T15:38:49.426 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.426 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-16T15:38:49.426 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.426 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.426 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.427 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.427 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.427 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.427 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.427 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.427 INFO:teuthology.orchestra.run.smithi098.stdout: "threshold": { 2024-09-16T15:38:49.427 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "threshold", 2024-09-16T15:38:49.427 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "float", 2024-09-16T15:38:49.427 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.427 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.427 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "3.0", 2024-09-16T15:38:49.427 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "1.0", 2024-09-16T15:38:49.427 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.428 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.428 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "scaling threshold", 2024-09-16T15:38:49.428 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-16T15:38:49.428 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.428 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.428 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.428 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.428 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.428 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:49.428 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "progress", 2024-09-16T15:38:49.428 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-16T15:38:49.428 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-16T15:38:49.428 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-16T15:38:49.429 INFO:teuthology.orchestra.run.smithi098.stdout: "allow_pg_recovery_event": { 2024-09-16T15:38:49.429 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "allow_pg_recovery_event", 2024-09-16T15:38:49.429 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.429 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.429 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.429 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.429 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.429 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.429 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.429 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-16T15:38:49.429 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.429 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.429 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.429 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.430 INFO:teuthology.orchestra.run.smithi098.stdout: "enabled": { 2024-09-16T15:38:49.430 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "enabled", 2024-09-16T15:38:49.430 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.430 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.430 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.430 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-16T15:38:49.430 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.430 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.430 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.430 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.430 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.430 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.430 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.430 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.431 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-16T15:38:49.431 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-16T15:38:49.431 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.431 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.431 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.431 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.431 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.431 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.431 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.431 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.431 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.431 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.431 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.431 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.432 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.432 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.432 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.432 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.432 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.432 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.432 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.432 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-16T15:38:49.432 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-16T15:38:49.432 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.432 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.432 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.432 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.432 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.433 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.433 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.433 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.433 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.433 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.433 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.433 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.433 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-16T15:38:49.433 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-16T15:38:49.433 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.433 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.433 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.433 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-16T15:38:49.433 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.433 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.434 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.434 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.434 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.434 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.434 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.434 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.434 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.434 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.434 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.434 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.434 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.434 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.434 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.434 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-16T15:38:49.434 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-16T15:38:49.434 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.435 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.435 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.435 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.435 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.435 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.435 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.435 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.435 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.435 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.435 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.435 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.435 INFO:teuthology.orchestra.run.smithi098.stdout: "max_completed_events": { 2024-09-16T15:38:49.435 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "max_completed_events", 2024-09-16T15:38:49.435 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.435 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.436 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.436 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "50", 2024-09-16T15:38:49.436 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.436 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.436 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.436 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "number of past completed events to remember", 2024-09-16T15:38:49.436 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.436 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.436 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.436 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.436 INFO:teuthology.orchestra.run.smithi098.stdout: "sleep_interval": { 2024-09-16T15:38:49.436 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sleep_interval", 2024-09-16T15:38:49.436 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-16T15:38:49.436 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.437 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.437 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "5", 2024-09-16T15:38:49.437 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.437 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.437 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.437 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "how long the module is going to sleep", 2024-09-16T15:38:49.437 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.437 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.437 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.437 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.437 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-16T15:38:49.437 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-16T15:38:49.437 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.437 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-16T15:38:49.438 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.438 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-16T15:38:49.438 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.438 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.438 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.438 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.438 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.438 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.438 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.438 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.438 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.438 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.438 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:49.438 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "prometheus", 2024-09-16T15:38:49.439 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-16T15:38:49.439 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-16T15:38:49.439 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-16T15:38:49.439 INFO:teuthology.orchestra.run.smithi098.stdout: "cache": { 2024-09-16T15:38:49.439 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "cache", 2024-09-16T15:38:49.439 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.439 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.439 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.439 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-16T15:38:49.439 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.439 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.439 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.439 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.439 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.440 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.440 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.440 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.440 INFO:teuthology.orchestra.run.smithi098.stdout: "exclude_perf_counters": { 2024-09-16T15:38:49.440 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "exclude_perf_counters", 2024-09-16T15:38:49.440 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.440 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.440 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.440 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-16T15:38:49.440 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.440 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.440 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.440 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-16T15:38:49.440 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-16T15:38:49.440 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.441 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.441 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.441 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-16T15:38:49.441 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-16T15:38:49.441 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.441 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.441 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.441 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.441 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.441 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.441 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.441 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.441 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.441 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.441 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.442 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.442 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.442 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.442 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.442 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.442 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.442 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.442 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.442 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-16T15:38:49.442 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-16T15:38:49.442 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.442 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.442 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.442 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.442 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.443 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.443 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.443 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.443 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.443 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.443 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.443 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.443 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-16T15:38:49.443 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-16T15:38:49.443 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.443 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.443 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.443 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-16T15:38:49.443 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.444 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.444 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.444 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.444 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.444 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.444 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.444 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.444 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.444 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.444 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.444 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.445 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.445 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.445 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.445 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-16T15:38:49.445 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-16T15:38:49.445 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.445 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.445 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.445 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.445 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.445 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.445 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.445 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.445 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.446 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.446 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.446 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.446 INFO:teuthology.orchestra.run.smithi098.stdout: "rbd_stats_pools": { 2024-09-16T15:38:49.446 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rbd_stats_pools", 2024-09-16T15:38:49.446 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.446 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.446 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.446 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.446 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.446 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.446 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.446 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.447 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.447 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.447 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.447 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.447 INFO:teuthology.orchestra.run.smithi098.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-16T15:38:49.447 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-16T15:38:49.447 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.447 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.447 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.447 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "300", 2024-09-16T15:38:49.447 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.447 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.447 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.447 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.448 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.448 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.448 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.448 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.448 INFO:teuthology.orchestra.run.smithi098.stdout: "scrape_interval": { 2024-09-16T15:38:49.448 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "scrape_interval", 2024-09-16T15:38:49.448 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "float", 2024-09-16T15:38:49.448 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.448 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.448 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "15.0", 2024-09-16T15:38:49.448 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.448 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.448 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.448 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.449 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.449 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.449 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.449 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.449 INFO:teuthology.orchestra.run.smithi098.stdout: "server_addr": { 2024-09-16T15:38:49.449 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "server_addr", 2024-09-16T15:38:49.449 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.449 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.449 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.449 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "::", 2024-09-16T15:38:49.449 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.449 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.449 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.449 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-16T15:38:49.449 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.450 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.450 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.450 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.450 INFO:teuthology.orchestra.run.smithi098.stdout: "server_port": { 2024-09-16T15:38:49.450 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "server_port", 2024-09-16T15:38:49.450 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.450 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.450 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.450 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "9283", 2024-09-16T15:38:49.450 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.450 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.450 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.450 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-16T15:38:49.450 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.450 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.450 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.451 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.451 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-16T15:38:49.451 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-16T15:38:49.451 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.451 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-16T15:38:49.451 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.451 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-16T15:38:49.451 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.451 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.451 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.451 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.451 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.451 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.451 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.451 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.451 INFO:teuthology.orchestra.run.smithi098.stdout: "stale_cache_strategy": { 2024-09-16T15:38:49.452 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "stale_cache_strategy", 2024-09-16T15:38:49.452 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.452 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.452 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.452 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "log", 2024-09-16T15:38:49.452 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.452 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.452 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.452 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.452 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.452 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.452 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.452 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.452 INFO:teuthology.orchestra.run.smithi098.stdout: "standby_behaviour": { 2024-09-16T15:38:49.452 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "standby_behaviour", 2024-09-16T15:38:49.452 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.453 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.453 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.453 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "default", 2024-09-16T15:38:49.453 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.453 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.453 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.453 INFO:teuthology.orchestra.run.smithi098.stdout: "default", 2024-09-16T15:38:49.453 INFO:teuthology.orchestra.run.smithi098.stdout: "error" 2024-09-16T15:38:49.453 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.453 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.453 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.453 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.453 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.453 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.454 INFO:teuthology.orchestra.run.smithi098.stdout: "standby_error_status_code": { 2024-09-16T15:38:49.454 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "standby_error_status_code", 2024-09-16T15:38:49.454 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.454 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.454 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.454 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "500", 2024-09-16T15:38:49.454 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "400", 2024-09-16T15:38:49.454 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "599", 2024-09-16T15:38:49.454 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.454 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.454 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.454 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.454 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.454 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.454 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.454 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.455 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:49.455 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rbd_support", 2024-09-16T15:38:49.455 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-16T15:38:49.455 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-16T15:38:49.455 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-16T15:38:49.455 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-16T15:38:49.455 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-16T15:38:49.455 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.455 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.455 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.455 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.455 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.455 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.455 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.455 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.455 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.456 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.456 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.456 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.456 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.456 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.456 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.456 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.456 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.456 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.456 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.456 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-16T15:38:49.456 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-16T15:38:49.456 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.456 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.456 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.457 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.457 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.457 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.457 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.457 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.457 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.457 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.457 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.457 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.457 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-16T15:38:49.457 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-16T15:38:49.457 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.457 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.458 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.458 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-16T15:38:49.458 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.458 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.458 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.458 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.458 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.458 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.458 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.458 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.458 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.458 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.458 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.458 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.458 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.459 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.459 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.459 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-16T15:38:49.459 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-16T15:38:49.459 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.459 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.459 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.459 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.459 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.459 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.459 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.459 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.459 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.459 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.459 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.460 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.460 INFO:teuthology.orchestra.run.smithi098.stdout: "max_concurrent_snap_create": { 2024-09-16T15:38:49.460 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "max_concurrent_snap_create", 2024-09-16T15:38:49.460 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.460 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.460 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.460 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "10", 2024-09-16T15:38:49.460 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.460 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.460 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.460 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.460 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.460 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.460 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.460 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.461 INFO:teuthology.orchestra.run.smithi098.stdout: "mirror_snapshot_schedule": { 2024-09-16T15:38:49.461 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "mirror_snapshot_schedule", 2024-09-16T15:38:49.461 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.461 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.461 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.461 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.461 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.461 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.461 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.461 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.461 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.461 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.461 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.461 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.461 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-16T15:38:49.462 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-16T15:38:49.462 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.462 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-16T15:38:49.462 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.462 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-16T15:38:49.462 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.462 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.462 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.462 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.462 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.462 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.462 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.462 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.462 INFO:teuthology.orchestra.run.smithi098.stdout: "trash_purge_schedule": { 2024-09-16T15:38:49.462 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "trash_purge_schedule", 2024-09-16T15:38:49.462 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.463 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.463 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.463 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.463 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.463 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.463 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.463 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.463 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.463 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.463 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.463 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.463 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.463 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.463 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:49.463 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "restful", 2024-09-16T15:38:49.463 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-16T15:38:49.464 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-16T15:38:49.464 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-16T15:38:49.464 INFO:teuthology.orchestra.run.smithi098.stdout: "enable_auth": { 2024-09-16T15:38:49.464 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "enable_auth", 2024-09-16T15:38:49.464 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.464 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.464 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.464 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-16T15:38:49.464 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.464 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.464 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.464 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.464 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.464 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.464 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.465 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.465 INFO:teuthology.orchestra.run.smithi098.stdout: "key_file": { 2024-09-16T15:38:49.465 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "key_file", 2024-09-16T15:38:49.465 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.465 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.465 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.465 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.465 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.465 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.465 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.465 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.465 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.465 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.465 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.465 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.465 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-16T15:38:49.466 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-16T15:38:49.466 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.466 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.466 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.466 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.466 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.466 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.466 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.466 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.466 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.466 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.466 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.466 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.466 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.466 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.467 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.467 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.467 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.467 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.467 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.467 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-16T15:38:49.467 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-16T15:38:49.467 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.467 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.467 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.467 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.467 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.467 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.467 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.467 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.467 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.468 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.468 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.468 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.468 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-16T15:38:49.468 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-16T15:38:49.468 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.468 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.468 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.468 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-16T15:38:49.468 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.468 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.468 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.468 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.468 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.468 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.468 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.469 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.469 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.469 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.469 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.469 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.469 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.469 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.469 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.469 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-16T15:38:49.469 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-16T15:38:49.469 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.469 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.469 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.469 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.469 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.469 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.470 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.470 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.470 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.470 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.470 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.470 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.470 INFO:teuthology.orchestra.run.smithi098.stdout: "max_requests": { 2024-09-16T15:38:49.470 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "max_requests", 2024-09-16T15:38:49.470 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.470 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.470 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.470 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "500", 2024-09-16T15:38:49.470 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.470 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.470 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.471 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-16T15:38:49.471 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.471 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.471 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.471 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.471 INFO:teuthology.orchestra.run.smithi098.stdout: "server_addr": { 2024-09-16T15:38:49.471 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "server_addr", 2024-09-16T15:38:49.471 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.471 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.471 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.471 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.471 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.471 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.471 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.472 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.472 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.472 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.472 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.472 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.472 INFO:teuthology.orchestra.run.smithi098.stdout: "server_port": { 2024-09-16T15:38:49.472 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "server_port", 2024-09-16T15:38:49.472 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.472 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.472 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.472 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.472 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.472 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.472 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.472 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.473 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.473 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.473 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.473 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.473 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-16T15:38:49.473 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-16T15:38:49.473 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.473 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-16T15:38:49.473 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.473 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-16T15:38:49.473 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.473 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.473 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.473 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.473 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.473 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.474 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.474 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.474 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.474 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.474 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:49.474 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rgw", 2024-09-16T15:38:49.474 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-16T15:38:49.474 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-16T15:38:49.474 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-16T15:38:49.474 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-16T15:38:49.474 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-16T15:38:49.474 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.474 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.474 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.474 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.475 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.475 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.475 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.475 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.475 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.475 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.475 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.475 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.475 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.475 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.475 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.475 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.475 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.475 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.475 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.475 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-16T15:38:49.476 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-16T15:38:49.476 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.476 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.476 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.476 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.476 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.476 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.476 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.476 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.476 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.476 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.476 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.476 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.476 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-16T15:38:49.476 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-16T15:38:49.476 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.477 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.477 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.477 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-16T15:38:49.477 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.477 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.477 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.477 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.477 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.477 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.477 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.477 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.477 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.477 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.477 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.477 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.478 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.478 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.478 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.478 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-16T15:38:49.478 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-16T15:38:49.478 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.478 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.478 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.478 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.478 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.478 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.478 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.478 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.478 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.478 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.479 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.479 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.479 INFO:teuthology.orchestra.run.smithi098.stdout: "secondary_zone_period_retry_limit": { 2024-09-16T15:38:49.479 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-16T15:38:49.479 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.479 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.479 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.479 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "5", 2024-09-16T15:38:49.479 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.479 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.479 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.479 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-16T15:38:49.479 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.479 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.479 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.479 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.480 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-16T15:38:49.480 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-16T15:38:49.480 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.480 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-16T15:38:49.480 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.480 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-16T15:38:49.480 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.480 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.480 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.480 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.480 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.480 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.480 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.480 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.480 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.481 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.481 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:49.481 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rook", 2024-09-16T15:38:49.481 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-16T15:38:49.481 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-16T15:38:49.481 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-16T15:38:49.481 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-16T15:38:49.481 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-16T15:38:49.481 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.481 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.481 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.481 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.481 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.481 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.482 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.482 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.482 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.482 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.482 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.482 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.482 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.482 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.482 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.482 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.482 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.482 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.482 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.483 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-16T15:38:49.483 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-16T15:38:49.483 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.483 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.483 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.483 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.483 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.483 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.483 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.483 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.483 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.483 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.483 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.483 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.483 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-16T15:38:49.484 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-16T15:38:49.484 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.484 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.484 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.484 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-16T15:38:49.484 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.484 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.484 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.484 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.484 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.484 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.484 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.484 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.484 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.485 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.485 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.485 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.485 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.485 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.485 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.485 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-16T15:38:49.485 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-16T15:38:49.485 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.485 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.485 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.485 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.485 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.486 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.486 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.486 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.486 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.486 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.486 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.486 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.486 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-16T15:38:49.486 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-16T15:38:49.486 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.486 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-16T15:38:49.486 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.486 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-16T15:38:49.486 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.487 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.487 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.487 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.487 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.487 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.487 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.487 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.487 INFO:teuthology.orchestra.run.smithi098.stdout: "storage_class": { 2024-09-16T15:38:49.487 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "storage_class", 2024-09-16T15:38:49.487 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.487 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.487 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.487 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "local", 2024-09-16T15:38:49.487 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.487 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.488 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.488 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-16T15:38:49.488 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.488 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.488 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.488 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.488 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.488 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.488 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:49.488 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "selftest", 2024-09-16T15:38:49.488 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-16T15:38:49.488 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-16T15:38:49.488 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-16T15:38:49.488 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-16T15:38:49.489 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-16T15:38:49.489 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.489 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.489 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.489 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.489 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.489 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.489 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.489 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.489 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.489 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.489 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.489 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.489 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.490 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.490 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.490 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.490 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.490 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.490 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.490 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-16T15:38:49.490 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-16T15:38:49.490 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.490 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.490 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.490 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.490 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.490 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.491 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.491 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.491 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.491 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.491 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.491 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.491 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-16T15:38:49.491 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-16T15:38:49.491 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.491 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.491 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.491 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-16T15:38:49.491 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.492 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.492 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.492 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.492 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.492 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.492 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.492 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.492 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.492 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.492 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.492 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.492 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.492 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.492 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.492 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-16T15:38:49.493 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-16T15:38:49.493 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.493 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.493 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.493 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.493 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.493 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.493 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.493 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.493 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.493 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.493 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.493 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.493 INFO:teuthology.orchestra.run.smithi098.stdout: "roption1": { 2024-09-16T15:38:49.494 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "roption1", 2024-09-16T15:38:49.494 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.494 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.494 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.494 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.494 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.494 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.494 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.494 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.494 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.494 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.494 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.494 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.494 INFO:teuthology.orchestra.run.smithi098.stdout: "roption2": { 2024-09-16T15:38:49.495 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "roption2", 2024-09-16T15:38:49.495 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.495 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.495 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.495 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "xyz", 2024-09-16T15:38:49.495 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.495 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.495 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.495 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.495 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.495 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.495 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.495 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.495 INFO:teuthology.orchestra.run.smithi098.stdout: "rwoption1": { 2024-09-16T15:38:49.495 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rwoption1", 2024-09-16T15:38:49.495 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.496 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.496 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.496 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.496 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.496 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.496 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.496 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.496 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.496 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.496 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.496 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.496 INFO:teuthology.orchestra.run.smithi098.stdout: "rwoption2": { 2024-09-16T15:38:49.496 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rwoption2", 2024-09-16T15:38:49.496 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.496 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.497 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.497 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.497 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.497 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.497 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.497 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.497 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.497 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.497 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.497 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.497 INFO:teuthology.orchestra.run.smithi098.stdout: "rwoption3": { 2024-09-16T15:38:49.497 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rwoption3", 2024-09-16T15:38:49.497 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "float", 2024-09-16T15:38:49.497 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.497 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.498 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.498 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.498 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.498 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.498 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.498 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.498 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.498 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.498 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.498 INFO:teuthology.orchestra.run.smithi098.stdout: "rwoption4": { 2024-09-16T15:38:49.498 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rwoption4", 2024-09-16T15:38:49.498 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.498 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.498 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.498 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.499 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.499 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.499 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.499 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.499 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.499 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.499 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.499 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.499 INFO:teuthology.orchestra.run.smithi098.stdout: "rwoption5": { 2024-09-16T15:38:49.499 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rwoption5", 2024-09-16T15:38:49.499 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.499 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.499 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.499 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.499 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.499 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.500 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.500 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.500 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.500 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.500 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.500 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.500 INFO:teuthology.orchestra.run.smithi098.stdout: "rwoption6": { 2024-09-16T15:38:49.500 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rwoption6", 2024-09-16T15:38:49.500 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.500 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.500 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.500 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-16T15:38:49.500 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.500 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.501 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.501 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.501 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.501 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.501 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.501 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.501 INFO:teuthology.orchestra.run.smithi098.stdout: "rwoption7": { 2024-09-16T15:38:49.501 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rwoption7", 2024-09-16T15:38:49.501 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.501 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.501 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.501 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.501 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "1", 2024-09-16T15:38:49.501 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "42", 2024-09-16T15:38:49.501 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.502 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.502 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.502 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.502 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.502 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.502 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-16T15:38:49.502 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-16T15:38:49.502 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.502 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-16T15:38:49.502 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.502 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-16T15:38:49.502 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.502 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.502 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.502 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.503 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.503 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.503 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.503 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.503 INFO:teuthology.orchestra.run.smithi098.stdout: "testkey": { 2024-09-16T15:38:49.503 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "testkey", 2024-09-16T15:38:49.503 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.503 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.503 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.503 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.503 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.503 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.503 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.503 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.503 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.504 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.504 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.504 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.504 INFO:teuthology.orchestra.run.smithi098.stdout: "testlkey": { 2024-09-16T15:38:49.504 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "testlkey", 2024-09-16T15:38:49.504 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.504 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.504 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.504 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.504 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.504 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.504 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.504 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.504 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.504 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.504 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.505 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.505 INFO:teuthology.orchestra.run.smithi098.stdout: "testnewline": { 2024-09-16T15:38:49.505 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "testnewline", 2024-09-16T15:38:49.505 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.505 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.505 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.505 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.505 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.505 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.505 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.505 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.505 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.505 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.505 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.505 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.506 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.506 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.506 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:49.506 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "smb", 2024-09-16T15:38:49.506 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-16T15:38:49.506 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-16T15:38:49.506 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-16T15:38:49.506 INFO:teuthology.orchestra.run.smithi098.stdout: "internal_store_backend": { 2024-09-16T15:38:49.506 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "internal_store_backend", 2024-09-16T15:38:49.506 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.506 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-16T15:38:49.506 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.506 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.506 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.507 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.507 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.507 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-16T15:38:49.507 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.507 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.507 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.507 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.507 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-16T15:38:49.507 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-16T15:38:49.507 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.507 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.507 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.507 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.507 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.508 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.508 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.508 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.508 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.508 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.508 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.508 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.508 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.508 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.508 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.508 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.508 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.508 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.508 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.508 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-16T15:38:49.509 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-16T15:38:49.509 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.509 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.509 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.509 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.509 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.509 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.509 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.509 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.509 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.509 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.509 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.509 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.509 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-16T15:38:49.510 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-16T15:38:49.510 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.510 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.510 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.510 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-16T15:38:49.510 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.510 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.510 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.510 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.510 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.510 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.510 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.510 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.510 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.511 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.511 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.511 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.511 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.511 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.511 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.511 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-16T15:38:49.511 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-16T15:38:49.511 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.511 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.511 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.511 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.511 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.511 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.511 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.512 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.512 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.512 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.512 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.512 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.512 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-16T15:38:49.512 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-16T15:38:49.512 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.512 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-16T15:38:49.512 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.512 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-16T15:38:49.512 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.512 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.513 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.513 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.513 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.513 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.513 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.513 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.513 INFO:teuthology.orchestra.run.smithi098.stdout: "update_orchestration": { 2024-09-16T15:38:49.513 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "update_orchestration", 2024-09-16T15:38:49.513 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.513 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.513 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.513 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-16T15:38:49.513 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.513 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.514 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.514 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-16T15:38:49.514 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.514 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.514 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.514 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.514 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.514 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.514 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:49.514 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "snap_schedule", 2024-09-16T15:38:49.514 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-16T15:38:49.514 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-16T15:38:49.514 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-16T15:38:49.514 INFO:teuthology.orchestra.run.smithi098.stdout: "allow_m_granularity": { 2024-09-16T15:38:49.515 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "allow_m_granularity", 2024-09-16T15:38:49.515 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.515 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.515 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.515 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.515 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.515 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.515 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.515 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "allow minute scheduled snapshots", 2024-09-16T15:38:49.515 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.515 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.515 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.515 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.515 INFO:teuthology.orchestra.run.smithi098.stdout: "dump_on_update": { 2024-09-16T15:38:49.516 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "dump_on_update", 2024-09-16T15:38:49.516 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.516 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.516 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.516 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.516 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.516 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.516 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.516 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "dump database to debug log on update", 2024-09-16T15:38:49.516 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.516 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.516 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.516 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.516 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-16T15:38:49.517 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-16T15:38:49.517 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.517 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.517 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.517 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.517 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.517 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.517 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.517 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.517 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.517 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.517 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.517 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.517 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.518 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.518 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.518 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.518 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.518 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.518 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.518 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-16T15:38:49.518 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-16T15:38:49.518 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.518 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.518 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.518 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.519 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.519 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.519 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.519 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.519 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.519 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.519 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.519 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.519 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-16T15:38:49.519 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-16T15:38:49.519 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.519 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.519 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.519 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-16T15:38:49.519 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.520 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.520 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.520 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.520 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.520 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.520 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.520 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.520 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.520 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.520 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.520 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.520 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.520 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.520 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.520 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-16T15:38:49.521 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-16T15:38:49.521 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.521 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.521 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.521 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.521 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.521 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.521 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.521 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.521 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.521 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.521 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.521 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.521 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-16T15:38:49.522 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-16T15:38:49.522 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.522 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-16T15:38:49.522 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.522 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-16T15:38:49.522 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.522 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.522 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.522 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.522 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.522 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.522 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.522 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.522 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.522 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.523 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:49.523 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "stats", 2024-09-16T15:38:49.523 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-16T15:38:49.523 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-16T15:38:49.523 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-16T15:38:49.523 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-16T15:38:49.523 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-16T15:38:49.523 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.523 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.523 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.523 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.523 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.523 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.523 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.523 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.523 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.524 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.524 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.524 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.524 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.524 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.524 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.524 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.524 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.524 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.524 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.524 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-16T15:38:49.524 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-16T15:38:49.524 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.524 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.525 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.525 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.525 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.525 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.525 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.525 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.525 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.525 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.525 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.525 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.525 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-16T15:38:49.525 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-16T15:38:49.525 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.525 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.525 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.525 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-16T15:38:49.526 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.526 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.526 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.526 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.526 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.526 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.526 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.526 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.526 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.526 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.526 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.526 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.526 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.526 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.526 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.527 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-16T15:38:49.527 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-16T15:38:49.527 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.527 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.527 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.527 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.527 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.527 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.527 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.527 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.527 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.527 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.527 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.527 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.527 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-16T15:38:49.528 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-16T15:38:49.528 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.528 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-16T15:38:49.528 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.528 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-16T15:38:49.528 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.528 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.528 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.528 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.528 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.528 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.528 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.528 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.528 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.528 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.529 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:49.529 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "status", 2024-09-16T15:38:49.529 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-16T15:38:49.529 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-16T15:38:49.529 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-16T15:38:49.529 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-16T15:38:49.529 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-16T15:38:49.529 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.529 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.529 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.529 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.529 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.529 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.529 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.529 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.530 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.530 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.530 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.530 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.530 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.530 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.530 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.530 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.530 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.530 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.530 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.530 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-16T15:38:49.530 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-16T15:38:49.530 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.530 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.530 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.531 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.531 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.531 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.531 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.531 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.531 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.531 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.531 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.531 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.531 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-16T15:38:49.531 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-16T15:38:49.531 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.531 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.531 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.531 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-16T15:38:49.531 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.532 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.532 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.532 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.532 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.532 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.532 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.532 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.532 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.532 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.532 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.532 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.532 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.532 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.532 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.532 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-16T15:38:49.533 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-16T15:38:49.533 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.533 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.533 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.533 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.533 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.533 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.533 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.533 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.533 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.533 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.533 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.533 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.534 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-16T15:38:49.534 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-16T15:38:49.534 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.534 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-16T15:38:49.534 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.534 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-16T15:38:49.534 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.534 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.534 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.534 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.534 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.534 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.534 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.534 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.535 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.535 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.535 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:49.535 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "telegraf", 2024-09-16T15:38:49.535 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-16T15:38:49.535 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-16T15:38:49.535 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-16T15:38:49.535 INFO:teuthology.orchestra.run.smithi098.stdout: "address": { 2024-09-16T15:38:49.535 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "address", 2024-09-16T15:38:49.535 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.535 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.535 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.535 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-16T15:38:49.535 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.535 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.536 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.536 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.536 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.536 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.536 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.536 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.536 INFO:teuthology.orchestra.run.smithi098.stdout: "interval": { 2024-09-16T15:38:49.536 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "interval", 2024-09-16T15:38:49.536 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-16T15:38:49.536 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.536 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.536 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "15", 2024-09-16T15:38:49.536 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.537 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.537 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.537 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.537 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.537 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.537 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.537 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.537 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-16T15:38:49.537 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-16T15:38:49.537 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.537 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.537 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.537 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.537 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.538 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.538 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.538 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.538 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.538 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.538 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.538 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.538 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.538 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.538 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.538 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.538 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.538 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.538 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.538 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-16T15:38:49.539 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-16T15:38:49.539 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.539 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.539 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.539 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.539 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.539 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.539 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.539 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.539 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.539 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.539 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.539 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.539 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-16T15:38:49.540 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-16T15:38:49.540 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.540 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.540 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.540 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-16T15:38:49.540 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.540 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.540 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.540 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.540 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.540 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.540 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.540 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.540 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.541 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.541 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.541 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.541 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.541 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.541 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.541 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-16T15:38:49.541 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-16T15:38:49.541 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.541 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.541 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.541 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.541 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.541 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.541 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.542 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.542 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.542 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.542 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.542 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.542 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-16T15:38:49.542 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-16T15:38:49.542 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.542 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-16T15:38:49.542 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.542 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-16T15:38:49.542 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.542 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.542 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.543 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.543 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.543 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.543 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.543 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.543 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.543 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.543 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:49.543 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "telemetry", 2024-09-16T15:38:49.543 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-16T15:38:49.543 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-16T15:38:49.543 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-16T15:38:49.543 INFO:teuthology.orchestra.run.smithi098.stdout: "channel_basic": { 2024-09-16T15:38:49.543 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "channel_basic", 2024-09-16T15:38:49.544 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.544 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.544 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.544 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-16T15:38:49.544 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.544 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.544 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.544 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-16T15:38:49.544 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.544 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.544 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.544 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.544 INFO:teuthology.orchestra.run.smithi098.stdout: "channel_crash": { 2024-09-16T15:38:49.544 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "channel_crash", 2024-09-16T15:38:49.545 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.545 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.545 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.545 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-16T15:38:49.545 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.545 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.545 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.545 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-16T15:38:49.545 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.545 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.545 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.545 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.546 INFO:teuthology.orchestra.run.smithi098.stdout: "channel_device": { 2024-09-16T15:38:49.546 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "channel_device", 2024-09-16T15:38:49.546 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.546 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.546 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.546 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-16T15:38:49.546 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.546 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.546 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.546 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-16T15:38:49.546 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.546 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.546 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.546 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.547 INFO:teuthology.orchestra.run.smithi098.stdout: "channel_ident": { 2024-09-16T15:38:49.547 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "channel_ident", 2024-09-16T15:38:49.547 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.547 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.547 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.547 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.547 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.547 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.547 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.547 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-16T15:38:49.547 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.547 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.547 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.548 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.548 INFO:teuthology.orchestra.run.smithi098.stdout: "channel_perf": { 2024-09-16T15:38:49.548 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "channel_perf", 2024-09-16T15:38:49.548 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.548 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.548 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.548 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.548 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.548 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.548 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.548 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-16T15:38:49.548 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.548 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.549 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.549 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.549 INFO:teuthology.orchestra.run.smithi098.stdout: "contact": { 2024-09-16T15:38:49.549 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "contact", 2024-09-16T15:38:49.549 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.549 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.549 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.549 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.549 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.549 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.549 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.549 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.549 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.550 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.550 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.550 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.550 INFO:teuthology.orchestra.run.smithi098.stdout: "description": { 2024-09-16T15:38:49.550 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "description", 2024-09-16T15:38:49.550 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.550 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.550 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.550 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.550 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.550 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.550 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.550 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.550 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.550 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.551 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.551 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.551 INFO:teuthology.orchestra.run.smithi098.stdout: "device_url": { 2024-09-16T15:38:49.551 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "device_url", 2024-09-16T15:38:49.551 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.551 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.551 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.551 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-16T15:38:49.551 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.551 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.551 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.551 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.551 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.551 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.552 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.552 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.552 INFO:teuthology.orchestra.run.smithi098.stdout: "enabled": { 2024-09-16T15:38:49.552 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "enabled", 2024-09-16T15:38:49.552 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.552 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.552 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.552 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.552 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.552 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.552 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.552 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.552 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.553 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.553 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.553 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.553 INFO:teuthology.orchestra.run.smithi098.stdout: "interval": { 2024-09-16T15:38:49.553 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "interval", 2024-09-16T15:38:49.553 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.553 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.553 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.553 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "24", 2024-09-16T15:38:49.553 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "8", 2024-09-16T15:38:49.553 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.553 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.553 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.553 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.554 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.554 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.554 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.554 INFO:teuthology.orchestra.run.smithi098.stdout: "last_opt_revision": { 2024-09-16T15:38:49.554 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "last_opt_revision", 2024-09-16T15:38:49.554 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.554 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.554 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.554 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "1", 2024-09-16T15:38:49.554 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.554 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.554 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.554 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.555 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.555 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.555 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.555 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.555 INFO:teuthology.orchestra.run.smithi098.stdout: "leaderboard": { 2024-09-16T15:38:49.555 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "leaderboard", 2024-09-16T15:38:49.555 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.555 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.555 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.555 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.555 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.555 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.555 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.555 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.556 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.556 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.556 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.556 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.556 INFO:teuthology.orchestra.run.smithi098.stdout: "leaderboard_description": { 2024-09-16T15:38:49.556 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "leaderboard_description", 2024-09-16T15:38:49.556 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.556 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.556 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.556 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.556 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.556 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.556 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.556 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.557 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.557 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.557 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.557 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.557 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-16T15:38:49.557 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-16T15:38:49.557 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.557 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.557 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.557 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.557 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.557 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.557 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.558 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.558 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.558 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.558 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.558 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.558 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.558 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.558 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.558 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.558 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.558 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.558 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.558 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-16T15:38:49.558 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-16T15:38:49.559 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.559 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.559 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.559 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.559 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.559 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.559 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.559 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.559 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.559 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.559 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.559 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.559 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-16T15:38:49.559 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-16T15:38:49.560 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.560 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.560 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.560 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-16T15:38:49.560 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.560 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.560 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.560 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.560 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.560 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.560 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.560 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.560 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.560 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.560 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.561 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.561 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.561 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.561 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.561 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-16T15:38:49.561 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-16T15:38:49.561 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.561 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.561 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.561 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.561 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.561 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.561 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.561 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.561 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.562 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.562 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.562 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.562 INFO:teuthology.orchestra.run.smithi098.stdout: "organization": { 2024-09-16T15:38:49.562 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "organization", 2024-09-16T15:38:49.562 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.562 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.562 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.562 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.562 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.562 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.562 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.562 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.562 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.563 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.563 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.563 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.563 INFO:teuthology.orchestra.run.smithi098.stdout: "proxy": { 2024-09-16T15:38:49.563 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "proxy", 2024-09-16T15:38:49.563 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.563 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.563 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.563 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.563 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.563 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.563 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.563 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.563 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.564 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.564 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.564 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.564 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-16T15:38:49.564 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-16T15:38:49.564 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.564 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-16T15:38:49.564 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.564 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-16T15:38:49.564 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.564 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.564 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.564 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.564 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.565 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.565 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.565 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.567 INFO:teuthology.orchestra.run.smithi098.stdout: "url": { 2024-09-16T15:38:49.567 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "url", 2024-09-16T15:38:49.567 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.567 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.567 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.567 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-16T15:38:49.568 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.568 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.568 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.568 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.568 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.568 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.568 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.568 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.568 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.568 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.568 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:49.568 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "test_orchestrator", 2024-09-16T15:38:49.568 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-16T15:38:49.568 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-16T15:38:49.568 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-16T15:38:49.569 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-16T15:38:49.569 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-16T15:38:49.569 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.569 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.569 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.569 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.569 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.569 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.569 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.569 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.569 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.569 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.569 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.569 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.569 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.570 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.570 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.570 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.570 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.570 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.570 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.570 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-16T15:38:49.570 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-16T15:38:49.570 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.570 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.570 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.570 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.570 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.570 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.570 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.571 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.571 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.571 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.571 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.571 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.571 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-16T15:38:49.571 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-16T15:38:49.571 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.571 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.571 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.571 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-16T15:38:49.571 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.571 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.571 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.571 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.571 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.572 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.572 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.572 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.572 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.572 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.572 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.572 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.572 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.572 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.572 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.572 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-16T15:38:49.572 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-16T15:38:49.572 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.572 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.573 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.573 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.573 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.573 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.573 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.573 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.573 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.573 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.573 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.573 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.573 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-16T15:38:49.573 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-16T15:38:49.573 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.573 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-16T15:38:49.573 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.574 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-16T15:38:49.574 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.574 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.574 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.574 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.574 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.574 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.574 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.574 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.574 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.574 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.574 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:49.574 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "volumes", 2024-09-16T15:38:49.574 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-16T15:38:49.574 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-16T15:38:49.574 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-16T15:38:49.575 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-16T15:38:49.575 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-16T15:38:49.575 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.575 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.575 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.575 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.575 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.575 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.575 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.575 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.575 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.575 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.575 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.575 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.575 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.576 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.576 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.576 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.576 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.576 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.576 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.576 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-16T15:38:49.576 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-16T15:38:49.576 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.576 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.576 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.576 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.576 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.576 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.577 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.577 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.577 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.577 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.577 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.577 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.577 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-16T15:38:49.577 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-16T15:38:49.577 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.577 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.577 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.577 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-16T15:38:49.577 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.577 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.578 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.578 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.578 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.578 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.578 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.578 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.578 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.578 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.578 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.578 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.578 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.578 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.578 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.578 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-16T15:38:49.579 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-16T15:38:49.579 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.579 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.579 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.579 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.579 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.579 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.579 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.579 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.579 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.579 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.579 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.579 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.579 INFO:teuthology.orchestra.run.smithi098.stdout: "max_concurrent_clones": { 2024-09-16T15:38:49.580 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "max_concurrent_clones", 2024-09-16T15:38:49.580 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.580 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.580 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.580 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "4", 2024-09-16T15:38:49.580 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.580 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.580 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.580 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-16T15:38:49.580 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.580 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.580 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.580 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.580 INFO:teuthology.orchestra.run.smithi098.stdout: "periodic_async_work": { 2024-09-16T15:38:49.580 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "periodic_async_work", 2024-09-16T15:38:49.581 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.581 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.581 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.581 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.581 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.581 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.581 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.581 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Periodically check for async work", 2024-09-16T15:38:49.581 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.581 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.581 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.581 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.581 INFO:teuthology.orchestra.run.smithi098.stdout: "snapshot_clone_delay": { 2024-09-16T15:38:49.581 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "snapshot_clone_delay", 2024-09-16T15:38:49.582 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.582 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.582 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.582 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-16T15:38:49.582 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.582 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.582 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.582 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-16T15:38:49.582 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.582 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.582 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.582 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.582 INFO:teuthology.orchestra.run.smithi098.stdout: "snapshot_clone_no_wait": { 2024-09-16T15:38:49.582 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "snapshot_clone_no_wait", 2024-09-16T15:38:49.582 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.583 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.583 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.583 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-16T15:38:49.583 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.583 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.583 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.583 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-16T15:38:49.583 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.583 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.583 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.583 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.583 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-16T15:38:49.583 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-16T15:38:49.584 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.584 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-16T15:38:49.584 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.584 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-16T15:38:49.584 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.584 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.584 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.584 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.584 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.584 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.584 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.584 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.584 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.584 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.584 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:49.584 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "zabbix", 2024-09-16T15:38:49.585 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-16T15:38:49.585 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-16T15:38:49.585 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-16T15:38:49.585 INFO:teuthology.orchestra.run.smithi098.stdout: "discovery_interval": { 2024-09-16T15:38:49.585 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "discovery_interval", 2024-09-16T15:38:49.585 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "uint", 2024-09-16T15:38:49.585 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.585 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.585 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "100", 2024-09-16T15:38:49.585 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.585 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.585 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.585 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.585 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.585 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.585 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.586 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.586 INFO:teuthology.orchestra.run.smithi098.stdout: "identifier": { 2024-09-16T15:38:49.586 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "identifier", 2024-09-16T15:38:49.586 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.586 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.586 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.586 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.586 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.586 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.586 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.586 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.586 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.586 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.587 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.587 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.587 INFO:teuthology.orchestra.run.smithi098.stdout: "interval": { 2024-09-16T15:38:49.587 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "interval", 2024-09-16T15:38:49.587 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-16T15:38:49.587 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.587 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.587 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "60", 2024-09-16T15:38:49.587 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.587 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.587 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.587 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.587 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.587 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.588 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.588 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.588 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-16T15:38:49.588 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-16T15:38:49.588 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.588 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.588 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.588 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.588 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.588 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.588 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.588 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.588 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.588 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.588 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.589 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.589 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.589 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.589 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.589 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.589 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.589 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.589 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.589 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-16T15:38:49.589 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-16T15:38:49.589 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.589 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.589 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.589 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.589 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.590 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.590 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.590 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.590 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.590 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.590 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.590 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.590 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-16T15:38:49.590 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-16T15:38:49.590 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.590 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.590 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.590 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-16T15:38:49.590 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.590 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.590 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.591 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.591 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.591 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.591 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.591 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.591 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.591 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.591 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.591 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.591 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.591 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.591 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.591 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-16T15:38:49.591 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-16T15:38:49.591 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.592 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.592 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.592 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.592 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.592 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.592 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.592 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.592 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.592 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.592 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.592 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.592 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-16T15:38:49.593 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-16T15:38:49.593 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.593 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-16T15:38:49.593 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.593 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-16T15:38:49.593 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.593 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.593 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.593 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.593 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.593 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.593 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.593 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.593 INFO:teuthology.orchestra.run.smithi098.stdout: "zabbix_host": { 2024-09-16T15:38:49.593 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "zabbix_host", 2024-09-16T15:38:49.594 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.594 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.594 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.594 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.594 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.594 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.594 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.594 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.594 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.594 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.594 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.594 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.594 INFO:teuthology.orchestra.run.smithi098.stdout: "zabbix_port": { 2024-09-16T15:38:49.594 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "zabbix_port", 2024-09-16T15:38:49.594 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.595 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.595 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.595 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "10051", 2024-09-16T15:38:49.595 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.595 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.595 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.595 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.595 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.595 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.595 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.595 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.595 INFO:teuthology.orchestra.run.smithi098.stdout: "zabbix_sender": { 2024-09-16T15:38:49.595 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "zabbix_sender", 2024-09-16T15:38:49.595 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.596 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.596 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.596 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-16T15:38:49.596 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.596 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.596 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.596 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.596 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.596 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.596 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.596 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.596 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.596 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.596 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-16T15:38:49.597 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.597 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.597 INFO:teuthology.orchestra.run.smithi098.stdout: "modules": [ 2024-09-16T15:38:49.597 INFO:teuthology.orchestra.run.smithi098.stdout: "iostat", 2024-09-16T15:38:49.597 INFO:teuthology.orchestra.run.smithi098.stdout: "nfs", 2024-09-16T15:38:49.597 INFO:teuthology.orchestra.run.smithi098.stdout: "restful" 2024-09-16T15:38:49.597 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.597 INFO:teuthology.orchestra.run.smithi098.stdout: "available_modules": [ 2024-09-16T15:38:49.597 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:49.597 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "alerts", 2024-09-16T15:38:49.597 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-16T15:38:49.597 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-16T15:38:49.597 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-16T15:38:49.597 INFO:teuthology.orchestra.run.smithi098.stdout: "interval": { 2024-09-16T15:38:49.598 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "interval", 2024-09-16T15:38:49.598 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-16T15:38:49.598 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.598 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.598 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "60", 2024-09-16T15:38:49.598 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.598 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.598 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.598 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "How frequently to reexamine health status", 2024-09-16T15:38:49.598 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.598 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.598 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.598 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.598 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-16T15:38:49.599 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-16T15:38:49.599 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.599 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.599 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.599 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.599 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.599 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.599 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.599 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.599 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.599 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.599 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.599 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.599 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.600 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.600 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.600 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.600 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.600 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.600 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.600 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-16T15:38:49.600 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-16T15:38:49.600 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.600 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.600 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.600 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.600 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.601 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.601 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.601 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.601 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.601 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.601 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.601 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.601 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-16T15:38:49.601 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-16T15:38:49.601 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.601 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.601 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.601 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-16T15:38:49.601 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.601 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.602 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.602 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.602 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.602 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.602 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.602 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.602 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.602 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.602 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.602 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.602 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.602 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.602 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.602 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-16T15:38:49.602 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-16T15:38:49.603 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.603 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.603 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.603 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.603 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.603 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.603 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.603 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.603 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.603 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.603 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.603 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.603 INFO:teuthology.orchestra.run.smithi098.stdout: "smtp_destination": { 2024-09-16T15:38:49.603 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "smtp_destination", 2024-09-16T15:38:49.604 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.604 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.604 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.604 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.604 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.604 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.604 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.604 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-16T15:38:49.604 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.604 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.604 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.604 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.604 INFO:teuthology.orchestra.run.smithi098.stdout: "smtp_from_name": { 2024-09-16T15:38:49.604 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "smtp_from_name", 2024-09-16T15:38:49.604 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.605 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.605 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.605 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "Ceph", 2024-09-16T15:38:49.605 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.605 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.605 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.605 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Email From: name", 2024-09-16T15:38:49.605 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.605 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.605 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.605 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.605 INFO:teuthology.orchestra.run.smithi098.stdout: "smtp_host": { 2024-09-16T15:38:49.605 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "smtp_host", 2024-09-16T15:38:49.605 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.606 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.606 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.606 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.606 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.606 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.606 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.606 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "SMTP server", 2024-09-16T15:38:49.606 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.606 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.606 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.606 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.606 INFO:teuthology.orchestra.run.smithi098.stdout: "smtp_password": { 2024-09-16T15:38:49.606 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "smtp_password", 2024-09-16T15:38:49.606 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.607 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.607 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.607 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.607 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.607 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.607 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.607 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Password to authenticate with", 2024-09-16T15:38:49.607 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.607 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.607 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.607 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.607 INFO:teuthology.orchestra.run.smithi098.stdout: "smtp_port": { 2024-09-16T15:38:49.607 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "smtp_port", 2024-09-16T15:38:49.607 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.608 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.608 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.608 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "465", 2024-09-16T15:38:49.608 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.608 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.608 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.608 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "SMTP port", 2024-09-16T15:38:49.608 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.608 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.608 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.608 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.608 INFO:teuthology.orchestra.run.smithi098.stdout: "smtp_sender": { 2024-09-16T15:38:49.608 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "smtp_sender", 2024-09-16T15:38:49.608 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.608 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.609 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.609 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.609 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.609 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.609 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.609 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "SMTP envelope sender", 2024-09-16T15:38:49.609 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.609 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.609 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.609 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.609 INFO:teuthology.orchestra.run.smithi098.stdout: "smtp_ssl": { 2024-09-16T15:38:49.609 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "smtp_ssl", 2024-09-16T15:38:49.609 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.610 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.610 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.610 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-16T15:38:49.610 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.610 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.610 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.610 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-16T15:38:49.610 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.610 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.610 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.610 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.610 INFO:teuthology.orchestra.run.smithi098.stdout: "smtp_user": { 2024-09-16T15:38:49.610 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "smtp_user", 2024-09-16T15:38:49.610 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.610 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.610 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.611 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.611 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.611 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.611 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.611 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "User to authenticate as", 2024-09-16T15:38:49.611 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.611 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.611 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.611 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.611 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-16T15:38:49.611 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-16T15:38:49.611 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.611 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-16T15:38:49.611 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.611 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-16T15:38:49.611 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.612 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.612 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.612 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.612 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.612 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.612 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.612 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.612 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.612 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.612 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:49.612 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "balancer", 2024-09-16T15:38:49.612 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-16T15:38:49.612 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-16T15:38:49.612 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-16T15:38:49.612 INFO:teuthology.orchestra.run.smithi098.stdout: "active": { 2024-09-16T15:38:49.612 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "active", 2024-09-16T15:38:49.613 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.613 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.613 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.613 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-16T15:38:49.613 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.613 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.613 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.613 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "automatically balance PGs across cluster", 2024-09-16T15:38:49.613 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.613 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.613 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.613 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.613 INFO:teuthology.orchestra.run.smithi098.stdout: "begin_time": { 2024-09-16T15:38:49.613 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "begin_time", 2024-09-16T15:38:49.613 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.614 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.614 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.614 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0000", 2024-09-16T15:38:49.614 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.614 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.614 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.614 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "beginning time of day to automatically balance", 2024-09-16T15:38:49.614 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-16T15:38:49.614 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.614 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.614 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.614 INFO:teuthology.orchestra.run.smithi098.stdout: "begin_weekday": { 2024-09-16T15:38:49.614 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "begin_weekday", 2024-09-16T15:38:49.614 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "uint", 2024-09-16T15:38:49.614 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.615 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.615 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-16T15:38:49.615 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "0", 2024-09-16T15:38:49.615 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "6", 2024-09-16T15:38:49.615 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.615 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-16T15:38:49.615 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-16T15:38:49.615 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.615 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.615 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.615 INFO:teuthology.orchestra.run.smithi098.stdout: "crush_compat_max_iterations": { 2024-09-16T15:38:49.615 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "crush_compat_max_iterations", 2024-09-16T15:38:49.615 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "uint", 2024-09-16T15:38:49.615 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.615 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.615 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "25", 2024-09-16T15:38:49.616 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "1", 2024-09-16T15:38:49.616 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "250", 2024-09-16T15:38:49.616 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.616 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-16T15:38:49.616 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.616 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.616 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.616 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.616 INFO:teuthology.orchestra.run.smithi098.stdout: "crush_compat_metrics": { 2024-09-16T15:38:49.616 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "crush_compat_metrics", 2024-09-16T15:38:49.616 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.616 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.616 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.616 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "pgs,objects,bytes", 2024-09-16T15:38:49.616 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.616 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.617 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.617 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-16T15:38:49.617 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-16T15:38:49.617 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.617 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.617 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.617 INFO:teuthology.orchestra.run.smithi098.stdout: "crush_compat_step": { 2024-09-16T15:38:49.617 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "crush_compat_step", 2024-09-16T15:38:49.617 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "float", 2024-09-16T15:38:49.617 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.617 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.617 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0.5", 2024-09-16T15:38:49.617 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "0.001", 2024-09-16T15:38:49.617 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "0.999", 2024-09-16T15:38:49.617 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.618 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "aggressiveness of optimization", 2024-09-16T15:38:49.618 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-16T15:38:49.618 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.618 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.618 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.618 INFO:teuthology.orchestra.run.smithi098.stdout: "end_time": { 2024-09-16T15:38:49.618 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "end_time", 2024-09-16T15:38:49.618 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.618 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.618 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.618 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "2359", 2024-09-16T15:38:49.618 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.618 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.618 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.618 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "ending time of day to automatically balance", 2024-09-16T15:38:49.619 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-16T15:38:49.619 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.619 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.619 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.619 INFO:teuthology.orchestra.run.smithi098.stdout: "end_weekday": { 2024-09-16T15:38:49.619 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "end_weekday", 2024-09-16T15:38:49.619 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "uint", 2024-09-16T15:38:49.619 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.619 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.619 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-16T15:38:49.619 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "0", 2024-09-16T15:38:49.619 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "6", 2024-09-16T15:38:49.619 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.619 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-16T15:38:49.619 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-16T15:38:49.620 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.620 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.620 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.620 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-16T15:38:49.620 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-16T15:38:49.620 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.620 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.620 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.620 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.620 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.620 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.620 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.620 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.620 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.621 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.621 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.621 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.621 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.621 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.621 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.621 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.621 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.621 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.621 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.621 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-16T15:38:49.621 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-16T15:38:49.621 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.621 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.622 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.622 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.622 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.622 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.622 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.622 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.622 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.622 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.622 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.622 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.622 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-16T15:38:49.622 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-16T15:38:49.622 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.622 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.623 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.623 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-16T15:38:49.623 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.623 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.623 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.623 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.623 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.623 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.623 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.623 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.623 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.623 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.623 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.624 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.624 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.624 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.624 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.624 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-16T15:38:49.624 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-16T15:38:49.624 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.624 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.624 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.624 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.624 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.624 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.624 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.624 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.625 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.625 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.625 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.625 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.625 INFO:teuthology.orchestra.run.smithi098.stdout: "min_score": { 2024-09-16T15:38:49.625 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "min_score", 2024-09-16T15:38:49.625 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "float", 2024-09-16T15:38:49.625 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.625 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.625 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-16T15:38:49.625 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.625 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.625 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.625 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-16T15:38:49.625 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.626 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.626 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.626 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.626 INFO:teuthology.orchestra.run.smithi098.stdout: "mode": { 2024-09-16T15:38:49.626 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "mode", 2024-09-16T15:38:49.626 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.626 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.626 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.626 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "upmap", 2024-09-16T15:38:49.626 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.626 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.626 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.626 INFO:teuthology.orchestra.run.smithi098.stdout: "crush-compat", 2024-09-16T15:38:49.626 INFO:teuthology.orchestra.run.smithi098.stdout: "none", 2024-09-16T15:38:49.626 INFO:teuthology.orchestra.run.smithi098.stdout: "read", 2024-09-16T15:38:49.627 INFO:teuthology.orchestra.run.smithi098.stdout: "upmap", 2024-09-16T15:38:49.627 INFO:teuthology.orchestra.run.smithi098.stdout: "upmap-read" 2024-09-16T15:38:49.627 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.627 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Balancer mode", 2024-09-16T15:38:49.627 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.627 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.627 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.627 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.627 INFO:teuthology.orchestra.run.smithi098.stdout: "pool_ids": { 2024-09-16T15:38:49.627 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "pool_ids", 2024-09-16T15:38:49.627 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.627 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.627 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.627 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.627 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.628 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.628 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.628 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-16T15:38:49.628 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.628 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.628 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.628 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.628 INFO:teuthology.orchestra.run.smithi098.stdout: "sleep_interval": { 2024-09-16T15:38:49.628 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sleep_interval", 2024-09-16T15:38:49.628 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-16T15:38:49.628 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.628 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.628 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "60", 2024-09-16T15:38:49.628 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.629 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.629 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.629 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-16T15:38:49.629 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.629 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.629 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.629 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.629 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-16T15:38:49.629 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-16T15:38:49.629 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.629 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-16T15:38:49.629 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.629 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-16T15:38:49.629 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.629 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.630 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.630 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.630 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.630 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.630 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.630 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.630 INFO:teuthology.orchestra.run.smithi098.stdout: "upmap_max_deviation": { 2024-09-16T15:38:49.630 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "upmap_max_deviation", 2024-09-16T15:38:49.630 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.630 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.630 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.630 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "5", 2024-09-16T15:38:49.630 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "1", 2024-09-16T15:38:49.630 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.630 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.631 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-16T15:38:49.631 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-16T15:38:49.631 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.631 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.631 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.631 INFO:teuthology.orchestra.run.smithi098.stdout: "upmap_max_optimizations": { 2024-09-16T15:38:49.631 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "upmap_max_optimizations", 2024-09-16T15:38:49.631 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "uint", 2024-09-16T15:38:49.631 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.631 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.631 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "10", 2024-09-16T15:38:49.631 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.631 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.631 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.631 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-16T15:38:49.631 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.632 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.632 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.632 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.632 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.632 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.632 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:49.632 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "cephadm", 2024-09-16T15:38:49.632 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-16T15:38:49.632 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-16T15:38:49.632 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-16T15:38:49.632 INFO:teuthology.orchestra.run.smithi098.stdout: "agent_down_multiplier": { 2024-09-16T15:38:49.632 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "agent_down_multiplier", 2024-09-16T15:38:49.632 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "float", 2024-09-16T15:38:49.632 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.632 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.633 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "3.0", 2024-09-16T15:38:49.633 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.633 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.633 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.633 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-16T15:38:49.633 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.633 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.633 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.633 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.633 INFO:teuthology.orchestra.run.smithi098.stdout: "agent_refresh_rate": { 2024-09-16T15:38:49.633 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "agent_refresh_rate", 2024-09-16T15:38:49.633 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-16T15:38:49.633 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.633 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.633 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "20", 2024-09-16T15:38:49.634 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.634 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.634 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.634 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-16T15:38:49.634 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.634 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.634 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.634 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.634 INFO:teuthology.orchestra.run.smithi098.stdout: "agent_starting_port": { 2024-09-16T15:38:49.634 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "agent_starting_port", 2024-09-16T15:38:49.634 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.634 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.634 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.634 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "4721", 2024-09-16T15:38:49.634 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.634 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.635 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.635 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-16T15:38:49.635 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.635 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.635 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.635 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.635 INFO:teuthology.orchestra.run.smithi098.stdout: "allow_ptrace": { 2024-09-16T15:38:49.635 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "allow_ptrace", 2024-09-16T15:38:49.635 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.635 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.635 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.635 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.635 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.635 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.635 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.635 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-16T15:38:49.636 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-16T15:38:49.636 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.636 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.636 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.636 INFO:teuthology.orchestra.run.smithi098.stdout: "autotune_interval": { 2024-09-16T15:38:49.636 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "autotune_interval", 2024-09-16T15:38:49.636 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-16T15:38:49.636 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.636 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.636 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "600", 2024-09-16T15:38:49.636 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.636 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.636 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.636 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-16T15:38:49.636 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.637 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.637 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.637 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.637 INFO:teuthology.orchestra.run.smithi098.stdout: "autotune_memory_target_ratio": { 2024-09-16T15:38:49.637 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "autotune_memory_target_ratio", 2024-09-16T15:38:49.637 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "float", 2024-09-16T15:38:49.637 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.637 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.637 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0.7", 2024-09-16T15:38:49.637 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.637 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.637 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.637 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-16T15:38:49.638 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.638 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.638 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.638 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.638 INFO:teuthology.orchestra.run.smithi098.stdout: "cephadm_log_destination": { 2024-09-16T15:38:49.638 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "cephadm_log_destination", 2024-09-16T15:38:49.638 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.638 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.638 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.638 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.638 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.638 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.638 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.638 INFO:teuthology.orchestra.run.smithi098.stdout: "file", 2024-09-16T15:38:49.638 INFO:teuthology.orchestra.run.smithi098.stdout: "file,syslog", 2024-09-16T15:38:49.639 INFO:teuthology.orchestra.run.smithi098.stdout: "syslog" 2024-09-16T15:38:49.639 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.639 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-16T15:38:49.639 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.639 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.639 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.639 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.639 INFO:teuthology.orchestra.run.smithi098.stdout: "cgroups_split": { 2024-09-16T15:38:49.639 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "cgroups_split", 2024-09-16T15:38:49.639 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.639 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.639 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.639 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-16T15:38:49.639 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.640 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.640 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.640 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-16T15:38:49.640 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.640 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.640 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.640 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.640 INFO:teuthology.orchestra.run.smithi098.stdout: "config_checks_enabled": { 2024-09-16T15:38:49.640 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "config_checks_enabled", 2024-09-16T15:38:49.640 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.640 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.640 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.640 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.640 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.640 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.640 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.641 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-16T15:38:49.641 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.641 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.641 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.641 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.641 INFO:teuthology.orchestra.run.smithi098.stdout: "config_dashboard": { 2024-09-16T15:38:49.641 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "config_dashboard", 2024-09-16T15:38:49.641 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.641 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.641 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.641 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-16T15:38:49.641 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.641 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.641 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.641 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-16T15:38:49.641 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.642 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.642 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.642 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.642 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_alertmanager": { 2024-09-16T15:38:49.642 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_alertmanager", 2024-09-16T15:38:49.642 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.642 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.642 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.642 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-16T15:38:49.642 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.642 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.642 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.642 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Prometheus container image", 2024-09-16T15:38:49.642 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.642 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.642 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.643 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.643 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_base": { 2024-09-16T15:38:49.643 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_base", 2024-09-16T15:38:49.643 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.643 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.643 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.643 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-16T15:38:49.643 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.643 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.643 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.643 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Container image name, without the tag", 2024-09-16T15:38:49.643 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.643 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.643 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.643 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.643 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_elasticsearch": { 2024-09-16T15:38:49.644 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_elasticsearch", 2024-09-16T15:38:49.644 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.644 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.644 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.644 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-16T15:38:49.644 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.644 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.644 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.644 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "elasticsearch container image", 2024-09-16T15:38:49.644 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.644 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.644 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.644 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.644 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_grafana": { 2024-09-16T15:38:49.644 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_grafana", 2024-09-16T15:38:49.645 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.645 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.645 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.645 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-09-16T15:38:49.645 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.645 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.645 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.645 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Prometheus container image", 2024-09-16T15:38:49.645 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.645 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.645 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.645 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.645 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_haproxy": { 2024-09-16T15:38:49.645 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_haproxy", 2024-09-16T15:38:49.645 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.646 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.646 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.646 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-16T15:38:49.646 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.646 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.646 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.646 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "HAproxy container image", 2024-09-16T15:38:49.646 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.646 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.646 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.646 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.646 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_jaeger_agent": { 2024-09-16T15:38:49.646 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_jaeger_agent", 2024-09-16T15:38:49.646 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.646 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.646 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.647 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-16T15:38:49.647 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.647 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.647 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.647 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Jaeger agent container image", 2024-09-16T15:38:49.647 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.647 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.647 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.647 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.647 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_jaeger_collector": { 2024-09-16T15:38:49.647 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_jaeger_collector", 2024-09-16T15:38:49.647 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.647 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.647 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.647 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-16T15:38:49.648 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.648 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.648 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.648 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Jaeger collector container image", 2024-09-16T15:38:49.648 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.648 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.648 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.648 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.648 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_jaeger_query": { 2024-09-16T15:38:49.648 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_jaeger_query", 2024-09-16T15:38:49.648 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.648 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.648 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.648 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-16T15:38:49.648 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.649 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.649 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.649 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Jaeger query container image", 2024-09-16T15:38:49.649 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.649 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.649 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.649 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.649 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_keepalived": { 2024-09-16T15:38:49.649 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_keepalived", 2024-09-16T15:38:49.649 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.649 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.649 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.649 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-16T15:38:49.649 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.649 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.650 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.650 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Keepalived container image", 2024-09-16T15:38:49.650 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.650 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.650 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.650 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.650 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_loki": { 2024-09-16T15:38:49.650 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_loki", 2024-09-16T15:38:49.650 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.650 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.650 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.650 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-16T15:38:49.650 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.650 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.651 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.651 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Loki container image", 2024-09-16T15:38:49.651 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.651 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.651 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.651 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.651 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_nginx": { 2024-09-16T15:38:49.651 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_nginx", 2024-09-16T15:38:49.651 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.651 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.651 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.651 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-16T15:38:49.651 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.651 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.652 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.652 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Nginx container image", 2024-09-16T15:38:49.652 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.652 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.652 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.652 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.652 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_node_exporter": { 2024-09-16T15:38:49.652 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_node_exporter", 2024-09-16T15:38:49.652 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.652 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.652 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.652 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-16T15:38:49.652 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.652 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.653 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.653 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Prometheus container image", 2024-09-16T15:38:49.653 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.653 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.653 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.653 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.653 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_nvmeof": { 2024-09-16T15:38:49.653 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_nvmeof", 2024-09-16T15:38:49.653 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.653 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.653 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.653 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-16T15:38:49.653 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.654 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.654 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.654 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Nvme-of container image", 2024-09-16T15:38:49.654 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.654 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.654 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.654 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.654 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_oauth2_proxy": { 2024-09-16T15:38:49.654 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_oauth2_proxy", 2024-09-16T15:38:49.654 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.654 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.654 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.654 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-16T15:38:49.654 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.654 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.655 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.655 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "oauth2-proxy container image", 2024-09-16T15:38:49.655 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.655 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.655 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.655 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.655 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_prometheus": { 2024-09-16T15:38:49.655 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_prometheus", 2024-09-16T15:38:49.655 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.655 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.655 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.655 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-16T15:38:49.655 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.656 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.656 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.656 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Prometheus container image", 2024-09-16T15:38:49.656 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.656 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.656 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.656 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.656 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_promtail": { 2024-09-16T15:38:49.656 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_promtail", 2024-09-16T15:38:49.656 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.656 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.656 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.656 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-16T15:38:49.656 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.656 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.657 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.657 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Promtail container image", 2024-09-16T15:38:49.657 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.657 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.657 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.657 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.657 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_samba": { 2024-09-16T15:38:49.657 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_samba", 2024-09-16T15:38:49.657 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.657 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.657 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.657 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-16T15:38:49.657 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.658 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.658 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.658 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Samba/SMB container image", 2024-09-16T15:38:49.658 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.658 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.658 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.658 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.658 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_samba_metrics": { 2024-09-16T15:38:49.658 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_samba_metrics", 2024-09-16T15:38:49.658 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.658 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.658 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.658 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-16T15:38:49.658 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.659 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.659 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.659 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-16T15:38:49.659 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.659 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.659 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.659 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.659 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_snmp_gateway": { 2024-09-16T15:38:49.659 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_snmp_gateway", 2024-09-16T15:38:49.659 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.659 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.659 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.659 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-16T15:38:49.659 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.659 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.660 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.660 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "SNMP Gateway container image", 2024-09-16T15:38:49.660 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.660 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.660 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.660 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.660 INFO:teuthology.orchestra.run.smithi098.stdout: "container_init": { 2024-09-16T15:38:49.660 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_init", 2024-09-16T15:38:49.660 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.660 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.660 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.660 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-16T15:38:49.660 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.660 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.660 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.661 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Run podman/docker with `--init`", 2024-09-16T15:38:49.661 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.661 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.661 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.661 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.661 INFO:teuthology.orchestra.run.smithi098.stdout: "daemon_cache_timeout": { 2024-09-16T15:38:49.661 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "daemon_cache_timeout", 2024-09-16T15:38:49.661 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-16T15:38:49.661 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.661 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.661 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "600", 2024-09-16T15:38:49.661 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.661 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.661 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.661 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-16T15:38:49.661 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.662 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.662 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.662 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.662 INFO:teuthology.orchestra.run.smithi098.stdout: "default_cephadm_command_timeout": { 2024-09-16T15:38:49.662 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "default_cephadm_command_timeout", 2024-09-16T15:38:49.662 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.662 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.662 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.662 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "900", 2024-09-16T15:38:49.662 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.662 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.662 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.662 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-16T15:38:49.662 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.662 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.663 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.663 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.663 INFO:teuthology.orchestra.run.smithi098.stdout: "default_registry": { 2024-09-16T15:38:49.663 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "default_registry", 2024-09-16T15:38:49.663 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.663 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.663 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.663 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "docker.io", 2024-09-16T15:38:49.663 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.663 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.663 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.663 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-16T15:38:49.663 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.663 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.663 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.663 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.664 INFO:teuthology.orchestra.run.smithi098.stdout: "device_cache_timeout": { 2024-09-16T15:38:49.664 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "device_cache_timeout", 2024-09-16T15:38:49.664 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-16T15:38:49.664 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.664 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.664 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "1800", 2024-09-16T15:38:49.664 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.664 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.664 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.664 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "seconds to cache device inventory", 2024-09-16T15:38:49.664 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.664 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.664 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.664 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.665 INFO:teuthology.orchestra.run.smithi098.stdout: "device_enhanced_scan": { 2024-09-16T15:38:49.665 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "device_enhanced_scan", 2024-09-16T15:38:49.665 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.665 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.665 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.665 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.665 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.665 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.665 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.665 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-16T15:38:49.665 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.665 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.665 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.666 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.666 INFO:teuthology.orchestra.run.smithi098.stdout: "facts_cache_timeout": { 2024-09-16T15:38:49.666 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "facts_cache_timeout", 2024-09-16T15:38:49.666 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-16T15:38:49.666 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.666 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.666 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "60", 2024-09-16T15:38:49.666 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.666 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.666 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.666 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "seconds to cache host facts data", 2024-09-16T15:38:49.666 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.666 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.666 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.666 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.667 INFO:teuthology.orchestra.run.smithi098.stdout: "grafana_dashboards_path": { 2024-09-16T15:38:49.667 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "grafana_dashboards_path", 2024-09-16T15:38:49.667 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.667 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.667 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.667 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-16T15:38:49.667 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.667 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.667 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.667 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-16T15:38:49.667 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.667 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.667 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.667 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.668 INFO:teuthology.orchestra.run.smithi098.stdout: "host_check_interval": { 2024-09-16T15:38:49.668 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "host_check_interval", 2024-09-16T15:38:49.668 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-16T15:38:49.668 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.668 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.668 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "600", 2024-09-16T15:38:49.668 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.668 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.668 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.668 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "how frequently to perform a host check", 2024-09-16T15:38:49.668 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.668 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.668 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.668 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.669 INFO:teuthology.orchestra.run.smithi098.stdout: "hw_monitoring": { 2024-09-16T15:38:49.669 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "hw_monitoring", 2024-09-16T15:38:49.669 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.669 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.669 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.669 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.669 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.669 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.669 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.669 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-16T15:38:49.669 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.669 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.669 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.669 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.669 INFO:teuthology.orchestra.run.smithi098.stdout: "inventory_list_all": { 2024-09-16T15:38:49.670 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "inventory_list_all", 2024-09-16T15:38:49.670 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.670 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.670 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.670 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.670 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.670 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.670 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.670 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-16T15:38:49.670 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.670 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.670 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.670 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.670 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-16T15:38:49.671 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-16T15:38:49.671 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.671 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.671 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.671 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.671 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.671 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.671 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.671 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.671 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.671 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.671 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.671 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.671 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.671 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.672 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.672 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.672 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.672 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.672 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.672 INFO:teuthology.orchestra.run.smithi098.stdout: "log_refresh_metadata": { 2024-09-16T15:38:49.672 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_refresh_metadata", 2024-09-16T15:38:49.672 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.672 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.672 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.672 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.672 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.672 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.672 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.672 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-16T15:38:49.672 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.673 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.673 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.673 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.673 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-16T15:38:49.673 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-16T15:38:49.673 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.673 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.673 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.673 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-16T15:38:49.673 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.673 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.673 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.673 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-16T15:38:49.673 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.673 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.674 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.674 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.674 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-16T15:38:49.674 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-16T15:38:49.674 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.674 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.674 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.674 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-16T15:38:49.674 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.674 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.674 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.674 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.674 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.674 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.674 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.675 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.675 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.675 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.675 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.675 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.675 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.675 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.675 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.675 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-16T15:38:49.675 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-16T15:38:49.675 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.675 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.675 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.675 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.675 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.675 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.676 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.676 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.676 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.676 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.676 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.676 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.676 INFO:teuthology.orchestra.run.smithi098.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-16T15:38:49.676 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-16T15:38:49.676 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.676 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.676 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.676 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.676 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.676 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.676 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.676 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-16T15:38:49.677 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.677 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.677 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.677 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.677 INFO:teuthology.orchestra.run.smithi098.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-16T15:38:49.677 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-16T15:38:49.677 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.677 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.677 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.677 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "*", 2024-09-16T15:38:49.677 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.677 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.677 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.677 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-16T15:38:49.677 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.678 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.678 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.678 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.678 INFO:teuthology.orchestra.run.smithi098.stdout: "max_count_per_host": { 2024-09-16T15:38:49.678 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "max_count_per_host", 2024-09-16T15:38:49.678 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.678 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.678 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.678 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "10", 2024-09-16T15:38:49.678 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.678 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.678 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.678 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "max number of daemons per service per host", 2024-09-16T15:38:49.678 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.678 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.679 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.679 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.679 INFO:teuthology.orchestra.run.smithi098.stdout: "max_osd_draining_count": { 2024-09-16T15:38:49.679 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "max_osd_draining_count", 2024-09-16T15:38:49.679 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.679 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.679 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.679 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "10", 2024-09-16T15:38:49.679 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.679 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.679 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.679 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-16T15:38:49.679 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.679 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.679 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.679 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.680 INFO:teuthology.orchestra.run.smithi098.stdout: "migration_current": { 2024-09-16T15:38:49.680 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "migration_current", 2024-09-16T15:38:49.680 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.680 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.680 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.680 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.680 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.680 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.680 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.680 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "internal - do not modify", 2024-09-16T15:38:49.680 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.680 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.680 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.680 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.680 INFO:teuthology.orchestra.run.smithi098.stdout: "mode": { 2024-09-16T15:38:49.681 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "mode", 2024-09-16T15:38:49.681 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.681 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.681 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.681 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "root", 2024-09-16T15:38:49.681 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.681 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.681 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.681 INFO:teuthology.orchestra.run.smithi098.stdout: "cephadm-package", 2024-09-16T15:38:49.681 INFO:teuthology.orchestra.run.smithi098.stdout: "root" 2024-09-16T15:38:49.681 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.681 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "mode for remote execution of cephadm", 2024-09-16T15:38:49.681 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.681 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.681 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.681 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.682 INFO:teuthology.orchestra.run.smithi098.stdout: "oob_default_addr": { 2024-09-16T15:38:49.682 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "oob_default_addr", 2024-09-16T15:38:49.682 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.682 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.682 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.682 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "169.254.1.1", 2024-09-16T15:38:49.682 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.682 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.682 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.682 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-16T15:38:49.682 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.682 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.682 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.682 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.682 INFO:teuthology.orchestra.run.smithi098.stdout: "prometheus_alerts_path": { 2024-09-16T15:38:49.682 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "prometheus_alerts_path", 2024-09-16T15:38:49.683 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.683 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.683 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.683 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-16T15:38:49.683 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.683 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.683 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.683 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-16T15:38:49.683 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.683 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.683 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.683 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.683 INFO:teuthology.orchestra.run.smithi098.stdout: "registry_insecure": { 2024-09-16T15:38:49.683 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "registry_insecure", 2024-09-16T15:38:49.683 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.683 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.684 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.684 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.684 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.684 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.684 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.684 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-16T15:38:49.684 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.684 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.684 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.684 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.684 INFO:teuthology.orchestra.run.smithi098.stdout: "registry_password": { 2024-09-16T15:38:49.684 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "registry_password", 2024-09-16T15:38:49.684 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.684 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.685 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.685 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.685 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.685 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.685 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.685 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-16T15:38:49.685 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.685 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.685 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.685 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.685 INFO:teuthology.orchestra.run.smithi098.stdout: "registry_url": { 2024-09-16T15:38:49.685 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "registry_url", 2024-09-16T15:38:49.685 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.685 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.685 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.686 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.686 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.686 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.686 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.686 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-16T15:38:49.686 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.686 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.686 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.686 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.686 INFO:teuthology.orchestra.run.smithi098.stdout: "registry_username": { 2024-09-16T15:38:49.686 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "registry_username", 2024-09-16T15:38:49.686 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.686 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.686 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.686 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.686 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.687 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.687 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.687 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-16T15:38:49.687 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.687 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.687 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.687 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.687 INFO:teuthology.orchestra.run.smithi098.stdout: "secure_monitoring_stack": { 2024-09-16T15:38:49.687 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "secure_monitoring_stack", 2024-09-16T15:38:49.687 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.687 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.687 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.687 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.687 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.687 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.687 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.688 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-16T15:38:49.688 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.688 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.688 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.688 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.688 INFO:teuthology.orchestra.run.smithi098.stdout: "service_discovery_port": { 2024-09-16T15:38:49.688 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "service_discovery_port", 2024-09-16T15:38:49.688 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.688 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.688 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.688 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "8765", 2024-09-16T15:38:49.688 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.688 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.688 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.689 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "cephadm service discovery port", 2024-09-16T15:38:49.689 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.689 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.689 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.689 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.689 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-16T15:38:49.689 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-16T15:38:49.689 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.689 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-16T15:38:49.689 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.689 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-16T15:38:49.689 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.689 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.689 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.689 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.689 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.690 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.690 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.690 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.690 INFO:teuthology.orchestra.run.smithi098.stdout: "ssh_config_file": { 2024-09-16T15:38:49.690 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "ssh_config_file", 2024-09-16T15:38:49.690 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.690 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.690 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.690 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.690 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.690 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.690 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.690 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-16T15:38:49.690 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.690 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.690 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.691 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.691 INFO:teuthology.orchestra.run.smithi098.stdout: "ssh_keepalive_count_max": { 2024-09-16T15:38:49.691 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "ssh_keepalive_count_max", 2024-09-16T15:38:49.691 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.691 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.691 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.691 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "3", 2024-09-16T15:38:49.691 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.691 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.691 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.691 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-16T15:38:49.691 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.691 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.691 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.691 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.691 INFO:teuthology.orchestra.run.smithi098.stdout: "ssh_keepalive_interval": { 2024-09-16T15:38:49.692 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "ssh_keepalive_interval", 2024-09-16T15:38:49.692 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.692 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.692 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.692 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "7", 2024-09-16T15:38:49.692 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.692 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.692 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.692 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-16T15:38:49.692 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.692 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.692 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.692 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.692 INFO:teuthology.orchestra.run.smithi098.stdout: "use_agent": { 2024-09-16T15:38:49.692 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "use_agent", 2024-09-16T15:38:49.693 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.693 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.693 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.693 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.693 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.693 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.693 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.693 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-16T15:38:49.693 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.693 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.693 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.693 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.693 INFO:teuthology.orchestra.run.smithi098.stdout: "use_repo_digest": { 2024-09-16T15:38:49.693 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "use_repo_digest", 2024-09-16T15:38:49.693 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.693 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.694 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.694 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-16T15:38:49.694 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.694 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.694 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.694 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-16T15:38:49.694 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.694 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.694 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.694 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.694 INFO:teuthology.orchestra.run.smithi098.stdout: "warn_on_failed_host_check": { 2024-09-16T15:38:49.694 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "warn_on_failed_host_check", 2024-09-16T15:38:49.694 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.694 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.694 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.695 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-16T15:38:49.695 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.695 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.695 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.695 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "raise a health warning if the host check fails", 2024-09-16T15:38:49.695 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.695 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.695 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.695 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.695 INFO:teuthology.orchestra.run.smithi098.stdout: "warn_on_stray_daemons": { 2024-09-16T15:38:49.695 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "warn_on_stray_daemons", 2024-09-16T15:38:49.695 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.695 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.695 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.695 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-16T15:38:49.695 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.696 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.696 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.696 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-16T15:38:49.696 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.696 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.696 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.696 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.696 INFO:teuthology.orchestra.run.smithi098.stdout: "warn_on_stray_hosts": { 2024-09-16T15:38:49.696 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "warn_on_stray_hosts", 2024-09-16T15:38:49.696 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.696 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.696 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.696 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-16T15:38:49.696 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.696 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.697 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.697 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-16T15:38:49.697 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.697 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.697 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.697 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.697 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.697 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.697 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:49.697 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "crash", 2024-09-16T15:38:49.697 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-16T15:38:49.697 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-16T15:38:49.697 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-16T15:38:49.697 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-16T15:38:49.697 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-16T15:38:49.697 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.698 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.698 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.698 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.698 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.698 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.698 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.698 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.698 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.698 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.698 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.698 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.698 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.698 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.698 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.698 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.699 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.699 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.699 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.699 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-16T15:38:49.699 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-16T15:38:49.699 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.699 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.699 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.699 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.699 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.699 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.699 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.699 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.699 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.699 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.699 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.700 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.700 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-16T15:38:49.700 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-16T15:38:49.700 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.700 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.700 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.700 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-16T15:38:49.700 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.700 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.700 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.700 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.700 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.700 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.700 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.700 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.700 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.701 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.701 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.701 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.701 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.701 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.701 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.701 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-16T15:38:49.701 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-16T15:38:49.701 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.701 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.701 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.701 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.701 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.701 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.701 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.701 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.702 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.702 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.702 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.702 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.702 INFO:teuthology.orchestra.run.smithi098.stdout: "retain_interval": { 2024-09-16T15:38:49.702 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "retain_interval", 2024-09-16T15:38:49.702 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-16T15:38:49.702 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.702 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.702 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "31536000", 2024-09-16T15:38:49.702 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.702 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.702 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.702 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-16T15:38:49.702 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.702 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.703 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.703 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.703 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-16T15:38:49.703 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-16T15:38:49.703 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.703 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-16T15:38:49.703 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.703 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-16T15:38:49.703 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.703 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.703 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.703 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.703 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.703 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.703 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.704 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.704 INFO:teuthology.orchestra.run.smithi098.stdout: "warn_recent_interval": { 2024-09-16T15:38:49.704 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "warn_recent_interval", 2024-09-16T15:38:49.704 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-16T15:38:49.704 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.704 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.704 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "1209600", 2024-09-16T15:38:49.704 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.704 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.704 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.704 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-16T15:38:49.704 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.704 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.704 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.704 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.704 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.705 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.705 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:49.705 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "dashboard", 2024-09-16T15:38:49.705 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-16T15:38:49.705 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-16T15:38:49.705 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-16T15:38:49.705 INFO:teuthology.orchestra.run.smithi098.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-16T15:38:49.705 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-16T15:38:49.705 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.705 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.705 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.705 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "10", 2024-09-16T15:38:49.705 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.705 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.706 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.706 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.706 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.706 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.706 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.706 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.706 INFO:teuthology.orchestra.run.smithi098.stdout: "ALERTMANAGER_API_HOST": { 2024-09-16T15:38:49.706 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-16T15:38:49.706 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.706 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.706 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.706 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.706 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.706 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.706 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.706 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.707 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.707 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.707 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.707 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.707 INFO:teuthology.orchestra.run.smithi098.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-16T15:38:49.707 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-16T15:38:49.707 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.707 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.707 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.707 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-16T15:38:49.707 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.707 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.707 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.707 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.707 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.708 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.708 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.708 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.708 INFO:teuthology.orchestra.run.smithi098.stdout: "AUDIT_API_ENABLED": { 2024-09-16T15:38:49.708 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "AUDIT_API_ENABLED", 2024-09-16T15:38:49.708 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.708 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.708 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.708 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.708 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.708 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.708 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.708 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.708 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.708 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.709 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.709 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.709 INFO:teuthology.orchestra.run.smithi098.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-16T15:38:49.709 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-16T15:38:49.709 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.709 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.709 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.709 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-16T15:38:49.709 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.709 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.709 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.709 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.709 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.709 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.710 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.710 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.710 INFO:teuthology.orchestra.run.smithi098.stdout: "ENABLE_BROWSABLE_API": { 2024-09-16T15:38:49.710 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-16T15:38:49.710 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.710 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.710 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.710 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-16T15:38:49.710 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.710 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.710 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.710 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.710 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.710 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.710 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.711 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.711 INFO:teuthology.orchestra.run.smithi098.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-16T15:38:49.711 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-16T15:38:49.711 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.711 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.711 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.711 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-16T15:38:49.711 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.711 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.711 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.711 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.711 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.711 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.711 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.711 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.711 INFO:teuthology.orchestra.run.smithi098.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-16T15:38:49.712 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-16T15:38:49.712 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.712 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.712 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.712 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-16T15:38:49.712 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.712 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.712 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.712 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.712 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.712 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.712 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.712 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.712 INFO:teuthology.orchestra.run.smithi098.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-16T15:38:49.713 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-16T15:38:49.713 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.713 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.713 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.713 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-16T15:38:49.713 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.713 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.713 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.713 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.713 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.713 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.713 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.713 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.713 INFO:teuthology.orchestra.run.smithi098.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-16T15:38:49.713 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-16T15:38:49.714 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.714 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.714 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.714 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-16T15:38:49.714 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.714 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.714 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.714 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.714 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.714 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.714 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.714 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.714 INFO:teuthology.orchestra.run.smithi098.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-16T15:38:49.714 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-16T15:38:49.714 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.714 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.715 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.715 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-16T15:38:49.715 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.715 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.715 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.715 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.715 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.715 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.715 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.715 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.715 INFO:teuthology.orchestra.run.smithi098.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-16T15:38:49.715 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-16T15:38:49.715 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.715 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.716 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.716 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-16T15:38:49.716 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.716 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.716 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.716 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.716 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.716 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.716 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.716 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.716 INFO:teuthology.orchestra.run.smithi098.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-16T15:38:49.716 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-16T15:38:49.716 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.716 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.716 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.717 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-16T15:38:49.717 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.717 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.717 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.717 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.717 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.717 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.717 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.717 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.717 INFO:teuthology.orchestra.run.smithi098.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-16T15:38:49.717 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-16T15:38:49.717 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.717 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.717 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.718 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.718 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.718 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.718 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.718 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.718 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.718 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.718 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.718 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.718 INFO:teuthology.orchestra.run.smithi098.stdout: "GRAFANA_API_PASSWORD": { 2024-09-16T15:38:49.718 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-16T15:38:49.718 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.718 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.718 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.718 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "admin", 2024-09-16T15:38:49.719 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.719 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.719 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.719 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.719 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.719 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.719 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.719 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.719 INFO:teuthology.orchestra.run.smithi098.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-16T15:38:49.719 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-16T15:38:49.719 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.719 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.719 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.719 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-16T15:38:49.720 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.720 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.720 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.720 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.720 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.720 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.720 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.720 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.720 INFO:teuthology.orchestra.run.smithi098.stdout: "GRAFANA_API_URL": { 2024-09-16T15:38:49.720 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "GRAFANA_API_URL", 2024-09-16T15:38:49.720 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.720 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.720 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.720 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.720 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.720 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.721 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.721 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.721 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.721 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.721 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.721 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.721 INFO:teuthology.orchestra.run.smithi098.stdout: "GRAFANA_API_USERNAME": { 2024-09-16T15:38:49.721 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-16T15:38:49.721 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.721 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.721 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.721 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "admin", 2024-09-16T15:38:49.721 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.721 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.721 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.722 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.722 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.722 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.722 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.722 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.722 INFO:teuthology.orchestra.run.smithi098.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-16T15:38:49.722 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-16T15:38:49.722 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.722 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.722 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.722 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.722 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.722 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.722 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.722 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.723 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.723 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.723 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.723 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.723 INFO:teuthology.orchestra.run.smithi098.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-16T15:38:49.723 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-16T15:38:49.723 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.723 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.723 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.723 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.723 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.723 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.723 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.723 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.723 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.723 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.724 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.724 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.724 INFO:teuthology.orchestra.run.smithi098.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-16T15:38:49.724 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-16T15:38:49.724 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.724 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.724 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.724 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-16T15:38:49.724 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.724 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.724 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.724 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.724 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.724 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.725 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.725 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.725 INFO:teuthology.orchestra.run.smithi098.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-16T15:38:49.725 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-16T15:38:49.725 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.725 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.725 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.725 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.725 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.725 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.725 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.725 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.725 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.725 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.725 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.726 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.726 INFO:teuthology.orchestra.run.smithi098.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-16T15:38:49.726 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-16T15:38:49.726 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.726 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.726 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.726 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "[]", 2024-09-16T15:38:49.726 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.726 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.726 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.726 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.726 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.726 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.726 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.726 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.727 INFO:teuthology.orchestra.run.smithi098.stdout: "MULTICLUSTER_CONFIG": { 2024-09-16T15:38:49.727 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-16T15:38:49.727 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.727 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.727 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.727 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "{}", 2024-09-16T15:38:49.727 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.727 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.727 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.727 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.727 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.727 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.727 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.727 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.728 INFO:teuthology.orchestra.run.smithi098.stdout: "PROMETHEUS_API_HOST": { 2024-09-16T15:38:49.728 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-16T15:38:49.728 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.728 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.728 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.728 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.728 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.728 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.728 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.728 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.728 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.728 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.728 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.729 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.729 INFO:teuthology.orchestra.run.smithi098.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-16T15:38:49.729 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-16T15:38:49.729 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.729 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.729 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.729 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-16T15:38:49.729 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.729 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.729 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.729 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.729 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.729 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.729 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.729 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.730 INFO:teuthology.orchestra.run.smithi098.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-16T15:38:49.730 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-16T15:38:49.730 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.730 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.730 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.730 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.730 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.730 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.730 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.730 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.730 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.730 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.730 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.730 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.730 INFO:teuthology.orchestra.run.smithi098.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-16T15:38:49.730 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-16T15:38:49.731 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.731 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.731 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.731 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.731 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.731 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.731 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.731 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.731 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.731 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.731 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.731 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.731 INFO:teuthology.orchestra.run.smithi098.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-16T15:38:49.731 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-16T15:38:49.731 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.731 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.732 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.732 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-16T15:38:49.732 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.732 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.732 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.732 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.732 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.732 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.732 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.732 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.732 INFO:teuthology.orchestra.run.smithi098.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-16T15:38:49.732 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-16T15:38:49.732 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.733 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.733 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.733 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-16T15:38:49.733 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.733 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.733 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.733 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.733 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.733 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.733 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.733 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.733 INFO:teuthology.orchestra.run.smithi098.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-16T15:38:49.733 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-16T15:38:49.733 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.733 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.733 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.734 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.734 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.734 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.734 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.734 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.734 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.734 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.734 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.734 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.734 INFO:teuthology.orchestra.run.smithi098.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-16T15:38:49.734 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-16T15:38:49.734 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.734 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.734 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.734 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.735 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.735 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.735 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.735 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.735 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.735 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.735 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.735 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.735 INFO:teuthology.orchestra.run.smithi098.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-16T15:38:49.735 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-16T15:38:49.735 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.735 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.735 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.735 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.735 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.735 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.736 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.736 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.736 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.736 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.736 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.736 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.736 INFO:teuthology.orchestra.run.smithi098.stdout: "PWD_POLICY_ENABLED": { 2024-09-16T15:38:49.736 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-16T15:38:49.736 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.736 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.736 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.736 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-16T15:38:49.736 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.736 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.736 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.737 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.737 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.737 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.737 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.737 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.737 INFO:teuthology.orchestra.run.smithi098.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-16T15:38:49.737 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-16T15:38:49.737 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.737 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.737 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.737 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-16T15:38:49.737 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.737 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.737 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.738 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.738 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.738 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.738 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.738 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.738 INFO:teuthology.orchestra.run.smithi098.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-16T15:38:49.738 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-16T15:38:49.738 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.738 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.738 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.738 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "10", 2024-09-16T15:38:49.738 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.738 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.739 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.739 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.739 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.739 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.739 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.739 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.739 INFO:teuthology.orchestra.run.smithi098.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-16T15:38:49.739 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-16T15:38:49.739 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.739 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.739 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.739 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "8", 2024-09-16T15:38:49.739 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.739 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.740 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.740 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.740 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.740 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.740 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.740 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.740 INFO:teuthology.orchestra.run.smithi098.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-16T15:38:49.740 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-16T15:38:49.740 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.740 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.740 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.740 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "45", 2024-09-16T15:38:49.740 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.740 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.740 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.741 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.741 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.741 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.741 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.741 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.741 INFO:teuthology.orchestra.run.smithi098.stdout: "RGW_API_ACCESS_KEY": { 2024-09-16T15:38:49.741 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-16T15:38:49.741 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.741 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.741 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.741 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.741 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.741 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.741 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.741 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.741 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.742 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.742 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.742 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.742 INFO:teuthology.orchestra.run.smithi098.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-16T15:38:49.742 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-16T15:38:49.742 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.742 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.742 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.742 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "admin", 2024-09-16T15:38:49.742 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.742 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.742 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.742 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.742 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.742 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.742 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.743 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.743 INFO:teuthology.orchestra.run.smithi098.stdout: "RGW_API_SECRET_KEY": { 2024-09-16T15:38:49.743 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-16T15:38:49.743 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.743 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.743 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.743 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.743 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.743 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.743 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.743 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.743 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.743 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.743 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.743 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.743 INFO:teuthology.orchestra.run.smithi098.stdout: "RGW_API_SSL_VERIFY": { 2024-09-16T15:38:49.744 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-16T15:38:49.744 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.744 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.744 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.744 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-16T15:38:49.744 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.744 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.744 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.744 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.744 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.744 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.744 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.744 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.744 INFO:teuthology.orchestra.run.smithi098.stdout: "UNSAFE_TLS_v1_2": { 2024-09-16T15:38:49.744 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-16T15:38:49.745 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.745 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.745 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.745 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.745 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.745 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.745 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.745 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.745 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.745 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.745 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.745 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.745 INFO:teuthology.orchestra.run.smithi098.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-16T15:38:49.745 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-16T15:38:49.745 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.746 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.746 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.746 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-16T15:38:49.746 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.746 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.746 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.746 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.746 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.746 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.746 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.746 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.746 INFO:teuthology.orchestra.run.smithi098.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-16T15:38:49.746 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-16T15:38:49.746 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.746 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.746 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.747 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "10", 2024-09-16T15:38:49.747 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.747 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.747 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.747 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.747 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.747 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.747 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.747 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.747 INFO:teuthology.orchestra.run.smithi098.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-16T15:38:49.747 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-16T15:38:49.747 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.747 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.747 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.748 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "5", 2024-09-16T15:38:49.748 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.748 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.748 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.748 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.748 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.748 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.748 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.748 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.748 INFO:teuthology.orchestra.run.smithi098.stdout: "cross_origin_url": { 2024-09-16T15:38:49.748 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "cross_origin_url", 2024-09-16T15:38:49.748 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.748 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.748 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.749 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.749 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.749 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.749 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.749 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.749 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.749 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.749 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.749 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.749 INFO:teuthology.orchestra.run.smithi098.stdout: "crt_file": { 2024-09-16T15:38:49.749 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "crt_file", 2024-09-16T15:38:49.749 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.749 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.749 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.749 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.749 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.750 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.750 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.750 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.750 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.750 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.750 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.750 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.750 INFO:teuthology.orchestra.run.smithi098.stdout: "debug": { 2024-09-16T15:38:49.750 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "debug", 2024-09-16T15:38:49.750 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.750 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.750 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.750 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.750 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.750 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.751 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.751 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Enable/disable debug options", 2024-09-16T15:38:49.751 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.751 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.751 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.751 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.751 INFO:teuthology.orchestra.run.smithi098.stdout: "jwt_token_ttl": { 2024-09-16T15:38:49.751 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "jwt_token_ttl", 2024-09-16T15:38:49.751 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.751 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.751 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.751 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "28800", 2024-09-16T15:38:49.751 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.751 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.752 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.752 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.752 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.752 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.752 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.752 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.752 INFO:teuthology.orchestra.run.smithi098.stdout: "key_file": { 2024-09-16T15:38:49.752 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "key_file", 2024-09-16T15:38:49.752 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.752 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.752 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.752 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.752 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.752 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.752 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.753 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.753 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.753 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.753 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.753 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.753 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-16T15:38:49.753 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-16T15:38:49.753 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.753 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.753 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.753 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.753 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.753 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.753 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.753 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.754 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.754 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.754 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.754 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.754 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.754 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.754 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.754 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.754 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.754 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.754 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.754 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-16T15:38:49.754 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-16T15:38:49.754 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.754 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.755 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.755 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.755 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.755 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.755 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.755 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.755 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.755 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.755 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.755 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.755 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-16T15:38:49.755 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-16T15:38:49.755 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.755 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.755 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.755 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-16T15:38:49.756 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.756 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.756 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.756 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.756 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.756 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.756 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.756 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.756 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.756 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.756 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.756 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.756 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.756 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.757 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.757 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-16T15:38:49.757 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-16T15:38:49.757 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.757 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.757 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.757 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.757 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.757 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.757 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.757 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.757 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.757 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.758 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.758 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.758 INFO:teuthology.orchestra.run.smithi098.stdout: "motd": { 2024-09-16T15:38:49.758 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "motd", 2024-09-16T15:38:49.758 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.758 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.758 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.758 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.758 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.758 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.758 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.758 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "The message of the day", 2024-09-16T15:38:49.758 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.758 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.759 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.759 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.759 INFO:teuthology.orchestra.run.smithi098.stdout: "redirect_resolve_ip_addr": { 2024-09-16T15:38:49.759 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "redirect_resolve_ip_addr", 2024-09-16T15:38:49.759 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.759 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.759 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.759 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.759 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.759 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.759 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.759 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.759 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.759 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.759 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.759 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.760 INFO:teuthology.orchestra.run.smithi098.stdout: "server_addr": { 2024-09-16T15:38:49.760 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "server_addr", 2024-09-16T15:38:49.760 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.760 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.760 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.760 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "::", 2024-09-16T15:38:49.760 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.760 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.760 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.760 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.760 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.760 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.760 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.760 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.760 INFO:teuthology.orchestra.run.smithi098.stdout: "server_port": { 2024-09-16T15:38:49.761 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "server_port", 2024-09-16T15:38:49.761 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.761 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.761 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.761 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "8080", 2024-09-16T15:38:49.761 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.761 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.761 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.761 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.761 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.761 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.761 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.761 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.761 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-16T15:38:49.761 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-16T15:38:49.761 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.762 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-16T15:38:49.762 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.762 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-16T15:38:49.762 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.762 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.762 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.762 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.762 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.762 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.762 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.762 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.762 INFO:teuthology.orchestra.run.smithi098.stdout: "ssl": { 2024-09-16T15:38:49.762 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "ssl", 2024-09-16T15:38:49.762 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.762 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.762 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.763 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-16T15:38:49.763 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.763 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.763 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.763 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.763 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.763 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.763 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.763 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.763 INFO:teuthology.orchestra.run.smithi098.stdout: "ssl_server_port": { 2024-09-16T15:38:49.763 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "ssl_server_port", 2024-09-16T15:38:49.763 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.763 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.763 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.763 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "8443", 2024-09-16T15:38:49.763 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.764 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.764 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.764 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.764 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.764 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.764 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.764 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.764 INFO:teuthology.orchestra.run.smithi098.stdout: "standby_behaviour": { 2024-09-16T15:38:49.764 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "standby_behaviour", 2024-09-16T15:38:49.764 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.764 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.764 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.764 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "redirect", 2024-09-16T15:38:49.764 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.764 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.764 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.765 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.765 INFO:teuthology.orchestra.run.smithi098.stdout: "redirect" 2024-09-16T15:38:49.765 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.765 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.765 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.765 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.765 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.765 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.765 INFO:teuthology.orchestra.run.smithi098.stdout: "standby_error_status_code": { 2024-09-16T15:38:49.765 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "standby_error_status_code", 2024-09-16T15:38:49.765 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.765 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.765 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.765 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "500", 2024-09-16T15:38:49.766 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "400", 2024-09-16T15:38:49.766 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "599", 2024-09-16T15:38:49.766 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.766 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.766 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.766 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.766 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.766 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.766 INFO:teuthology.orchestra.run.smithi098.stdout: "url_prefix": { 2024-09-16T15:38:49.766 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "url_prefix", 2024-09-16T15:38:49.766 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.766 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.766 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.766 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.766 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.766 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.767 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.767 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.767 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.767 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.767 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.767 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.767 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.767 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.767 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:49.767 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "devicehealth", 2024-09-16T15:38:49.767 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-16T15:38:49.767 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-16T15:38:49.767 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-16T15:38:49.767 INFO:teuthology.orchestra.run.smithi098.stdout: "enable_monitoring": { 2024-09-16T15:38:49.767 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "enable_monitoring", 2024-09-16T15:38:49.768 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.768 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.768 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.768 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-16T15:38:49.768 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.768 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.768 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.768 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "monitor device health metrics", 2024-09-16T15:38:49.768 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.768 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.768 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.768 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.768 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-16T15:38:49.769 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-16T15:38:49.769 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.769 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.769 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.769 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.769 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.769 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.769 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.769 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.769 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.769 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.769 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.769 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.769 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.769 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.769 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.770 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.770 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.770 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.770 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.770 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-16T15:38:49.770 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-16T15:38:49.770 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.770 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.770 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.770 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.770 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.770 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.770 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.770 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.770 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.771 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.771 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.771 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.771 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-16T15:38:49.771 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-16T15:38:49.771 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.771 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.771 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.771 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-16T15:38:49.771 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.771 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.771 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.771 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.771 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.771 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.772 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.772 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.772 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.772 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.772 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.772 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.772 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.772 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.772 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.772 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-16T15:38:49.772 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-16T15:38:49.772 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.772 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.772 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.772 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.773 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.773 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.773 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.773 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.773 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.773 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.773 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.773 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.773 INFO:teuthology.orchestra.run.smithi098.stdout: "mark_out_threshold": { 2024-09-16T15:38:49.773 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "mark_out_threshold", 2024-09-16T15:38:49.773 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-16T15:38:49.773 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.773 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.773 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "2419200", 2024-09-16T15:38:49.773 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.774 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.774 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.774 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-16T15:38:49.774 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.774 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.774 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.774 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.774 INFO:teuthology.orchestra.run.smithi098.stdout: "pool_name": { 2024-09-16T15:38:49.774 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "pool_name", 2024-09-16T15:38:49.774 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.774 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.774 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.774 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "device_health_metrics", 2024-09-16T15:38:49.774 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.774 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.775 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.775 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-16T15:38:49.775 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.775 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.775 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.775 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.775 INFO:teuthology.orchestra.run.smithi098.stdout: "retention_period": { 2024-09-16T15:38:49.775 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "retention_period", 2024-09-16T15:38:49.775 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-16T15:38:49.775 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.775 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.775 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "15552000", 2024-09-16T15:38:49.775 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.775 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.775 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.776 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "how long to retain device health metrics", 2024-09-16T15:38:49.776 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.776 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.776 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.776 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.776 INFO:teuthology.orchestra.run.smithi098.stdout: "scrape_frequency": { 2024-09-16T15:38:49.776 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "scrape_frequency", 2024-09-16T15:38:49.776 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-16T15:38:49.776 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.776 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.776 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "86400", 2024-09-16T15:38:49.776 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.776 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.776 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.777 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-16T15:38:49.777 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.777 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.777 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.777 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.777 INFO:teuthology.orchestra.run.smithi098.stdout: "self_heal": { 2024-09-16T15:38:49.777 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "self_heal", 2024-09-16T15:38:49.777 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.777 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.777 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.777 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-16T15:38:49.777 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.777 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.778 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.778 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-16T15:38:49.778 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.778 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.778 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.778 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.778 INFO:teuthology.orchestra.run.smithi098.stdout: "sleep_interval": { 2024-09-16T15:38:49.778 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sleep_interval", 2024-09-16T15:38:49.778 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-16T15:38:49.778 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.778 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.778 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "600", 2024-09-16T15:38:49.778 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.778 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.778 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.779 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "how frequently to wake up and check device health", 2024-09-16T15:38:49.779 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.779 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.779 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.779 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.779 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-16T15:38:49.779 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-16T15:38:49.779 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.779 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-16T15:38:49.779 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.779 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-16T15:38:49.779 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.779 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.779 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.779 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.780 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.780 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.780 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.780 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.780 INFO:teuthology.orchestra.run.smithi098.stdout: "warn_threshold": { 2024-09-16T15:38:49.780 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "warn_threshold", 2024-09-16T15:38:49.780 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-16T15:38:49.780 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.780 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.780 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "7257600", 2024-09-16T15:38:49.780 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.780 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.780 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.781 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-16T15:38:49.781 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.781 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.781 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.781 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.781 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.781 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.781 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:49.781 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "diskprediction_local", 2024-09-16T15:38:49.781 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-16T15:38:49.781 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-16T15:38:49.781 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-16T15:38:49.781 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-16T15:38:49.781 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-16T15:38:49.781 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.781 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.782 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.782 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.782 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.782 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.782 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.782 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.782 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.782 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.782 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.782 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.782 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.782 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.782 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.782 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.783 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.783 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.783 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.783 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-16T15:38:49.783 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-16T15:38:49.783 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.783 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.783 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.783 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.783 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.783 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.783 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.783 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.783 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.784 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.784 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.784 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.784 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-16T15:38:49.784 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-16T15:38:49.784 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.784 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.784 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.784 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-16T15:38:49.784 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.784 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.784 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.784 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.784 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.784 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.785 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.785 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.785 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.785 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.785 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.785 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.785 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.785 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.785 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.785 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-16T15:38:49.785 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-16T15:38:49.785 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.785 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.786 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.786 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.786 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.786 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.786 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.786 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.786 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.786 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.786 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.786 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.786 INFO:teuthology.orchestra.run.smithi098.stdout: "predict_interval": { 2024-09-16T15:38:49.786 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "predict_interval", 2024-09-16T15:38:49.786 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.786 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.786 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.787 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "86400", 2024-09-16T15:38:49.787 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.787 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.787 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.787 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.787 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.787 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.787 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.787 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.787 INFO:teuthology.orchestra.run.smithi098.stdout: "predictor_model": { 2024-09-16T15:38:49.787 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "predictor_model", 2024-09-16T15:38:49.787 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.787 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.787 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.788 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "prophetstor", 2024-09-16T15:38:49.788 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.788 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.788 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.788 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.788 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.788 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.788 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.788 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.788 INFO:teuthology.orchestra.run.smithi098.stdout: "sleep_interval": { 2024-09-16T15:38:49.788 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sleep_interval", 2024-09-16T15:38:49.788 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.788 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.789 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.789 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "600", 2024-09-16T15:38:49.789 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.789 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.789 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.789 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.789 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.789 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.789 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.789 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.789 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-16T15:38:49.789 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-16T15:38:49.789 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.789 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-16T15:38:49.790 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.790 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-16T15:38:49.790 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.790 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.790 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.790 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.790 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.790 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.790 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.790 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.790 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.790 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.790 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:49.790 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "influx", 2024-09-16T15:38:49.790 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": false, 2024-09-16T15:38:49.791 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "influxdb python module not found", 2024-09-16T15:38:49.791 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-16T15:38:49.791 INFO:teuthology.orchestra.run.smithi098.stdout: "batch_size": { 2024-09-16T15:38:49.791 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "batch_size", 2024-09-16T15:38:49.791 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.791 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.791 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.791 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "5000", 2024-09-16T15:38:49.791 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.791 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.791 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.791 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-16T15:38:49.791 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.791 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.791 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.792 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.792 INFO:teuthology.orchestra.run.smithi098.stdout: "database": { 2024-09-16T15:38:49.792 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "database", 2024-09-16T15:38:49.792 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.792 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.792 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.792 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "ceph", 2024-09-16T15:38:49.792 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.792 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.792 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.792 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-16T15:38:49.792 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.792 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.792 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.793 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.793 INFO:teuthology.orchestra.run.smithi098.stdout: "hostname": { 2024-09-16T15:38:49.793 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "hostname", 2024-09-16T15:38:49.793 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.793 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.793 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.793 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.793 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.793 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.793 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.793 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "InfluxDB server hostname", 2024-09-16T15:38:49.793 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.793 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.793 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.793 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.794 INFO:teuthology.orchestra.run.smithi098.stdout: "interval": { 2024-09-16T15:38:49.794 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "interval", 2024-09-16T15:38:49.794 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-16T15:38:49.794 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.794 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.794 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "30", 2024-09-16T15:38:49.794 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "5", 2024-09-16T15:38:49.794 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.794 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.794 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-16T15:38:49.794 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.794 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.794 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.794 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.794 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-16T15:38:49.795 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-16T15:38:49.795 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.795 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.795 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.795 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.795 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.795 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.795 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.795 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.795 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.795 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.795 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.795 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.795 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.795 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.795 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.796 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.796 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.796 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.796 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.796 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-16T15:38:49.796 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-16T15:38:49.796 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.796 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.796 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.796 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.796 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.796 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.796 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.796 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.796 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.797 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.797 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.797 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.797 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-16T15:38:49.797 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-16T15:38:49.797 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.797 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.797 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.797 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-16T15:38:49.797 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.797 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.797 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.797 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.797 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.798 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.798 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.798 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.798 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.798 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.798 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.798 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.798 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.798 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.798 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.798 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-16T15:38:49.798 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-16T15:38:49.798 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.798 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.799 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.799 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.799 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.799 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.799 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.799 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.799 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.799 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.799 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.799 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.799 INFO:teuthology.orchestra.run.smithi098.stdout: "password": { 2024-09-16T15:38:49.799 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "password", 2024-09-16T15:38:49.799 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.799 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.799 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.799 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.800 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.800 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.800 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.800 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "password of InfluxDB server user", 2024-09-16T15:38:49.800 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.800 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.800 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.800 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.800 INFO:teuthology.orchestra.run.smithi098.stdout: "port": { 2024-09-16T15:38:49.800 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "port", 2024-09-16T15:38:49.800 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.800 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.800 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.800 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "8086", 2024-09-16T15:38:49.800 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.801 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.801 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.801 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "InfluxDB server port", 2024-09-16T15:38:49.801 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.801 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.801 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.801 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.801 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-16T15:38:49.801 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-16T15:38:49.801 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.801 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-16T15:38:49.801 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.801 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-16T15:38:49.801 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.801 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.801 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.802 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.802 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.802 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.802 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.802 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.802 INFO:teuthology.orchestra.run.smithi098.stdout: "ssl": { 2024-09-16T15:38:49.802 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "ssl", 2024-09-16T15:38:49.802 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.802 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.802 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.802 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "false", 2024-09-16T15:38:49.802 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.802 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.802 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.802 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-16T15:38:49.803 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.803 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.803 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.803 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.803 INFO:teuthology.orchestra.run.smithi098.stdout: "threads": { 2024-09-16T15:38:49.803 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "threads", 2024-09-16T15:38:49.803 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.803 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.803 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.803 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "5", 2024-09-16T15:38:49.803 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "1", 2024-09-16T15:38:49.803 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "32", 2024-09-16T15:38:49.803 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.803 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-16T15:38:49.803 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.803 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.804 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.804 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.804 INFO:teuthology.orchestra.run.smithi098.stdout: "username": { 2024-09-16T15:38:49.804 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "username", 2024-09-16T15:38:49.804 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.804 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.804 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.804 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.804 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.804 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.804 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.804 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "username of InfluxDB server user", 2024-09-16T15:38:49.804 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.804 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.804 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.805 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.805 INFO:teuthology.orchestra.run.smithi098.stdout: "verify_ssl": { 2024-09-16T15:38:49.805 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "verify_ssl", 2024-09-16T15:38:49.805 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.805 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.805 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.805 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "true", 2024-09-16T15:38:49.805 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.805 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.805 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.805 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-16T15:38:49.805 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.805 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.805 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.805 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.805 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.806 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.806 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:49.806 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "insights", 2024-09-16T15:38:49.806 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-16T15:38:49.806 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-16T15:38:49.806 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-16T15:38:49.806 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-16T15:38:49.806 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-16T15:38:49.806 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.806 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.806 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.806 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.806 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.806 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.806 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.807 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.807 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.807 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.807 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.807 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.807 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.807 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.807 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.807 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.807 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.807 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.807 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.807 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-16T15:38:49.807 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-16T15:38:49.807 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.807 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.808 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.808 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.808 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.808 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.808 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.808 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.808 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.808 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.808 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.808 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.808 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-16T15:38:49.808 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-16T15:38:49.808 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.808 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.808 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.809 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-16T15:38:49.809 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.809 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.809 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.809 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.809 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.809 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.809 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.809 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.809 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.809 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.809 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.809 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.809 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.810 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.810 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.810 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-16T15:38:49.810 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-16T15:38:49.810 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.810 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.810 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.810 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.810 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.810 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.810 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.810 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.810 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.810 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.811 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.811 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.811 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-16T15:38:49.811 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-16T15:38:49.811 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.811 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-16T15:38:49.811 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.811 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-16T15:38:49.811 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.811 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.811 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.811 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.811 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.811 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.811 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.812 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.812 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.812 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.812 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:49.812 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "iostat", 2024-09-16T15:38:49.812 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-16T15:38:49.812 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-16T15:38:49.812 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-16T15:38:49.812 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-16T15:38:49.812 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-16T15:38:49.812 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.812 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.812 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.812 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.812 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.813 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.813 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.813 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.813 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.813 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.813 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.813 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.813 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.813 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.813 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.813 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.814 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.814 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.814 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.814 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-16T15:38:49.814 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-16T15:38:49.814 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.814 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.814 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.814 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.814 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.814 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.814 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.814 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.814 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.815 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.815 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.815 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.815 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-16T15:38:49.815 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-16T15:38:49.815 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.815 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.815 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.815 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-16T15:38:49.815 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.815 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.815 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.815 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.815 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.816 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.816 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.816 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.816 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.816 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.816 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.816 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.816 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.816 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.816 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.816 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-16T15:38:49.816 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-16T15:38:49.816 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.816 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.817 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.817 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.817 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.817 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.817 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.817 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.817 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.817 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.817 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.817 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.817 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-16T15:38:49.817 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-16T15:38:49.817 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.817 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-16T15:38:49.817 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.818 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-16T15:38:49.818 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.818 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.818 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.818 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.818 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.818 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.818 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.818 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.818 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.818 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.818 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:49.818 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "localpool", 2024-09-16T15:38:49.818 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-16T15:38:49.819 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-16T15:38:49.819 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-16T15:38:49.819 INFO:teuthology.orchestra.run.smithi098.stdout: "failure_domain": { 2024-09-16T15:38:49.819 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "failure_domain", 2024-09-16T15:38:49.819 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.819 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.819 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.819 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "host", 2024-09-16T15:38:49.819 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.819 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.819 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.819 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "failure domain for any created local pool", 2024-09-16T15:38:49.819 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-16T15:38:49.819 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.819 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.820 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.820 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-16T15:38:49.820 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-16T15:38:49.820 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.820 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.820 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.820 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.820 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.820 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.820 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.820 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.820 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.820 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.820 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.820 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.821 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.821 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.821 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.821 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.821 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.821 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.821 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.821 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-16T15:38:49.821 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-16T15:38:49.821 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.821 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.821 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.821 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.821 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.821 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.821 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.822 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.822 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.822 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.822 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.822 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.822 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-16T15:38:49.822 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-16T15:38:49.822 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.822 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.822 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.822 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-16T15:38:49.822 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.822 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.822 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.822 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.823 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.823 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.823 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.823 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.823 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.823 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.823 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.823 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.823 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.823 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.823 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.823 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-16T15:38:49.823 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-16T15:38:49.823 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.823 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.824 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.824 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.824 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.824 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.824 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.824 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.824 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.824 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.824 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.824 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.824 INFO:teuthology.orchestra.run.smithi098.stdout: "min_size": { 2024-09-16T15:38:49.824 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "min_size", 2024-09-16T15:38:49.824 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.824 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.825 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.825 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.825 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.825 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.825 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.825 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "default min_size for any created local pool", 2024-09-16T15:38:49.825 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-16T15:38:49.825 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.825 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.825 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.825 INFO:teuthology.orchestra.run.smithi098.stdout: "num_rep": { 2024-09-16T15:38:49.825 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "num_rep", 2024-09-16T15:38:49.825 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.825 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.826 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.826 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "3", 2024-09-16T15:38:49.826 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.826 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.826 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.826 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "default replica count for any created local pool", 2024-09-16T15:38:49.826 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.826 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.826 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.826 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.826 INFO:teuthology.orchestra.run.smithi098.stdout: "pg_num": { 2024-09-16T15:38:49.826 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "pg_num", 2024-09-16T15:38:49.826 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.826 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.826 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.827 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "128", 2024-09-16T15:38:49.827 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.827 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.827 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.827 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "default pg_num for any created local pool", 2024-09-16T15:38:49.827 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.827 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.827 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.827 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.827 INFO:teuthology.orchestra.run.smithi098.stdout: "prefix": { 2024-09-16T15:38:49.827 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "prefix", 2024-09-16T15:38:49.827 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.827 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.827 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.828 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.828 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.828 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.828 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.828 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "name prefix for any created local pool", 2024-09-16T15:38:49.828 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.828 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.828 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.828 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.828 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-16T15:38:49.828 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-16T15:38:49.828 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.828 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-16T15:38:49.828 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.828 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-16T15:38:49.829 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.829 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.829 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.829 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.829 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.829 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.829 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.829 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.829 INFO:teuthology.orchestra.run.smithi098.stdout: "subtree": { 2024-09-16T15:38:49.829 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "subtree", 2024-09-16T15:38:49.829 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.829 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.829 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.829 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "rack", 2024-09-16T15:38:49.830 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.830 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.830 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.830 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-16T15:38:49.830 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-16T15:38:49.830 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.830 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.830 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.830 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.830 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.830 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:49.830 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "mds_autoscaler", 2024-09-16T15:38:49.830 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-16T15:38:49.831 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-16T15:38:49.831 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-16T15:38:49.831 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-16T15:38:49.831 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-16T15:38:49.831 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.831 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.831 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.831 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.831 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.831 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.831 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.831 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.831 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.831 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.831 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.832 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.832 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.832 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.832 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.832 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.832 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.832 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.832 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.832 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-16T15:38:49.832 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-16T15:38:49.832 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.832 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.832 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.832 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.832 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.832 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.833 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.833 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.833 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.833 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.833 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.833 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.833 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-16T15:38:49.833 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-16T15:38:49.833 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.833 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.833 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.833 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-16T15:38:49.833 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.833 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.833 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.834 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.834 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.834 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.834 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.834 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.834 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.834 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.834 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.834 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.834 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.834 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.834 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.834 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-16T15:38:49.834 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-16T15:38:49.834 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.835 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.835 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.835 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.835 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.835 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.835 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.835 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.835 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.835 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.835 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.835 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.835 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-16T15:38:49.835 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-16T15:38:49.835 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.835 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-16T15:38:49.835 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.836 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-16T15:38:49.836 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.836 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.836 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.836 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.836 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.836 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.836 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.836 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.836 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.836 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.836 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:49.836 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "mirroring", 2024-09-16T15:38:49.836 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-16T15:38:49.836 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-16T15:38:49.837 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-16T15:38:49.837 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-16T15:38:49.837 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-16T15:38:49.837 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.837 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.837 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.837 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.837 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.837 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.837 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.837 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.837 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.837 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.838 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.838 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.838 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.838 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.838 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.838 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.838 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.838 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.838 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.838 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-16T15:38:49.838 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-16T15:38:49.838 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.838 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.839 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.839 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.839 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.839 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.839 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.839 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.839 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.839 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.839 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.839 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.839 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-16T15:38:49.839 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-16T15:38:49.839 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.839 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.839 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.840 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-16T15:38:49.840 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.840 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.840 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.840 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.840 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.840 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.840 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.840 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.840 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.840 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.840 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.840 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.841 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.841 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.841 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.841 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-16T15:38:49.841 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-16T15:38:49.841 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.841 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.841 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.841 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.841 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.841 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.841 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.841 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.841 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.842 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.842 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.842 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.842 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-16T15:38:49.842 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-16T15:38:49.842 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.842 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-16T15:38:49.842 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.842 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-16T15:38:49.842 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.842 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.842 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.842 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.842 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.842 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.843 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.843 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.843 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.843 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.843 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:49.843 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "nfs", 2024-09-16T15:38:49.843 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-16T15:38:49.843 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-16T15:38:49.843 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-16T15:38:49.843 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-16T15:38:49.843 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-16T15:38:49.843 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.843 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.843 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.843 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.843 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.844 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.844 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.844 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.844 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.844 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.844 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.844 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.844 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.844 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.844 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.844 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.844 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.844 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.844 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.844 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-16T15:38:49.845 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-16T15:38:49.845 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.845 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.845 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.845 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.845 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.845 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.845 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.845 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.845 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.845 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.845 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.845 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.845 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-16T15:38:49.846 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-16T15:38:49.846 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.846 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.846 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.846 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-16T15:38:49.846 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.846 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.846 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.846 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.846 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.846 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.846 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.846 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.846 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.847 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.847 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.847 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.847 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.847 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.847 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.847 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-16T15:38:49.847 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-16T15:38:49.847 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.847 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.847 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.847 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.847 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.847 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.847 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.848 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.848 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.848 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.848 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.848 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.848 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-16T15:38:49.848 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-16T15:38:49.848 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.848 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-16T15:38:49.848 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.848 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-16T15:38:49.848 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.848 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.848 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.848 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.849 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.849 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.849 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.849 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.849 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.849 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.849 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:49.849 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "orchestrator", 2024-09-16T15:38:49.849 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-16T15:38:49.849 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-16T15:38:49.849 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-16T15:38:49.849 INFO:teuthology.orchestra.run.smithi098.stdout: "fail_fs": { 2024-09-16T15:38:49.849 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "fail_fs", 2024-09-16T15:38:49.849 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.850 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.850 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.850 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.850 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.850 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.850 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.850 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-16T15:38:49.850 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.850 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.850 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.850 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.850 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-16T15:38:49.850 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-16T15:38:49.850 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.850 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.850 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.851 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.851 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.851 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.851 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.851 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.851 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.851 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.851 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.851 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.851 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.851 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.851 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.851 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.851 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.851 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.851 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.852 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-16T15:38:49.852 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-16T15:38:49.852 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.852 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.852 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.852 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.852 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.852 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.852 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.852 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.852 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.852 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.852 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.852 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.852 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-16T15:38:49.853 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-16T15:38:49.853 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.853 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.853 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.853 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-16T15:38:49.853 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.853 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.853 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.853 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.853 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.853 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.853 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.853 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.853 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.853 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.854 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.854 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.854 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.854 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.854 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.854 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-16T15:38:49.854 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-16T15:38:49.854 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.854 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.854 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.854 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.854 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.854 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.854 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.855 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.855 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.855 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.855 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.855 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.855 INFO:teuthology.orchestra.run.smithi098.stdout: "orchestrator": { 2024-09-16T15:38:49.855 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "orchestrator", 2024-09-16T15:38:49.855 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.855 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.855 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.855 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.855 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.855 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.855 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.855 INFO:teuthology.orchestra.run.smithi098.stdout: "cephadm", 2024-09-16T15:38:49.855 INFO:teuthology.orchestra.run.smithi098.stdout: "rook", 2024-09-16T15:38:49.855 INFO:teuthology.orchestra.run.smithi098.stdout: "test_orchestrator" 2024-09-16T15:38:49.856 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.856 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Orchestrator backend", 2024-09-16T15:38:49.856 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.856 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.856 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.856 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.856 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-16T15:38:49.856 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-16T15:38:49.856 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.856 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-16T15:38:49.856 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.856 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-16T15:38:49.856 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.856 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.856 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.857 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.857 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.857 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.857 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.857 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.857 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.857 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.857 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:49.857 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "osd_perf_query", 2024-09-16T15:38:49.857 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-16T15:38:49.857 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-16T15:38:49.857 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-16T15:38:49.857 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-16T15:38:49.857 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-16T15:38:49.858 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.858 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.858 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.858 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.858 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.858 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.858 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.858 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.858 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.858 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.858 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.858 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.858 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.859 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.859 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.859 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.859 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.859 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.859 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.859 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-16T15:38:49.859 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-16T15:38:49.859 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.859 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.859 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.859 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.859 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.859 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.859 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.860 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.860 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.860 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.860 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.860 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.860 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-16T15:38:49.860 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-16T15:38:49.860 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.860 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.860 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.860 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-16T15:38:49.860 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.860 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.860 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.861 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.861 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.861 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.861 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.861 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.861 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.861 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.861 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.861 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.861 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.861 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.861 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.861 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-16T15:38:49.861 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-16T15:38:49.861 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.862 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.862 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.862 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.862 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.862 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.862 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.862 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.862 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.862 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.862 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.862 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.862 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-16T15:38:49.862 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-16T15:38:49.862 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.862 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-16T15:38:49.863 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.863 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-16T15:38:49.863 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.863 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.863 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.863 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.863 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.863 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.863 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.863 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.863 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.863 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.863 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:49.863 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "osd_support", 2024-09-16T15:38:49.863 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-16T15:38:49.864 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-16T15:38:49.864 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-16T15:38:49.864 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-16T15:38:49.864 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-16T15:38:49.864 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.864 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.864 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.864 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.864 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.864 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.864 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.864 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.864 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.864 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.864 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.865 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.865 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.865 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.865 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.865 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.865 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.865 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.865 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.865 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-16T15:38:49.865 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-16T15:38:49.865 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.865 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.865 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.865 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.865 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.866 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.866 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.866 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.866 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.866 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.866 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.866 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.866 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-16T15:38:49.866 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-16T15:38:49.866 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.866 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.866 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.866 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-16T15:38:49.866 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.866 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.866 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.867 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.867 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.867 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.867 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.867 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.867 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.867 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.867 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.867 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.867 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.867 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.867 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.867 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-16T15:38:49.867 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-16T15:38:49.867 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.868 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.868 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.868 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.868 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.868 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.868 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.868 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.868 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.868 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.868 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.868 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.868 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-16T15:38:49.868 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-16T15:38:49.868 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.868 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-16T15:38:49.869 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.869 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-16T15:38:49.869 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.869 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.869 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.869 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.869 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.869 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.869 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.869 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.869 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.869 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.869 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:49.869 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "pg_autoscaler", 2024-09-16T15:38:49.869 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-16T15:38:49.869 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-16T15:38:49.870 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-16T15:38:49.870 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-16T15:38:49.870 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-16T15:38:49.870 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.870 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.870 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.870 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.870 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.870 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.870 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.870 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.870 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.870 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.870 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.870 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.871 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.871 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.871 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.871 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.871 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.871 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.871 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.871 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-16T15:38:49.871 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-16T15:38:49.871 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.871 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.871 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.871 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.871 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.871 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.871 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.872 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.872 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.872 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.872 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.872 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.872 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-16T15:38:49.872 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-16T15:38:49.872 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.872 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.872 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.872 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-16T15:38:49.872 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.872 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.872 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.872 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.872 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.873 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.873 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.873 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.873 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.873 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.873 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.873 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.873 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.873 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.873 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.873 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-16T15:38:49.873 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-16T15:38:49.873 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.873 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.873 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.873 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.874 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.874 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.874 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.874 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.874 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.874 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.874 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.874 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.874 INFO:teuthology.orchestra.run.smithi098.stdout: "sleep_interval": { 2024-09-16T15:38:49.874 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sleep_interval", 2024-09-16T15:38:49.874 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-16T15:38:49.874 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.874 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.874 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "60", 2024-09-16T15:38:49.874 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.874 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.875 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.875 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.875 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.875 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.875 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.875 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.875 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-16T15:38:49.875 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-16T15:38:49.875 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.875 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-16T15:38:49.875 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.875 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-16T15:38:49.875 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.875 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.875 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.875 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.876 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.876 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.876 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.876 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.876 INFO:teuthology.orchestra.run.smithi098.stdout: "threshold": { 2024-09-16T15:38:49.876 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "threshold", 2024-09-16T15:38:49.876 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "float", 2024-09-16T15:38:49.876 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.876 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.876 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "3.0", 2024-09-16T15:38:49.876 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "1.0", 2024-09-16T15:38:49.876 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.876 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.876 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "scaling threshold", 2024-09-16T15:38:49.876 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-16T15:38:49.877 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.877 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.877 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.877 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.877 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.877 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:49.877 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "progress", 2024-09-16T15:38:49.877 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-16T15:38:49.877 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-16T15:38:49.877 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-16T15:38:49.877 INFO:teuthology.orchestra.run.smithi098.stdout: "allow_pg_recovery_event": { 2024-09-16T15:38:49.877 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "allow_pg_recovery_event", 2024-09-16T15:38:49.877 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.877 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.878 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.878 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.878 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.878 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.878 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.878 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-16T15:38:49.878 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.878 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.878 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.878 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.878 INFO:teuthology.orchestra.run.smithi098.stdout: "enabled": { 2024-09-16T15:38:49.878 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "enabled", 2024-09-16T15:38:49.878 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.878 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.878 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.879 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-16T15:38:49.879 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.879 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.879 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.879 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.879 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.879 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.879 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.879 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.879 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-16T15:38:49.879 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-16T15:38:49.879 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.879 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.879 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.879 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.879 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.880 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.880 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.880 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.880 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.880 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.880 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.880 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.880 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.880 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.880 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.880 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.880 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.880 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.880 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.880 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-16T15:38:49.881 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-16T15:38:49.881 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.881 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.881 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.881 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.881 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.881 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.881 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.881 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.881 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.881 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.881 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.881 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.881 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-16T15:38:49.881 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-16T15:38:49.881 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.882 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.882 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.882 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-16T15:38:49.882 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.882 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.882 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.882 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.882 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.882 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.882 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.882 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.882 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.882 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.882 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.882 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.882 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.883 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.883 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.883 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-16T15:38:49.883 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-16T15:38:49.883 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.883 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.883 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.883 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.883 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.883 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.883 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.883 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.883 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.883 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.883 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.883 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.884 INFO:teuthology.orchestra.run.smithi098.stdout: "max_completed_events": { 2024-09-16T15:38:49.884 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "max_completed_events", 2024-09-16T15:38:49.884 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.884 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.884 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.884 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "50", 2024-09-16T15:38:49.884 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.884 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.884 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.884 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "number of past completed events to remember", 2024-09-16T15:38:49.884 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.884 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.884 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.884 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.884 INFO:teuthology.orchestra.run.smithi098.stdout: "sleep_interval": { 2024-09-16T15:38:49.885 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sleep_interval", 2024-09-16T15:38:49.885 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-16T15:38:49.885 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.885 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.885 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "5", 2024-09-16T15:38:49.885 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.885 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.885 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.885 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "how long the module is going to sleep", 2024-09-16T15:38:49.885 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.885 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.885 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.885 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.885 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-16T15:38:49.885 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-16T15:38:49.886 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.886 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-16T15:38:49.886 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.886 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-16T15:38:49.886 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.886 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.886 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.886 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.886 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.886 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.886 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.886 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.886 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.886 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.886 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:49.887 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "prometheus", 2024-09-16T15:38:49.887 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-16T15:38:49.887 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-16T15:38:49.887 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-16T15:38:49.887 INFO:teuthology.orchestra.run.smithi098.stdout: "cache": { 2024-09-16T15:38:49.887 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "cache", 2024-09-16T15:38:49.887 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.887 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.887 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.887 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-16T15:38:49.887 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.887 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.887 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.887 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.887 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.888 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.888 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.888 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.888 INFO:teuthology.orchestra.run.smithi098.stdout: "exclude_perf_counters": { 2024-09-16T15:38:49.888 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "exclude_perf_counters", 2024-09-16T15:38:49.888 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.888 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.888 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.888 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-16T15:38:49.888 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.888 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.888 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.888 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-16T15:38:49.889 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-16T15:38:49.889 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.889 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.889 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.889 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-16T15:38:49.889 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-16T15:38:49.889 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.889 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.889 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.889 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.889 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.889 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.889 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.889 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.889 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.890 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.890 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.890 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.890 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.890 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.890 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.890 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.890 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.890 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.890 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.890 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-16T15:38:49.890 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-16T15:38:49.890 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.890 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.890 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.891 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.891 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.891 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.891 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.891 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.891 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.891 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.891 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.891 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.891 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-16T15:38:49.891 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-16T15:38:49.891 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.891 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.892 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.892 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-16T15:38:49.892 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.892 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.892 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.892 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.892 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.892 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.892 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.892 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.892 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.892 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.892 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.892 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.893 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.893 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.893 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.893 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-16T15:38:49.893 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-16T15:38:49.893 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.893 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.893 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.893 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.893 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.893 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.893 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.893 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.893 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.894 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.894 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.894 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.894 INFO:teuthology.orchestra.run.smithi098.stdout: "rbd_stats_pools": { 2024-09-16T15:38:49.894 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rbd_stats_pools", 2024-09-16T15:38:49.894 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.894 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.894 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.894 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.894 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.894 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.894 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.894 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.894 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.894 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.894 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.895 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.895 INFO:teuthology.orchestra.run.smithi098.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-16T15:38:49.895 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-16T15:38:49.895 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.895 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.895 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.895 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "300", 2024-09-16T15:38:49.895 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.895 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.895 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.895 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.895 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.895 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.895 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.895 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.895 INFO:teuthology.orchestra.run.smithi098.stdout: "scrape_interval": { 2024-09-16T15:38:49.896 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "scrape_interval", 2024-09-16T15:38:49.896 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "float", 2024-09-16T15:38:49.896 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.896 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.896 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "15.0", 2024-09-16T15:38:49.896 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.896 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.896 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.896 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.896 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.896 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.896 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.896 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.896 INFO:teuthology.orchestra.run.smithi098.stdout: "server_addr": { 2024-09-16T15:38:49.896 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "server_addr", 2024-09-16T15:38:49.896 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.897 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.897 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.897 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "::", 2024-09-16T15:38:49.897 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.897 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.897 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.897 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-16T15:38:49.897 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.897 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.897 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.897 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.897 INFO:teuthology.orchestra.run.smithi098.stdout: "server_port": { 2024-09-16T15:38:49.897 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "server_port", 2024-09-16T15:38:49.897 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.898 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.898 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.898 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "9283", 2024-09-16T15:38:49.898 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.898 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.898 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.898 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-16T15:38:49.898 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.898 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.898 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.898 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.898 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-16T15:38:49.898 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-16T15:38:49.898 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.898 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-16T15:38:49.898 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.899 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-16T15:38:49.899 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.899 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.899 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.899 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.899 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.899 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.899 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.899 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.899 INFO:teuthology.orchestra.run.smithi098.stdout: "stale_cache_strategy": { 2024-09-16T15:38:49.899 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "stale_cache_strategy", 2024-09-16T15:38:49.899 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.899 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.899 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.899 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "log", 2024-09-16T15:38:49.900 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.900 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.900 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.900 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.900 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.900 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.900 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.900 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.900 INFO:teuthology.orchestra.run.smithi098.stdout: "standby_behaviour": { 2024-09-16T15:38:49.900 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "standby_behaviour", 2024-09-16T15:38:49.900 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.900 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.900 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.900 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "default", 2024-09-16T15:38:49.900 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.900 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.901 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.901 INFO:teuthology.orchestra.run.smithi098.stdout: "default", 2024-09-16T15:38:49.901 INFO:teuthology.orchestra.run.smithi098.stdout: "error" 2024-09-16T15:38:49.901 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.901 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.901 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.901 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.901 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.901 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.901 INFO:teuthology.orchestra.run.smithi098.stdout: "standby_error_status_code": { 2024-09-16T15:38:49.901 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "standby_error_status_code", 2024-09-16T15:38:49.901 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.901 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.901 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.901 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "500", 2024-09-16T15:38:49.902 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "400", 2024-09-16T15:38:49.902 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "599", 2024-09-16T15:38:49.902 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.902 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.902 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.902 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.902 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.902 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.902 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.902 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.902 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:49.902 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rbd_support", 2024-09-16T15:38:49.902 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-16T15:38:49.902 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-16T15:38:49.903 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-16T15:38:49.903 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-16T15:38:49.903 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-16T15:38:49.903 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.903 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.903 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.903 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.903 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.903 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.903 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.903 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.903 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.903 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.903 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.903 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.904 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.904 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.904 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.904 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.904 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.904 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.904 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.904 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-16T15:38:49.904 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-16T15:38:49.904 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.904 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.904 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.904 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.904 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.905 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.905 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.905 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.905 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.905 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.905 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.905 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.905 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-16T15:38:49.905 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-16T15:38:49.905 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.905 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.905 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.905 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-16T15:38:49.905 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.905 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.906 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.906 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.906 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.906 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.906 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.906 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.906 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.906 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.906 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.906 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.906 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.906 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.906 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.906 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-16T15:38:49.907 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-16T15:38:49.907 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.907 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.907 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.907 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.907 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.907 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.907 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.907 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.907 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.907 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.907 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.907 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.907 INFO:teuthology.orchestra.run.smithi098.stdout: "max_concurrent_snap_create": { 2024-09-16T15:38:49.908 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "max_concurrent_snap_create", 2024-09-16T15:38:49.908 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.908 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.908 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.908 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "10", 2024-09-16T15:38:49.908 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.908 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.908 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.908 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.908 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.908 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.908 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.908 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.908 INFO:teuthology.orchestra.run.smithi098.stdout: "mirror_snapshot_schedule": { 2024-09-16T15:38:49.908 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "mirror_snapshot_schedule", 2024-09-16T15:38:49.909 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.909 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.909 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.909 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.909 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.909 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.909 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.909 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.909 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.909 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.909 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.909 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.909 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-16T15:38:49.909 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-16T15:38:49.909 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.910 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-16T15:38:49.910 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.910 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-16T15:38:49.910 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.910 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.910 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.910 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.910 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.910 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.910 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.910 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.910 INFO:teuthology.orchestra.run.smithi098.stdout: "trash_purge_schedule": { 2024-09-16T15:38:49.910 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "trash_purge_schedule", 2024-09-16T15:38:49.910 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.910 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.910 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.911 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.911 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.911 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.911 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.911 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.911 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.911 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.911 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.911 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.911 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.911 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.911 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:49.911 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "restful", 2024-09-16T15:38:49.911 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-16T15:38:49.911 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-16T15:38:49.911 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-16T15:38:49.912 INFO:teuthology.orchestra.run.smithi098.stdout: "enable_auth": { 2024-09-16T15:38:49.912 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "enable_auth", 2024-09-16T15:38:49.912 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.912 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.912 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.912 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-16T15:38:49.912 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.912 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.912 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.912 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.912 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.912 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.912 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.912 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.912 INFO:teuthology.orchestra.run.smithi098.stdout: "key_file": { 2024-09-16T15:38:49.913 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "key_file", 2024-09-16T15:38:49.913 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.913 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.913 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.913 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.913 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.913 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.913 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.913 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.913 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.913 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.913 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.913 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.913 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-16T15:38:49.913 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-16T15:38:49.913 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.914 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.914 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.914 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.914 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.914 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.914 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.914 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.914 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.914 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.914 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.914 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.914 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.914 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.914 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.915 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.915 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.915 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.915 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.915 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-16T15:38:49.915 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-16T15:38:49.915 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.915 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.915 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.915 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.915 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.915 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.915 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.915 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.915 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.916 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.916 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.916 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.916 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-16T15:38:49.916 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-16T15:38:49.916 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.916 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.916 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.916 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-16T15:38:49.916 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.916 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.916 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.916 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.916 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.917 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.917 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.917 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.917 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.917 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.917 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.917 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.917 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.917 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.917 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.917 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-16T15:38:49.917 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-16T15:38:49.917 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.917 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.917 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.918 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.918 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.918 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.918 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.918 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.918 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.918 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.918 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.918 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.918 INFO:teuthology.orchestra.run.smithi098.stdout: "max_requests": { 2024-09-16T15:38:49.918 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "max_requests", 2024-09-16T15:38:49.918 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.918 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.918 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.918 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "500", 2024-09-16T15:38:49.919 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.919 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.919 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.919 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-16T15:38:49.919 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.919 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.919 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.919 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.919 INFO:teuthology.orchestra.run.smithi098.stdout: "server_addr": { 2024-09-16T15:38:49.919 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "server_addr", 2024-09-16T15:38:49.920 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.920 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.920 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.920 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.920 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.920 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.920 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.920 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.920 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.920 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.920 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.920 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.921 INFO:teuthology.orchestra.run.smithi098.stdout: "server_port": { 2024-09-16T15:38:49.921 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "server_port", 2024-09-16T15:38:49.921 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.921 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.921 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.921 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.921 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.921 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.921 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.921 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.921 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.921 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.921 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.922 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.922 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-16T15:38:49.922 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-16T15:38:49.922 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.922 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-16T15:38:49.922 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.922 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-16T15:38:49.922 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.922 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.922 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.922 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.922 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.922 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.923 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.923 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.923 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.923 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.923 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:49.923 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rgw", 2024-09-16T15:38:49.923 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-16T15:38:49.923 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-16T15:38:49.923 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-16T15:38:49.923 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-16T15:38:49.923 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-16T15:38:49.923 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.923 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.924 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.924 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.924 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.924 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.924 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.924 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.924 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.924 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.924 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.924 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.924 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.924 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.924 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.924 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.925 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.925 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.925 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.925 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-16T15:38:49.925 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-16T15:38:49.925 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.925 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.925 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.925 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.925 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.925 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.925 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.925 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.926 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.926 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.926 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.926 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.926 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-16T15:38:49.926 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-16T15:38:49.926 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.926 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.926 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.926 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-16T15:38:49.926 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.926 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.926 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.927 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.927 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.927 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.927 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.927 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.927 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.927 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.927 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.927 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.927 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.927 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.927 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.927 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-16T15:38:49.928 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-16T15:38:49.928 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.928 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.928 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.928 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.928 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.928 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.928 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.928 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.928 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.928 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.928 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.928 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.928 INFO:teuthology.orchestra.run.smithi098.stdout: "secondary_zone_period_retry_limit": { 2024-09-16T15:38:49.929 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-16T15:38:49.929 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.929 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.929 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.929 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "5", 2024-09-16T15:38:49.929 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.929 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.929 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.929 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-16T15:38:49.929 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.929 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.929 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.929 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.929 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-16T15:38:49.929 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-16T15:38:49.930 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.930 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-16T15:38:49.930 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.930 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-16T15:38:49.930 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.930 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.930 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.930 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.930 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.930 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.930 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.930 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.930 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.930 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.930 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:49.930 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rook", 2024-09-16T15:38:49.931 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-16T15:38:49.931 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-16T15:38:49.931 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-16T15:38:49.931 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-16T15:38:49.931 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-16T15:38:49.931 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.931 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.931 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.931 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.931 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.931 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.931 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.931 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.931 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.931 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.932 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.932 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.932 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.932 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.932 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.932 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.932 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.932 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.932 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.932 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-16T15:38:49.932 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-16T15:38:49.932 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.932 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.932 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.932 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.932 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.933 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.933 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.933 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.933 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.933 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.933 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.933 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.933 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-16T15:38:49.933 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-16T15:38:49.933 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.933 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.933 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.933 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-16T15:38:49.933 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.933 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.934 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.934 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.934 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.934 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.934 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.934 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.934 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.934 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.934 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.934 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.934 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.934 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.934 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.934 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-16T15:38:49.934 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-16T15:38:49.935 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.935 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.935 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.935 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.935 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.935 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.935 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.935 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.935 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.935 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.935 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.935 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.935 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-16T15:38:49.935 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-16T15:38:49.935 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.935 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-16T15:38:49.936 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.936 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-16T15:38:49.936 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.936 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.936 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.936 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.936 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.936 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.936 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.936 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.936 INFO:teuthology.orchestra.run.smithi098.stdout: "storage_class": { 2024-09-16T15:38:49.936 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "storage_class", 2024-09-16T15:38:49.936 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.936 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.936 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.937 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "local", 2024-09-16T15:38:49.937 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.937 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.937 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.937 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-16T15:38:49.937 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.937 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.937 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.937 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.937 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.937 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.937 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:49.937 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "selftest", 2024-09-16T15:38:49.937 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-16T15:38:49.937 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-16T15:38:49.938 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-16T15:38:49.938 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-16T15:38:49.938 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-16T15:38:49.938 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.938 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.938 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.938 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.938 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.938 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.938 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.938 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.938 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.938 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.938 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.939 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.939 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.939 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.939 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.939 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.939 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.939 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.939 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.939 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-16T15:38:49.939 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-16T15:38:49.939 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.939 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.939 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.939 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.939 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.939 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.940 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.940 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.940 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.940 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.940 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.940 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.940 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-16T15:38:49.940 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-16T15:38:49.940 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.940 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.940 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.940 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-16T15:38:49.940 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.940 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.940 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.941 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.941 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.941 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.941 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.941 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.941 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.941 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.941 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.941 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.941 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.941 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.941 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.941 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-16T15:38:49.941 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-16T15:38:49.941 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.941 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.942 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.942 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.942 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.942 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.942 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.942 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.942 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.942 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.942 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.942 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.942 INFO:teuthology.orchestra.run.smithi098.stdout: "roption1": { 2024-09-16T15:38:49.942 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "roption1", 2024-09-16T15:38:49.942 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.942 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.942 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.943 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.943 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.943 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.943 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.943 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.943 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.943 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.943 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.943 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.943 INFO:teuthology.orchestra.run.smithi098.stdout: "roption2": { 2024-09-16T15:38:49.943 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "roption2", 2024-09-16T15:38:49.943 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.943 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.943 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.944 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "xyz", 2024-09-16T15:38:49.944 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.944 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.944 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.944 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.944 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.944 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.944 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.944 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.944 INFO:teuthology.orchestra.run.smithi098.stdout: "rwoption1": { 2024-09-16T15:38:49.944 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rwoption1", 2024-09-16T15:38:49.944 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.944 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.944 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.944 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.945 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.945 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.945 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.945 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.945 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.945 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.945 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.945 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.945 INFO:teuthology.orchestra.run.smithi098.stdout: "rwoption2": { 2024-09-16T15:38:49.945 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rwoption2", 2024-09-16T15:38:49.945 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.945 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.945 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.945 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.946 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.946 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.946 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.946 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.946 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.946 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.946 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.946 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.946 INFO:teuthology.orchestra.run.smithi098.stdout: "rwoption3": { 2024-09-16T15:38:49.946 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rwoption3", 2024-09-16T15:38:49.946 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "float", 2024-09-16T15:38:49.946 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.946 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.946 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.946 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.947 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.947 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.947 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.947 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.947 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.947 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.947 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.947 INFO:teuthology.orchestra.run.smithi098.stdout: "rwoption4": { 2024-09-16T15:38:49.947 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rwoption4", 2024-09-16T15:38:49.947 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.947 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.947 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.947 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.947 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.947 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.948 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.948 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.948 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.948 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.948 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.948 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.948 INFO:teuthology.orchestra.run.smithi098.stdout: "rwoption5": { 2024-09-16T15:38:49.948 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rwoption5", 2024-09-16T15:38:49.948 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.948 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.948 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.948 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.948 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.949 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.949 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.949 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.949 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.949 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.949 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.949 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.949 INFO:teuthology.orchestra.run.smithi098.stdout: "rwoption6": { 2024-09-16T15:38:49.949 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rwoption6", 2024-09-16T15:38:49.949 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.949 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.949 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.949 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-16T15:38:49.949 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.949 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.949 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.950 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.950 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.950 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.950 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.950 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.950 INFO:teuthology.orchestra.run.smithi098.stdout: "rwoption7": { 2024-09-16T15:38:49.950 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rwoption7", 2024-09-16T15:38:49.950 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.950 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.950 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.950 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.950 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "1", 2024-09-16T15:38:49.950 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "42", 2024-09-16T15:38:49.950 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.950 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.951 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.951 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.951 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.951 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.951 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-16T15:38:49.951 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-16T15:38:49.951 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.951 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-16T15:38:49.951 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.951 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-16T15:38:49.951 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.951 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.951 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.951 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.951 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.951 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.952 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.952 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.952 INFO:teuthology.orchestra.run.smithi098.stdout: "testkey": { 2024-09-16T15:38:49.952 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "testkey", 2024-09-16T15:38:49.952 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.952 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.952 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.952 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.952 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.952 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.952 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.952 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.952 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.952 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.952 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.953 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.953 INFO:teuthology.orchestra.run.smithi098.stdout: "testlkey": { 2024-09-16T15:38:49.953 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "testlkey", 2024-09-16T15:38:49.953 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.953 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.953 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.953 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.953 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.953 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.953 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.953 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.953 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.953 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.953 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.953 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.953 INFO:teuthology.orchestra.run.smithi098.stdout: "testnewline": { 2024-09-16T15:38:49.954 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "testnewline", 2024-09-16T15:38:49.954 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.954 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.954 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.954 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.954 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.954 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.954 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.954 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.954 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.954 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.954 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.954 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.954 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.954 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.955 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:49.955 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "smb", 2024-09-16T15:38:49.955 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-16T15:38:49.955 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-16T15:38:49.955 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-16T15:38:49.955 INFO:teuthology.orchestra.run.smithi098.stdout: "internal_store_backend": { 2024-09-16T15:38:49.955 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "internal_store_backend", 2024-09-16T15:38:49.955 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.955 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-16T15:38:49.955 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.955 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.955 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.955 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.955 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.956 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-16T15:38:49.956 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.956 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.956 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.956 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.956 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-16T15:38:49.956 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-16T15:38:49.956 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.956 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.956 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.956 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.956 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.956 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.956 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.956 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.957 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.957 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.957 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.957 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.957 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.957 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.957 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.957 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.957 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.957 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.957 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.957 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-16T15:38:49.957 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-16T15:38:49.957 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.958 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.958 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.958 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.958 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.958 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.958 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.958 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.958 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.958 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.958 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.958 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.958 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-16T15:38:49.958 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-16T15:38:49.959 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.959 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.959 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.959 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-16T15:38:49.959 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.959 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.959 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.959 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.959 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.959 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.959 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.959 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.959 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.959 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.959 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.960 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.960 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.960 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.960 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.960 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-16T15:38:49.960 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-16T15:38:49.960 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.960 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.960 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.960 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.960 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.960 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.960 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.960 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.960 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.961 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.961 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.961 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.961 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-16T15:38:49.961 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-16T15:38:49.961 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.961 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-16T15:38:49.961 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.961 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-16T15:38:49.961 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.961 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.961 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.961 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.961 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.961 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.962 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.962 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.962 INFO:teuthology.orchestra.run.smithi098.stdout: "update_orchestration": { 2024-09-16T15:38:49.962 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "update_orchestration", 2024-09-16T15:38:49.962 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.962 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.962 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.962 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-16T15:38:49.962 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.962 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.962 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.962 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-16T15:38:49.962 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.962 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.962 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.963 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.963 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.963 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.963 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:49.963 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "snap_schedule", 2024-09-16T15:38:49.963 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-16T15:38:49.963 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-16T15:38:49.963 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-16T15:38:49.963 INFO:teuthology.orchestra.run.smithi098.stdout: "allow_m_granularity": { 2024-09-16T15:38:49.963 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "allow_m_granularity", 2024-09-16T15:38:49.963 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.963 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.963 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.963 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.963 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.964 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.964 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.964 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "allow minute scheduled snapshots", 2024-09-16T15:38:49.964 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.964 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.964 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.964 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.964 INFO:teuthology.orchestra.run.smithi098.stdout: "dump_on_update": { 2024-09-16T15:38:49.964 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "dump_on_update", 2024-09-16T15:38:49.964 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.964 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.964 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.964 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.964 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.965 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.965 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.965 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "dump database to debug log on update", 2024-09-16T15:38:49.965 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.965 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.965 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.965 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.965 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-16T15:38:49.965 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-16T15:38:49.965 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.965 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.965 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.965 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.965 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.965 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.966 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.966 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.966 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.966 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.966 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.966 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.966 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.966 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.966 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.966 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.966 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.966 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.966 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.966 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-16T15:38:49.966 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-16T15:38:49.967 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.967 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.967 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.967 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.967 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.967 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.967 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.967 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.967 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.967 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.967 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.967 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.967 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-16T15:38:49.967 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-16T15:38:49.968 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.968 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.968 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.968 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-16T15:38:49.968 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.968 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.968 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.968 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.968 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.968 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.968 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.968 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.968 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.968 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.969 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.969 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.969 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.969 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.969 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.969 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-16T15:38:49.969 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-16T15:38:49.969 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.969 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.969 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.969 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.969 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.969 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.969 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.969 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.969 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.970 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.970 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.970 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.970 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-16T15:38:49.970 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-16T15:38:49.970 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.970 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-16T15:38:49.970 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.970 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-16T15:38:49.970 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.970 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.970 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.970 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.970 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.970 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.971 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.971 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.971 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.971 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.971 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:49.971 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "stats", 2024-09-16T15:38:49.971 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-16T15:38:49.971 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-16T15:38:49.971 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-16T15:38:49.971 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-16T15:38:49.971 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-16T15:38:49.971 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.971 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.971 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.971 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.971 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.972 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.972 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.972 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.972 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.972 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.972 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.972 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.972 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.972 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.972 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.972 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.972 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.972 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.972 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.972 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-16T15:38:49.972 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-16T15:38:49.973 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.973 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.973 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.973 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.973 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.973 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.973 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.973 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.973 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.973 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.973 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.973 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.973 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-16T15:38:49.973 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-16T15:38:49.974 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.974 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.974 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.974 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-16T15:38:49.974 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.974 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.974 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.974 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.974 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.974 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.974 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.974 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.974 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.974 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.974 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.975 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.975 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.975 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.975 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.975 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-16T15:38:49.975 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-16T15:38:49.975 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.975 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.975 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.975 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.975 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.975 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.975 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.975 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.976 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.976 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.976 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.976 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.976 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-16T15:38:49.976 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-16T15:38:49.976 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.976 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-16T15:38:49.976 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.976 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-16T15:38:49.976 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.976 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.976 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.976 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.977 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.977 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.977 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.977 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.977 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.977 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.977 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:49.977 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "status", 2024-09-16T15:38:49.977 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-16T15:38:49.977 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-16T15:38:49.977 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-16T15:38:49.977 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-16T15:38:49.977 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-16T15:38:49.977 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.978 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.978 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.978 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.978 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.978 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.978 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.978 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.978 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.978 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.978 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.978 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.978 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.978 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.978 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.979 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.979 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.979 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.979 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.979 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-16T15:38:49.979 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-16T15:38:49.979 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.979 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.979 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.979 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.979 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.979 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.979 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.979 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.979 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.979 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.980 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.980 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.980 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-16T15:38:49.980 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-16T15:38:49.980 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.980 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.980 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.980 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-16T15:38:49.980 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.980 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.980 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.980 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.980 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.980 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.980 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.981 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.981 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.981 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.981 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.981 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.981 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.981 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.981 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.981 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-16T15:38:49.981 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-16T15:38:49.981 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.981 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.981 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.981 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.981 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.981 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.982 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.982 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.982 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.982 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.982 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.982 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.982 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-16T15:38:49.982 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-16T15:38:49.982 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.982 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-16T15:38:49.982 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.982 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-16T15:38:49.982 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.982 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.982 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.982 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.983 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.983 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.983 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.983 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.983 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.983 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.983 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:49.983 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "telegraf", 2024-09-16T15:38:49.983 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-16T15:38:49.983 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-16T15:38:49.983 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-16T15:38:49.983 INFO:teuthology.orchestra.run.smithi098.stdout: "address": { 2024-09-16T15:38:49.983 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "address", 2024-09-16T15:38:49.983 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.983 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.983 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.984 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-16T15:38:49.984 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.984 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.984 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.984 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.984 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.984 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.984 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.984 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.984 INFO:teuthology.orchestra.run.smithi098.stdout: "interval": { 2024-09-16T15:38:49.984 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "interval", 2024-09-16T15:38:49.984 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-16T15:38:49.984 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.984 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.984 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "15", 2024-09-16T15:38:49.985 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.985 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.985 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.985 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.985 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.985 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.985 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.985 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.985 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-16T15:38:49.985 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-16T15:38:49.985 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.985 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.985 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.985 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.985 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.986 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.986 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.986 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.986 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.986 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.986 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.986 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.986 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.986 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.986 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.986 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.986 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.986 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.986 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.986 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-16T15:38:49.986 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-16T15:38:49.987 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.987 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.987 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.987 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.987 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.987 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.987 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.987 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.987 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.987 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.987 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.987 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.987 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-16T15:38:49.987 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-16T15:38:49.987 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.988 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.988 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.988 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-16T15:38:49.988 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.988 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.988 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:49.988 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:49.988 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:49.988 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:49.988 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:49.988 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:49.988 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:49.988 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:49.988 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.989 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.989 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.989 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.989 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.989 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-16T15:38:49.989 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-16T15:38:49.989 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.989 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.989 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.989 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.989 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.989 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.989 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.989 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.989 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.989 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.990 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.990 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.990 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-16T15:38:49.990 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-16T15:38:49.990 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:49.990 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-16T15:38:49.990 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:49.990 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-16T15:38:49.990 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.990 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.990 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.990 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.990 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.990 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.990 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.991 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.991 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:49.991 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.991 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:49.991 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "telemetry", 2024-09-16T15:38:49.991 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-16T15:38:49.991 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-16T15:38:49.991 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-16T15:38:49.991 INFO:teuthology.orchestra.run.smithi098.stdout: "channel_basic": { 2024-09-16T15:38:49.991 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "channel_basic", 2024-09-16T15:38:49.991 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.991 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.991 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.991 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-16T15:38:49.991 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.991 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.992 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.992 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-16T15:38:49.992 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.992 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.992 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.992 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.992 INFO:teuthology.orchestra.run.smithi098.stdout: "channel_crash": { 2024-09-16T15:38:49.992 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "channel_crash", 2024-09-16T15:38:49.992 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.992 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.992 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.992 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-16T15:38:49.992 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.992 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.992 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.993 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-16T15:38:49.993 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.993 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.993 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.993 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.993 INFO:teuthology.orchestra.run.smithi098.stdout: "channel_device": { 2024-09-16T15:38:49.993 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "channel_device", 2024-09-16T15:38:49.993 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.993 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.993 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.993 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-16T15:38:49.993 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.993 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.993 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.994 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-16T15:38:49.994 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.994 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.994 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.994 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.994 INFO:teuthology.orchestra.run.smithi098.stdout: "channel_ident": { 2024-09-16T15:38:49.994 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "channel_ident", 2024-09-16T15:38:49.994 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.994 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.994 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.994 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.994 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.994 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.994 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.994 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-16T15:38:49.994 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.995 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.995 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.995 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.995 INFO:teuthology.orchestra.run.smithi098.stdout: "channel_perf": { 2024-09-16T15:38:49.995 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "channel_perf", 2024-09-16T15:38:49.995 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.995 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.995 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.995 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.995 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.995 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.995 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.995 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-16T15:38:49.995 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.995 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.995 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.996 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.996 INFO:teuthology.orchestra.run.smithi098.stdout: "contact": { 2024-09-16T15:38:49.996 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "contact", 2024-09-16T15:38:49.996 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.996 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.996 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.996 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.996 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.996 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.996 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.996 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.996 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.996 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.996 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.996 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.997 INFO:teuthology.orchestra.run.smithi098.stdout: "description": { 2024-09-16T15:38:49.997 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "description", 2024-09-16T15:38:49.997 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.997 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.997 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.997 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:49.997 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.997 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.997 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.997 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.997 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.997 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.997 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.997 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.998 INFO:teuthology.orchestra.run.smithi098.stdout: "device_url": { 2024-09-16T15:38:49.998 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "device_url", 2024-09-16T15:38:49.998 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:49.998 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.998 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.998 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-16T15:38:49.998 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.998 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.998 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.998 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.998 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.998 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.998 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.998 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.998 INFO:teuthology.orchestra.run.smithi098.stdout: "enabled": { 2024-09-16T15:38:49.999 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "enabled", 2024-09-16T15:38:49.999 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:49.999 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:49.999 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:49.999 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:49.999 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:49.999 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:49.999 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:49.999 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:49.999 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:49.999 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:49.999 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:49.999 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:49.999 INFO:teuthology.orchestra.run.smithi098.stdout: "interval": { 2024-09-16T15:38:50.000 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "interval", 2024-09-16T15:38:50.000 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:50.000 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:50.000 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:50.000 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "24", 2024-09-16T15:38:50.000 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "8", 2024-09-16T15:38:50.000 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:50.000 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:50.000 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:50.000 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:50.000 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:50.000 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:50.000 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:50.000 INFO:teuthology.orchestra.run.smithi098.stdout: "last_opt_revision": { 2024-09-16T15:38:50.000 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "last_opt_revision", 2024-09-16T15:38:50.000 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:50.001 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:50.001 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:50.001 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "1", 2024-09-16T15:38:50.001 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:50.001 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:50.001 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:50.001 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:50.001 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:50.001 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:50.001 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:50.001 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:50.001 INFO:teuthology.orchestra.run.smithi098.stdout: "leaderboard": { 2024-09-16T15:38:50.001 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "leaderboard", 2024-09-16T15:38:50.001 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:50.001 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:50.001 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:50.002 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:50.002 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:50.002 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:50.002 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:50.002 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:50.002 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:50.002 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:50.002 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:50.002 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:50.002 INFO:teuthology.orchestra.run.smithi098.stdout: "leaderboard_description": { 2024-09-16T15:38:50.002 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "leaderboard_description", 2024-09-16T15:38:50.002 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:50.002 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:50.002 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:50.002 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:50.003 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:50.003 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:50.003 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:50.003 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:50.003 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:50.003 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:50.003 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:50.003 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:50.003 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-16T15:38:50.003 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-16T15:38:50.003 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:50.003 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:50.003 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:50.003 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:50.003 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:50.003 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:50.004 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:50.004 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:50.004 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:50.004 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:50.004 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:50.004 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:50.004 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:50.004 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:50.004 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:50.004 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:50.004 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:50.004 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:50.004 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:50.004 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-16T15:38:50.004 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-16T15:38:50.005 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:50.005 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:50.005 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:50.005 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:50.005 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:50.005 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:50.005 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:50.005 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:50.005 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:50.005 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:50.005 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:50.005 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:50.005 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-16T15:38:50.005 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-16T15:38:50.005 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:50.005 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:50.006 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:50.006 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-16T15:38:50.006 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:50.006 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:50.006 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:50.006 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:50.006 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:50.006 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:50.006 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:50.006 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:50.006 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:50.006 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:50.006 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:50.006 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:50.006 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:50.006 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:50.007 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:50.007 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-16T15:38:50.007 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-16T15:38:50.007 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:50.007 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:50.007 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:50.007 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:50.007 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:50.007 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:50.007 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:50.007 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:50.007 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:50.007 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:50.007 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:50.008 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:50.008 INFO:teuthology.orchestra.run.smithi098.stdout: "organization": { 2024-09-16T15:38:50.008 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "organization", 2024-09-16T15:38:50.008 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:50.008 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:50.008 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:50.008 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:50.008 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:50.008 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:50.008 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:50.008 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:50.008 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:50.008 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:50.008 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:50.008 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:50.009 INFO:teuthology.orchestra.run.smithi098.stdout: "proxy": { 2024-09-16T15:38:50.009 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "proxy", 2024-09-16T15:38:50.009 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:50.009 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:50.009 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:50.009 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:50.009 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:50.009 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:50.009 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:50.009 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:50.009 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:50.009 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:50.009 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:50.009 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:50.009 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-16T15:38:50.009 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-16T15:38:50.010 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:50.010 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-16T15:38:50.010 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:50.010 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-16T15:38:50.010 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:50.010 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:50.010 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:50.010 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:50.010 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:50.010 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:50.010 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:50.010 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:50.010 INFO:teuthology.orchestra.run.smithi098.stdout: "url": { 2024-09-16T15:38:50.010 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "url", 2024-09-16T15:38:50.010 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:50.010 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:50.011 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:50.011 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-16T15:38:50.011 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:50.011 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:50.011 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:50.011 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:50.011 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:50.011 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:50.011 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:50.011 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:50.011 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:50.011 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:50.011 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:50.011 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "test_orchestrator", 2024-09-16T15:38:50.011 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-16T15:38:50.011 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-16T15:38:50.012 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-16T15:38:50.012 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-16T15:38:50.012 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-16T15:38:50.012 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:50.012 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:50.012 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:50.012 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:50.012 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:50.012 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:50.012 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:50.012 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:50.012 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:50.012 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:50.012 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:50.013 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:50.013 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:50.013 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:50.013 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:50.013 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:50.013 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:50.013 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:50.013 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:50.013 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-16T15:38:50.013 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-16T15:38:50.013 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:50.013 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:50.013 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:50.013 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:50.013 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:50.013 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:50.014 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:50.014 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:50.014 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:50.014 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:50.014 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:50.014 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:50.014 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-16T15:38:50.014 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-16T15:38:50.014 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:50.014 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:50.014 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:50.014 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-16T15:38:50.014 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:50.014 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:50.014 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:50.014 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:50.015 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:50.015 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:50.015 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:50.015 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:50.015 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:50.015 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:50.015 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:50.015 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:50.015 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:50.015 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:50.015 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:50.015 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-16T15:38:50.015 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-16T15:38:50.015 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:50.015 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:50.016 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:50.016 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:50.016 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:50.016 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:50.016 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:50.016 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:50.016 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:50.016 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:50.016 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:50.016 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:50.016 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-16T15:38:50.016 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-16T15:38:50.016 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:50.016 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-16T15:38:50.017 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:50.017 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-16T15:38:50.017 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:50.017 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:50.017 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:50.017 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:50.017 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:50.017 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:50.017 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:50.017 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:50.017 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:50.017 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:50.017 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:50.017 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "volumes", 2024-09-16T15:38:50.017 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-16T15:38:50.018 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-16T15:38:50.018 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-16T15:38:50.018 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-16T15:38:50.018 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-16T15:38:50.018 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:50.018 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:50.018 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:50.018 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:50.018 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:50.018 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:50.018 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:50.018 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:50.018 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:50.018 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:50.019 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:50.019 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:50.019 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:50.019 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:50.019 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:50.019 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:50.019 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:50.019 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:50.019 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:50.019 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-16T15:38:50.019 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-16T15:38:50.019 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:50.019 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:50.019 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:50.019 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:50.020 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:50.020 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:50.020 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:50.020 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:50.020 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:50.020 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:50.020 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:50.020 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:50.020 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-16T15:38:50.020 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-16T15:38:50.020 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:50.020 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:50.020 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:50.020 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-16T15:38:50.020 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:50.021 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:50.021 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:50.021 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:50.021 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:50.021 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:50.021 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:50.021 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:50.021 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:50.021 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:50.021 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:50.021 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:50.021 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:50.021 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:50.021 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:50.022 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-16T15:38:50.022 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-16T15:38:50.022 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:50.022 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:50.022 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:50.022 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:50.022 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:50.022 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:50.022 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:50.022 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:50.022 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:50.022 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:50.022 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:50.023 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:50.023 INFO:teuthology.orchestra.run.smithi098.stdout: "max_concurrent_clones": { 2024-09-16T15:38:50.023 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "max_concurrent_clones", 2024-09-16T15:38:50.023 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:50.023 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:50.023 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:50.023 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "4", 2024-09-16T15:38:50.023 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:50.023 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:50.023 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:50.023 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-16T15:38:50.023 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:50.023 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:50.023 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:50.024 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:50.024 INFO:teuthology.orchestra.run.smithi098.stdout: "periodic_async_work": { 2024-09-16T15:38:50.024 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "periodic_async_work", 2024-09-16T15:38:50.024 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:50.024 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:50.024 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:50.024 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:50.024 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:50.024 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:50.024 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:50.024 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Periodically check for async work", 2024-09-16T15:38:50.024 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:50.025 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:50.025 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:50.025 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:50.025 INFO:teuthology.orchestra.run.smithi098.stdout: "snapshot_clone_delay": { 2024-09-16T15:38:50.025 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "snapshot_clone_delay", 2024-09-16T15:38:50.025 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:50.025 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:50.025 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:50.025 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-16T15:38:50.025 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:50.025 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:50.025 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:50.025 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-16T15:38:50.025 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:50.026 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:50.026 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:50.026 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:50.026 INFO:teuthology.orchestra.run.smithi098.stdout: "snapshot_clone_no_wait": { 2024-09-16T15:38:50.026 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "snapshot_clone_no_wait", 2024-09-16T15:38:50.026 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:50.026 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:50.026 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:50.026 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-16T15:38:50.026 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:50.026 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:50.026 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:50.026 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-16T15:38:50.026 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:50.027 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:50.027 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:50.027 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:50.027 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-16T15:38:50.027 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-16T15:38:50.027 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:50.027 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-16T15:38:50.027 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:50.027 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-16T15:38:50.027 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:50.027 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:50.027 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:50.027 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:50.027 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:50.028 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:50.028 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:50.028 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:50.028 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:50.028 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:50.028 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:50.028 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "zabbix", 2024-09-16T15:38:50.028 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-16T15:38:50.028 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-16T15:38:50.028 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-16T15:38:50.028 INFO:teuthology.orchestra.run.smithi098.stdout: "discovery_interval": { 2024-09-16T15:38:50.028 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "discovery_interval", 2024-09-16T15:38:50.028 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "uint", 2024-09-16T15:38:50.028 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:50.029 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:50.029 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "100", 2024-09-16T15:38:50.029 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:50.029 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:50.029 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:50.029 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:50.029 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:50.029 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:50.029 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:50.029 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:50.029 INFO:teuthology.orchestra.run.smithi098.stdout: "identifier": { 2024-09-16T15:38:50.029 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "identifier", 2024-09-16T15:38:50.029 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:50.029 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:50.030 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:50.030 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:50.030 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:50.030 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:50.030 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:50.030 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:50.030 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:50.030 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:50.030 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:50.030 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:50.030 INFO:teuthology.orchestra.run.smithi098.stdout: "interval": { 2024-09-16T15:38:50.030 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "interval", 2024-09-16T15:38:50.030 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-16T15:38:50.030 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:50.031 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:50.031 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "60", 2024-09-16T15:38:50.031 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:50.031 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:50.031 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:50.031 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:50.031 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:50.031 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:50.031 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:50.031 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:50.031 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-16T15:38:50.031 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-16T15:38:50.031 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:50.031 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:50.031 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:50.032 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:50.032 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:50.032 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:50.032 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:50.032 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:50.032 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:50.032 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:50.032 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:50.032 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:50.032 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:50.032 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:50.032 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:50.032 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:50.032 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:50.032 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:50.032 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:50.033 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-16T15:38:50.033 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-16T15:38:50.033 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:50.033 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:50.033 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:50.033 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:50.033 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:50.033 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:50.033 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:50.033 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:50.033 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:50.033 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:50.033 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:50.033 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:50.033 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-16T15:38:50.034 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-16T15:38:50.034 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:50.034 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:50.034 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:50.034 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-16T15:38:50.034 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:50.034 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:50.034 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-16T15:38:50.034 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-16T15:38:50.034 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-16T15:38:50.034 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-16T15:38:50.034 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-16T15:38:50.034 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-16T15:38:50.035 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-16T15:38:50.035 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:50.035 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:50.035 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:50.035 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:50.035 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:50.035 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:50.035 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-16T15:38:50.035 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-16T15:38:50.035 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-16T15:38:50.035 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:50.035 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:50.035 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-16T15:38:50.035 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:50.035 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:50.036 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:50.036 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:50.036 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:50.036 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:50.036 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:50.036 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:50.036 INFO:teuthology.orchestra.run.smithi098.stdout: "sqlite3_killpoint": { 2024-09-16T15:38:50.036 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sqlite3_killpoint", 2024-09-16T15:38:50.036 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:50.036 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "dev", 2024-09-16T15:38:50.036 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-16T15:38:50.036 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-16T15:38:50.036 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:50.036 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:50.037 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:50.037 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:50.037 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:50.037 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:50.037 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:50.037 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:50.037 INFO:teuthology.orchestra.run.smithi098.stdout: "zabbix_host": { 2024-09-16T15:38:50.037 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "zabbix_host", 2024-09-16T15:38:50.037 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:50.037 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:50.037 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:50.037 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-16T15:38:50.037 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:50.037 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:50.037 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:50.038 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:50.038 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:50.038 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:50.038 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:50.038 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:50.038 INFO:teuthology.orchestra.run.smithi098.stdout: "zabbix_port": { 2024-09-16T15:38:50.038 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "zabbix_port", 2024-09-16T15:38:50.038 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-16T15:38:50.038 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:50.038 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:50.038 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "10051", 2024-09-16T15:38:50.038 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:50.038 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:50.039 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:50.039 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:50.039 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:50.039 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:50.039 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:50.039 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:50.039 INFO:teuthology.orchestra.run.smithi098.stdout: "zabbix_sender": { 2024-09-16T15:38:50.039 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "zabbix_sender", 2024-09-16T15:38:50.039 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-16T15:38:50.039 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-16T15:38:50.039 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-16T15:38:50.039 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-16T15:38:50.039 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-16T15:38:50.039 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-16T15:38:50.039 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-16T15:38:50.040 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-16T15:38:50.040 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-16T15:38:50.040 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-16T15:38:50.040 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-16T15:38:50.040 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:50.040 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:50.040 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:50.040 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:50.040 INFO:teuthology.orchestra.run.smithi098.stdout: "services": {}, 2024-09-16T15:38:50.040 INFO:teuthology.orchestra.run.smithi098.stdout: "always_on_modules": { 2024-09-16T15:38:50.040 INFO:teuthology.orchestra.run.smithi098.stdout: "octopus": [ 2024-09-16T15:38:50.040 INFO:teuthology.orchestra.run.smithi098.stdout: "balancer", 2024-09-16T15:38:50.040 INFO:teuthology.orchestra.run.smithi098.stdout: "crash", 2024-09-16T15:38:50.040 INFO:teuthology.orchestra.run.smithi098.stdout: "devicehealth", 2024-09-16T15:38:50.041 INFO:teuthology.orchestra.run.smithi098.stdout: "orchestrator", 2024-09-16T15:38:50.041 INFO:teuthology.orchestra.run.smithi098.stdout: "pg_autoscaler", 2024-09-16T15:38:50.041 INFO:teuthology.orchestra.run.smithi098.stdout: "progress", 2024-09-16T15:38:50.041 INFO:teuthology.orchestra.run.smithi098.stdout: "rbd_support", 2024-09-16T15:38:50.041 INFO:teuthology.orchestra.run.smithi098.stdout: "status", 2024-09-16T15:38:50.041 INFO:teuthology.orchestra.run.smithi098.stdout: "telemetry", 2024-09-16T15:38:50.041 INFO:teuthology.orchestra.run.smithi098.stdout: "volumes" 2024-09-16T15:38:50.041 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:50.041 INFO:teuthology.orchestra.run.smithi098.stdout: "pacific": [ 2024-09-16T15:38:50.041 INFO:teuthology.orchestra.run.smithi098.stdout: "balancer", 2024-09-16T15:38:50.041 INFO:teuthology.orchestra.run.smithi098.stdout: "crash", 2024-09-16T15:38:50.041 INFO:teuthology.orchestra.run.smithi098.stdout: "devicehealth", 2024-09-16T15:38:50.041 INFO:teuthology.orchestra.run.smithi098.stdout: "orchestrator", 2024-09-16T15:38:50.041 INFO:teuthology.orchestra.run.smithi098.stdout: "pg_autoscaler", 2024-09-16T15:38:50.042 INFO:teuthology.orchestra.run.smithi098.stdout: "progress", 2024-09-16T15:38:50.042 INFO:teuthology.orchestra.run.smithi098.stdout: "rbd_support", 2024-09-16T15:38:50.042 INFO:teuthology.orchestra.run.smithi098.stdout: "status", 2024-09-16T15:38:50.042 INFO:teuthology.orchestra.run.smithi098.stdout: "telemetry", 2024-09-16T15:38:50.042 INFO:teuthology.orchestra.run.smithi098.stdout: "volumes" 2024-09-16T15:38:50.042 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:50.042 INFO:teuthology.orchestra.run.smithi098.stdout: "quincy": [ 2024-09-16T15:38:50.042 INFO:teuthology.orchestra.run.smithi098.stdout: "balancer", 2024-09-16T15:38:50.042 INFO:teuthology.orchestra.run.smithi098.stdout: "crash", 2024-09-16T15:38:50.042 INFO:teuthology.orchestra.run.smithi098.stdout: "devicehealth", 2024-09-16T15:38:50.042 INFO:teuthology.orchestra.run.smithi098.stdout: "orchestrator", 2024-09-16T15:38:50.042 INFO:teuthology.orchestra.run.smithi098.stdout: "pg_autoscaler", 2024-09-16T15:38:50.042 INFO:teuthology.orchestra.run.smithi098.stdout: "progress", 2024-09-16T15:38:50.042 INFO:teuthology.orchestra.run.smithi098.stdout: "rbd_support", 2024-09-16T15:38:50.043 INFO:teuthology.orchestra.run.smithi098.stdout: "status", 2024-09-16T15:38:50.043 INFO:teuthology.orchestra.run.smithi098.stdout: "telemetry", 2024-09-16T15:38:50.043 INFO:teuthology.orchestra.run.smithi098.stdout: "volumes" 2024-09-16T15:38:50.043 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:50.043 INFO:teuthology.orchestra.run.smithi098.stdout: "reef": [ 2024-09-16T15:38:50.043 INFO:teuthology.orchestra.run.smithi098.stdout: "balancer", 2024-09-16T15:38:50.043 INFO:teuthology.orchestra.run.smithi098.stdout: "crash", 2024-09-16T15:38:50.043 INFO:teuthology.orchestra.run.smithi098.stdout: "devicehealth", 2024-09-16T15:38:50.043 INFO:teuthology.orchestra.run.smithi098.stdout: "orchestrator", 2024-09-16T15:38:50.043 INFO:teuthology.orchestra.run.smithi098.stdout: "pg_autoscaler", 2024-09-16T15:38:50.043 INFO:teuthology.orchestra.run.smithi098.stdout: "progress", 2024-09-16T15:38:50.043 INFO:teuthology.orchestra.run.smithi098.stdout: "rbd_support", 2024-09-16T15:38:50.043 INFO:teuthology.orchestra.run.smithi098.stdout: "status", 2024-09-16T15:38:50.043 INFO:teuthology.orchestra.run.smithi098.stdout: "telemetry", 2024-09-16T15:38:50.044 INFO:teuthology.orchestra.run.smithi098.stdout: "volumes" 2024-09-16T15:38:50.044 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-16T15:38:50.044 INFO:teuthology.orchestra.run.smithi098.stdout: "squid": [ 2024-09-16T15:38:50.044 INFO:teuthology.orchestra.run.smithi098.stdout: "balancer", 2024-09-16T15:38:50.044 INFO:teuthology.orchestra.run.smithi098.stdout: "crash", 2024-09-16T15:38:50.044 INFO:teuthology.orchestra.run.smithi098.stdout: "devicehealth", 2024-09-16T15:38:50.044 INFO:teuthology.orchestra.run.smithi098.stdout: "orchestrator", 2024-09-16T15:38:50.044 INFO:teuthology.orchestra.run.smithi098.stdout: "pg_autoscaler", 2024-09-16T15:38:50.044 INFO:teuthology.orchestra.run.smithi098.stdout: "progress", 2024-09-16T15:38:50.044 INFO:teuthology.orchestra.run.smithi098.stdout: "rbd_support", 2024-09-16T15:38:50.044 INFO:teuthology.orchestra.run.smithi098.stdout: "status", 2024-09-16T15:38:50.044 INFO:teuthology.orchestra.run.smithi098.stdout: "telemetry", 2024-09-16T15:38:50.044 INFO:teuthology.orchestra.run.smithi098.stdout: "volumes" 2024-09-16T15:38:50.044 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-16T15:38:50.044 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:50.045 INFO:teuthology.orchestra.run.smithi098.stdout: "last_failure_osd_epoch": 0, 2024-09-16T15:38:50.045 INFO:teuthology.orchestra.run.smithi098.stdout: "active_clients": [ 2024-09-16T15:38:50.045 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:50.045 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "devicehealth", 2024-09-16T15:38:50.045 INFO:teuthology.orchestra.run.smithi098.stdout: "addrvec": [ 2024-09-16T15:38:50.045 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:50.045 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "v2", 2024-09-16T15:38:50.045 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": "172.21.15.135:0", 2024-09-16T15:38:50.045 INFO:teuthology.orchestra.run.smithi098.stdout: "nonce": 2172983147 2024-09-16T15:38:50.045 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:50.045 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-16T15:38:50.045 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:50.045 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:50.045 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "libcephsqlite", 2024-09-16T15:38:50.045 INFO:teuthology.orchestra.run.smithi098.stdout: "addrvec": [ 2024-09-16T15:38:50.045 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:50.046 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "v2", 2024-09-16T15:38:50.046 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": "172.21.15.135:0", 2024-09-16T15:38:50.046 INFO:teuthology.orchestra.run.smithi098.stdout: "nonce": 1362861509 2024-09-16T15:38:50.046 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:50.046 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-16T15:38:50.046 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:50.046 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:50.046 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rbd_support", 2024-09-16T15:38:50.046 INFO:teuthology.orchestra.run.smithi098.stdout: "addrvec": [ 2024-09-16T15:38:50.046 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:50.046 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "v2", 2024-09-16T15:38:50.046 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": "172.21.15.135:0", 2024-09-16T15:38:50.046 INFO:teuthology.orchestra.run.smithi098.stdout: "nonce": 2719932678 2024-09-16T15:38:50.046 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:50.046 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-16T15:38:50.046 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:50.047 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:50.047 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "volumes", 2024-09-16T15:38:50.047 INFO:teuthology.orchestra.run.smithi098.stdout: "addrvec": [ 2024-09-16T15:38:50.047 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:50.047 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "v2", 2024-09-16T15:38:50.047 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": "172.21.15.135:0", 2024-09-16T15:38:50.047 INFO:teuthology.orchestra.run.smithi098.stdout: "nonce": 3241303294 2024-09-16T15:38:50.047 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:50.047 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-16T15:38:50.047 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:50.047 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:50.047 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "volumes", 2024-09-16T15:38:50.047 INFO:teuthology.orchestra.run.smithi098.stdout: "addrvec": [ 2024-09-16T15:38:50.047 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:50.047 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "v2", 2024-09-16T15:38:50.048 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": "172.21.15.135:0", 2024-09-16T15:38:50.048 INFO:teuthology.orchestra.run.smithi098.stdout: "nonce": 784021564 2024-09-16T15:38:50.048 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:50.048 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-16T15:38:50.048 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:50.048 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:50.048 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "volumes", 2024-09-16T15:38:50.048 INFO:teuthology.orchestra.run.smithi098.stdout: "addrvec": [ 2024-09-16T15:38:50.048 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:50.048 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "v2", 2024-09-16T15:38:50.048 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": "172.21.15.135:0", 2024-09-16T15:38:50.048 INFO:teuthology.orchestra.run.smithi098.stdout: "nonce": 3413728403 2024-09-16T15:38:50.048 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:50.048 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-16T15:38:50.048 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-16T15:38:50.049 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:50.049 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "volumes", 2024-09-16T15:38:50.049 INFO:teuthology.orchestra.run.smithi098.stdout: "addrvec": [ 2024-09-16T15:38:50.049 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-16T15:38:50.049 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "v2", 2024-09-16T15:38:50.049 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": "172.21.15.135:0", 2024-09-16T15:38:50.049 INFO:teuthology.orchestra.run.smithi098.stdout: "nonce": 969639918 2024-09-16T15:38:50.049 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:50.049 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-16T15:38:50.049 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-16T15:38:50.049 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-16T15:38:50.049 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-16T15:38:50.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:49.138+0000 7f9fbbebd640 1 -- 172.21.15.98:0/2040856893 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f9f98078a00 msgr2=0x7f9f9807aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:50.051 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:49.138+0000 7f9fbbebd640 1 --2- 172.21.15.98:0/2040856893 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f9f98078a00 0x7f9f9807aec0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9fa4000c00 tx=0x7f9fa4001540 comp rx=0 tx=0).stop 2024-09-16T15:38:50.051 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:49.138+0000 7f9fbbebd640 1 -- 172.21.15.98:0/2040856893 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9fa0003a00 msgr2=0x7f9fb415acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:50.051 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:49.138+0000 7f9fbbebd640 1 --2- 172.21.15.98:0/2040856893 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9fa0003a00 0x7f9fb415acf0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f9fb0034040 tx=0x7f9fb0005870 comp rx=0 tx=0).stop 2024-09-16T15:38:50.051 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:49.139+0000 7f9fbbebd640 1 -- 172.21.15.98:0/2040856893 shutdown_connections 2024-09-16T15:38:50.051 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:49.139+0000 7f9fbbebd640 1 --2- 172.21.15.98:0/2040856893 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f9fb4159340 0x7f9fb415b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:50.051 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:49.139+0000 7f9fbbebd640 1 --2- 172.21.15.98:0/2040856893 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f9f98078a00 0x7f9f9807aec0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:50.051 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:49.139+0000 7f9fbbebd640 1 --2- 172.21.15.98:0/2040856893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9fb41f2e60 0x7f9fb4158e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:50.051 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:49.139+0000 7f9fbbebd640 1 --2- 172.21.15.98:0/2040856893 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9fa0003a00 0x7f9fb415acf0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:50.051 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:49.139+0000 7f9fbbebd640 1 -- 172.21.15.98:0/2040856893 >> 172.21.15.98:0/2040856893 conn(0x7f9fb40b1950 msgr2=0x7f9fb409c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:50.051 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:49.139+0000 7f9fbbebd640 1 -- 172.21.15.98:0/2040856893 shutdown_connections 2024-09-16T15:38:50.051 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:49.139+0000 7f9fbbebd640 1 -- 172.21.15.98:0/2040856893 wait complete. 2024-09-16T15:38:50.108 DEBUG:tasks.check_counter:Getting stats from x 2024-09-16T15:38:50.108 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mgr.x.asok perf dump 2024-09-16T15:38:50.220 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-16T15:38:50.220 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-0": { 2024-09-16T15:38:50.220 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 266, 2024-09-16T15:38:50.220 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 148, 2024-09-16T15:38:50.220 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 2739858, 2024-09-16T15:38:50.220 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 173789, 2024-09-16T15:38:50.220 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 68, 2024-09-16T15:38:50.220 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 15, 2024-09-16T15:38:50.220 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.052210125, 2024-09-16T15:38:50.220 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.004842481, 2024-09-16T15:38:50.220 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.050038226, 2024-09-16T15:38:50.221 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.000024990, 2024-09-16T15:38:50.221 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T15:38:50.221 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 132, 2024-09-16T15:38:50.221 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.009485032, 2024-09-16T15:38:50.221 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000071856 2024-09-16T15:38:50.221 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.221 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-09-16T15:38:50.221 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 141, 2024-09-16T15:38:50.221 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000016624, 2024-09-16T15:38:50.221 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000117 2024-09-16T15:38:50.221 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.221 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 2738976, 2024-09-16T15:38:50.221 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 173280 2024-09-16T15:38:50.221 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.221 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-1": { 2024-09-16T15:38:50.222 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 741, 2024-09-16T15:38:50.222 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 488, 2024-09-16T15:38:50.222 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 3058736, 2024-09-16T15:38:50.222 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 3001656, 2024-09-16T15:38:50.222 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 94, 2024-09-16T15:38:50.222 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 22, 2024-09-16T15:38:50.222 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.104452049, 2024-09-16T15:38:50.222 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.025310001, 2024-09-16T15:38:50.222 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.103421972, 2024-09-16T15:38:50.222 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.000042304, 2024-09-16T15:38:50.222 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T15:38:50.222 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 478, 2024-09-16T15:38:50.222 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.030893037, 2024-09-16T15:38:50.222 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000064629 2024-09-16T15:38:50.222 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.223 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-09-16T15:38:50.223 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 357, 2024-09-16T15:38:50.223 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000040150, 2024-09-16T15:38:50.223 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000112 2024-09-16T15:38:50.223 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.223 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 3058736, 2024-09-16T15:38:50.223 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 3001656 2024-09-16T15:38:50.223 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.223 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-2": { 2024-09-16T15:38:50.223 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 299, 2024-09-16T15:38:50.223 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 170, 2024-09-16T15:38:50.223 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 3031360, 2024-09-16T15:38:50.223 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 2305848, 2024-09-16T15:38:50.223 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 120, 2024-09-16T15:38:50.223 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 20, 2024-09-16T15:38:50.224 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.090216564, 2024-09-16T15:38:50.224 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.005788791, 2024-09-16T15:38:50.224 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.098355688, 2024-09-16T15:38:50.224 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.001798974, 2024-09-16T15:38:50.224 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T15:38:50.224 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 156, 2024-09-16T15:38:50.224 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.026323010, 2024-09-16T15:38:50.224 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000168737 2024-09-16T15:38:50.224 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.224 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-09-16T15:38:50.224 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-16T15:38:50.224 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-16T15:38:50.224 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-16T15:38:50.224 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.224 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 3031360, 2024-09-16T15:38:50.225 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 2305848 2024-09-16T15:38:50.225 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.225 INFO:teuthology.orchestra.run.smithi135.stdout: "cct": { 2024-09-16T15:38:50.225 INFO:teuthology.orchestra.run.smithi135.stdout: "total_workers": 0, 2024-09-16T15:38:50.225 INFO:teuthology.orchestra.run.smithi135.stdout: "unhealthy_workers": 0 2024-09-16T15:38:50.225 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.225 INFO:teuthology.orchestra.run.smithi135.stdout: "client": { 2024-09-16T15:38:50.225 INFO:teuthology.orchestra.run.smithi135.stdout: "reply": { 2024-09-16T15:38:50.225 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-16T15:38:50.225 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-16T15:38:50.225 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-16T15:38:50.225 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.225 INFO:teuthology.orchestra.run.smithi135.stdout: "lat": { 2024-09-16T15:38:50.225 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-16T15:38:50.225 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-16T15:38:50.226 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-16T15:38:50.226 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.226 INFO:teuthology.orchestra.run.smithi135.stdout: "wrlat": { 2024-09-16T15:38:50.226 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-16T15:38:50.226 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-16T15:38:50.226 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-16T15:38:50.226 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.226 INFO:teuthology.orchestra.run.smithi135.stdout: "rdlat": { 2024-09-16T15:38:50.226 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-16T15:38:50.226 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-16T15:38:50.226 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-16T15:38:50.226 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.226 INFO:teuthology.orchestra.run.smithi135.stdout: "fsync": { 2024-09-16T15:38:50.226 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-16T15:38:50.226 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-16T15:38:50.226 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-16T15:38:50.227 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.227 INFO:teuthology.orchestra.run.smithi135.stdout: "mdavg": 0.000000000, 2024-09-16T15:38:50.227 INFO:teuthology.orchestra.run.smithi135.stdout: "mdsqsum": 0, 2024-09-16T15:38:50.227 INFO:teuthology.orchestra.run.smithi135.stdout: "mdops": 0, 2024-09-16T15:38:50.227 INFO:teuthology.orchestra.run.smithi135.stdout: "readavg": 0.000000000, 2024-09-16T15:38:50.227 INFO:teuthology.orchestra.run.smithi135.stdout: "readsqsum": 0, 2024-09-16T15:38:50.227 INFO:teuthology.orchestra.run.smithi135.stdout: "rdops": 0, 2024-09-16T15:38:50.227 INFO:teuthology.orchestra.run.smithi135.stdout: "writeavg": 0.000000000, 2024-09-16T15:38:50.227 INFO:teuthology.orchestra.run.smithi135.stdout: "writesqsum": 0, 2024-09-16T15:38:50.227 INFO:teuthology.orchestra.run.smithi135.stdout: "rdops": 0 2024-09-16T15:38:50.227 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.227 INFO:teuthology.orchestra.run.smithi135.stdout: "client-0x558813e86b40": { 2024-09-16T15:38:50.227 INFO:teuthology.orchestra.run.smithi135.stdout: "reply": { 2024-09-16T15:38:50.227 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 55, 2024-09-16T15:38:50.227 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.064656376, 2024-09-16T15:38:50.228 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.001175570 2024-09-16T15:38:50.228 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.228 INFO:teuthology.orchestra.run.smithi135.stdout: "lat": { 2024-09-16T15:38:50.228 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 55, 2024-09-16T15:38:50.228 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.064656376, 2024-09-16T15:38:50.228 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.001175570 2024-09-16T15:38:50.228 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.228 INFO:teuthology.orchestra.run.smithi135.stdout: "wrlat": { 2024-09-16T15:38:50.228 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-16T15:38:50.228 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-16T15:38:50.228 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-16T15:38:50.228 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.228 INFO:teuthology.orchestra.run.smithi135.stdout: "rdlat": { 2024-09-16T15:38:50.228 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-16T15:38:50.228 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-16T15:38:50.229 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-16T15:38:50.229 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.229 INFO:teuthology.orchestra.run.smithi135.stdout: "fsync": { 2024-09-16T15:38:50.229 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-16T15:38:50.229 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-16T15:38:50.229 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-16T15:38:50.229 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.229 INFO:teuthology.orchestra.run.smithi135.stdout: "mdavg": 0.001175558, 2024-09-16T15:38:50.229 INFO:teuthology.orchestra.run.smithi135.stdout: "mdsqsum": 87684432742806, 2024-09-16T15:38:50.229 INFO:teuthology.orchestra.run.smithi135.stdout: "mdops": 55, 2024-09-16T15:38:50.229 INFO:teuthology.orchestra.run.smithi135.stdout: "readavg": 0.000000000, 2024-09-16T15:38:50.229 INFO:teuthology.orchestra.run.smithi135.stdout: "readsqsum": 0, 2024-09-16T15:38:50.229 INFO:teuthology.orchestra.run.smithi135.stdout: "rdops": 0, 2024-09-16T15:38:50.229 INFO:teuthology.orchestra.run.smithi135.stdout: "writeavg": 0.000000000, 2024-09-16T15:38:50.230 INFO:teuthology.orchestra.run.smithi135.stdout: "writesqsum": 0, 2024-09-16T15:38:50.230 INFO:teuthology.orchestra.run.smithi135.stdout: "rdops": 0 2024-09-16T15:38:50.230 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.230 INFO:teuthology.orchestra.run.smithi135.stdout: "client-0x558813e87220": { 2024-09-16T15:38:50.230 INFO:teuthology.orchestra.run.smithi135.stdout: "reply": { 2024-09-16T15:38:50.230 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 71, 2024-09-16T15:38:50.230 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.088569376, 2024-09-16T15:38:50.230 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.001247456 2024-09-16T15:38:50.230 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.230 INFO:teuthology.orchestra.run.smithi135.stdout: "lat": { 2024-09-16T15:38:50.230 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 71, 2024-09-16T15:38:50.230 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.088569376, 2024-09-16T15:38:50.230 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.001247456 2024-09-16T15:38:50.230 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.230 INFO:teuthology.orchestra.run.smithi135.stdout: "wrlat": { 2024-09-16T15:38:50.230 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 18, 2024-09-16T15:38:50.231 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000365654, 2024-09-16T15:38:50.231 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000020314 2024-09-16T15:38:50.231 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.231 INFO:teuthology.orchestra.run.smithi135.stdout: "rdlat": { 2024-09-16T15:38:50.231 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 18, 2024-09-16T15:38:50.231 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000661800, 2024-09-16T15:38:50.231 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000036766 2024-09-16T15:38:50.231 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.231 INFO:teuthology.orchestra.run.smithi135.stdout: "fsync": { 2024-09-16T15:38:50.231 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 3, 2024-09-16T15:38:50.231 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.012374509, 2024-09-16T15:38:50.231 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.004124836 2024-09-16T15:38:50.231 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.231 INFO:teuthology.orchestra.run.smithi135.stdout: "mdavg": 0.001247441, 2024-09-16T15:38:50.231 INFO:teuthology.orchestra.run.smithi135.stdout: "mdsqsum": 119066452768360, 2024-09-16T15:38:50.231 INFO:teuthology.orchestra.run.smithi135.stdout: "mdops": 71, 2024-09-16T15:38:50.232 INFO:teuthology.orchestra.run.smithi135.stdout: "readavg": 0.000036763, 2024-09-16T15:38:50.232 INFO:teuthology.orchestra.run.smithi135.stdout: "readsqsum": 1778959583, 2024-09-16T15:38:50.232 INFO:teuthology.orchestra.run.smithi135.stdout: "rdops": 18, 2024-09-16T15:38:50.232 INFO:teuthology.orchestra.run.smithi135.stdout: "writeavg": 0.000020311, 2024-09-16T15:38:50.232 INFO:teuthology.orchestra.run.smithi135.stdout: "writesqsum": 1592612457, 2024-09-16T15:38:50.232 INFO:teuthology.orchestra.run.smithi135.stdout: "rdops": 18 2024-09-16T15:38:50.232 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.232 INFO:teuthology.orchestra.run.smithi135.stdout: "client-0x558813e87720": { 2024-09-16T15:38:50.232 INFO:teuthology.orchestra.run.smithi135.stdout: "reply": { 2024-09-16T15:38:50.232 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 20, 2024-09-16T15:38:50.232 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.321637355, 2024-09-16T15:38:50.232 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.016081867 2024-09-16T15:38:50.232 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.232 INFO:teuthology.orchestra.run.smithi135.stdout: "lat": { 2024-09-16T15:38:50.232 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 20, 2024-09-16T15:38:50.233 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.321637355, 2024-09-16T15:38:50.233 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.016081867 2024-09-16T15:38:50.233 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.233 INFO:teuthology.orchestra.run.smithi135.stdout: "wrlat": { 2024-09-16T15:38:50.233 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-16T15:38:50.233 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-16T15:38:50.233 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-16T15:38:50.233 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.233 INFO:teuthology.orchestra.run.smithi135.stdout: "rdlat": { 2024-09-16T15:38:50.233 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-16T15:38:50.233 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-16T15:38:50.233 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-16T15:38:50.233 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.233 INFO:teuthology.orchestra.run.smithi135.stdout: "fsync": { 2024-09-16T15:38:50.233 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-16T15:38:50.233 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-16T15:38:50.234 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-16T15:38:50.234 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.234 INFO:teuthology.orchestra.run.smithi135.stdout: "mdavg": 0.016081864, 2024-09-16T15:38:50.234 INFO:teuthology.orchestra.run.smithi135.stdout: "mdsqsum": 90995295765839296, 2024-09-16T15:38:50.234 INFO:teuthology.orchestra.run.smithi135.stdout: "mdops": 20, 2024-09-16T15:38:50.234 INFO:teuthology.orchestra.run.smithi135.stdout: "readavg": 0.000000000, 2024-09-16T15:38:50.234 INFO:teuthology.orchestra.run.smithi135.stdout: "readsqsum": 0, 2024-09-16T15:38:50.234 INFO:teuthology.orchestra.run.smithi135.stdout: "rdops": 0, 2024-09-16T15:38:50.234 INFO:teuthology.orchestra.run.smithi135.stdout: "writeavg": 0.000000000, 2024-09-16T15:38:50.234 INFO:teuthology.orchestra.run.smithi135.stdout: "writesqsum": 0, 2024-09-16T15:38:50.234 INFO:teuthology.orchestra.run.smithi135.stdout: "rdops": 0 2024-09-16T15:38:50.234 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.234 INFO:teuthology.orchestra.run.smithi135.stdout: "finisher-Mgr": { 2024-09-16T15:38:50.234 INFO:teuthology.orchestra.run.smithi135.stdout: "queue_len": 0, 2024-09-16T15:38:50.234 INFO:teuthology.orchestra.run.smithi135.stdout: "complete_latency": { 2024-09-16T15:38:50.234 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 2, 2024-09-16T15:38:50.235 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.035569107, 2024-09-16T15:38:50.235 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.017784553 2024-09-16T15:38:50.235 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-16T15:38:50.235 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.235 INFO:teuthology.orchestra.run.smithi135.stdout: "finisher-MgrStandby": { 2024-09-16T15:38:50.235 INFO:teuthology.orchestra.run.smithi135.stdout: "queue_len": 0, 2024-09-16T15:38:50.235 INFO:teuthology.orchestra.run.smithi135.stdout: "complete_latency": { 2024-09-16T15:38:50.235 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-16T15:38:50.235 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-16T15:38:50.235 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-16T15:38:50.235 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-16T15:38:50.235 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.235 INFO:teuthology.orchestra.run.smithi135.stdout: "finisher-balancer": { 2024-09-16T15:38:50.235 INFO:teuthology.orchestra.run.smithi135.stdout: "queue_len": 0, 2024-09-16T15:38:50.235 INFO:teuthology.orchestra.run.smithi135.stdout: "complete_latency": { 2024-09-16T15:38:50.235 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-16T15:38:50.236 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-16T15:38:50.236 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-16T15:38:50.236 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-16T15:38:50.236 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.236 INFO:teuthology.orchestra.run.smithi135.stdout: "finisher-cmd_finisher": { 2024-09-16T15:38:50.236 INFO:teuthology.orchestra.run.smithi135.stdout: "queue_len": 0, 2024-09-16T15:38:50.236 INFO:teuthology.orchestra.run.smithi135.stdout: "complete_latency": { 2024-09-16T15:38:50.236 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 13, 2024-09-16T15:38:50.236 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000681260, 2024-09-16T15:38:50.236 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000052404 2024-09-16T15:38:50.236 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-16T15:38:50.236 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.237 INFO:teuthology.orchestra.run.smithi135.stdout: "finisher-crash": { 2024-09-16T15:38:50.237 INFO:teuthology.orchestra.run.smithi135.stdout: "queue_len": 0, 2024-09-16T15:38:50.237 INFO:teuthology.orchestra.run.smithi135.stdout: "complete_latency": { 2024-09-16T15:38:50.237 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-16T15:38:50.237 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-16T15:38:50.237 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-16T15:38:50.237 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-16T15:38:50.237 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.237 INFO:teuthology.orchestra.run.smithi135.stdout: "finisher-devicehealth": { 2024-09-16T15:38:50.237 INFO:teuthology.orchestra.run.smithi135.stdout: "queue_len": 0, 2024-09-16T15:38:50.237 INFO:teuthology.orchestra.run.smithi135.stdout: "complete_latency": { 2024-09-16T15:38:50.237 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-16T15:38:50.237 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-16T15:38:50.237 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-16T15:38:50.238 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-16T15:38:50.238 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.238 INFO:teuthology.orchestra.run.smithi135.stdout: "finisher-iostat": { 2024-09-16T15:38:50.238 INFO:teuthology.orchestra.run.smithi135.stdout: "queue_len": 0, 2024-09-16T15:38:50.238 INFO:teuthology.orchestra.run.smithi135.stdout: "complete_latency": { 2024-09-16T15:38:50.238 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-16T15:38:50.238 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-16T15:38:50.238 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-16T15:38:50.238 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-16T15:38:50.238 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.238 INFO:teuthology.orchestra.run.smithi135.stdout: "finisher-nfs": { 2024-09-16T15:38:50.238 INFO:teuthology.orchestra.run.smithi135.stdout: "queue_len": 0, 2024-09-16T15:38:50.238 INFO:teuthology.orchestra.run.smithi135.stdout: "complete_latency": { 2024-09-16T15:38:50.238 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-16T15:38:50.238 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-16T15:38:50.239 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-16T15:38:50.239 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-16T15:38:50.239 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.239 INFO:teuthology.orchestra.run.smithi135.stdout: "finisher-orchestrator": { 2024-09-16T15:38:50.239 INFO:teuthology.orchestra.run.smithi135.stdout: "queue_len": 0, 2024-09-16T15:38:50.239 INFO:teuthology.orchestra.run.smithi135.stdout: "complete_latency": { 2024-09-16T15:38:50.239 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-16T15:38:50.239 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-16T15:38:50.239 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-16T15:38:50.239 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-16T15:38:50.239 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.239 INFO:teuthology.orchestra.run.smithi135.stdout: "finisher-pg_autoscaler": { 2024-09-16T15:38:50.239 INFO:teuthology.orchestra.run.smithi135.stdout: "queue_len": 0, 2024-09-16T15:38:50.239 INFO:teuthology.orchestra.run.smithi135.stdout: "complete_latency": { 2024-09-16T15:38:50.239 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-16T15:38:50.240 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-16T15:38:50.240 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-16T15:38:50.240 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-16T15:38:50.240 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.240 INFO:teuthology.orchestra.run.smithi135.stdout: "finisher-progress": { 2024-09-16T15:38:50.240 INFO:teuthology.orchestra.run.smithi135.stdout: "queue_len": 0, 2024-09-16T15:38:50.240 INFO:teuthology.orchestra.run.smithi135.stdout: "complete_latency": { 2024-09-16T15:38:50.240 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-16T15:38:50.240 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-16T15:38:50.240 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-16T15:38:50.240 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-16T15:38:50.240 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.240 INFO:teuthology.orchestra.run.smithi135.stdout: "finisher-rbd_support": { 2024-09-16T15:38:50.240 INFO:teuthology.orchestra.run.smithi135.stdout: "queue_len": 0, 2024-09-16T15:38:50.240 INFO:teuthology.orchestra.run.smithi135.stdout: "complete_latency": { 2024-09-16T15:38:50.241 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-16T15:38:50.241 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-16T15:38:50.241 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-16T15:38:50.241 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-16T15:38:50.241 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.241 INFO:teuthology.orchestra.run.smithi135.stdout: "finisher-restful": { 2024-09-16T15:38:50.241 INFO:teuthology.orchestra.run.smithi135.stdout: "queue_len": 0, 2024-09-16T15:38:50.241 INFO:teuthology.orchestra.run.smithi135.stdout: "complete_latency": { 2024-09-16T15:38:50.241 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 13, 2024-09-16T15:38:50.241 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.002747733, 2024-09-16T15:38:50.241 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000211364 2024-09-16T15:38:50.241 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-16T15:38:50.241 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.241 INFO:teuthology.orchestra.run.smithi135.stdout: "finisher-status": { 2024-09-16T15:38:50.241 INFO:teuthology.orchestra.run.smithi135.stdout: "queue_len": 0, 2024-09-16T15:38:50.242 INFO:teuthology.orchestra.run.smithi135.stdout: "complete_latency": { 2024-09-16T15:38:50.242 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-16T15:38:50.242 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-16T15:38:50.242 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-16T15:38:50.242 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-16T15:38:50.242 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.242 INFO:teuthology.orchestra.run.smithi135.stdout: "finisher-telemetry": { 2024-09-16T15:38:50.242 INFO:teuthology.orchestra.run.smithi135.stdout: "queue_len": 0, 2024-09-16T15:38:50.242 INFO:teuthology.orchestra.run.smithi135.stdout: "complete_latency": { 2024-09-16T15:38:50.242 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-16T15:38:50.242 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-16T15:38:50.242 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-16T15:38:50.242 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-16T15:38:50.242 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.242 INFO:teuthology.orchestra.run.smithi135.stdout: "finisher-volumes": { 2024-09-16T15:38:50.242 INFO:teuthology.orchestra.run.smithi135.stdout: "queue_len": 0, 2024-09-16T15:38:50.243 INFO:teuthology.orchestra.run.smithi135.stdout: "complete_latency": { 2024-09-16T15:38:50.243 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 9, 2024-09-16T15:38:50.243 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.145397599, 2024-09-16T15:38:50.243 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.016155288 2024-09-16T15:38:50.243 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-16T15:38:50.243 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.243 INFO:teuthology.orchestra.run.smithi135.stdout: "libcephsqlite_striper": { 2024-09-16T15:38:50.243 INFO:teuthology.orchestra.run.smithi135.stdout: "update_metadata": 5, 2024-09-16T15:38:50.243 INFO:teuthology.orchestra.run.smithi135.stdout: "update_allocated": 2, 2024-09-16T15:38:50.243 INFO:teuthology.orchestra.run.smithi135.stdout: "update_size": 3, 2024-09-16T15:38:50.243 INFO:teuthology.orchestra.run.smithi135.stdout: "update_version": 5, 2024-09-16T15:38:50.243 INFO:teuthology.orchestra.run.smithi135.stdout: "shrink": 0, 2024-09-16T15:38:50.243 INFO:teuthology.orchestra.run.smithi135.stdout: "shrink_bytes": 0, 2024-09-16T15:38:50.243 INFO:teuthology.orchestra.run.smithi135.stdout: "lock": 6, 2024-09-16T15:38:50.243 INFO:teuthology.orchestra.run.smithi135.stdout: "unlock": 6 2024-09-16T15:38:50.243 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.244 INFO:teuthology.orchestra.run.smithi135.stdout: "libcephsqlite_vfs": { 2024-09-16T15:38:50.244 INFO:teuthology.orchestra.run.smithi135.stdout: "op_open": { 2024-09-16T15:38:50.244 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 2, 2024-09-16T15:38:50.244 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.801983883, 2024-09-16T15:38:50.244 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.400991941 2024-09-16T15:38:50.244 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.244 INFO:teuthology.orchestra.run.smithi135.stdout: "op_delete": { 2024-09-16T15:38:50.244 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-16T15:38:50.244 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-16T15:38:50.244 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-16T15:38:50.244 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.244 INFO:teuthology.orchestra.run.smithi135.stdout: "op_access": { 2024-09-16T15:38:50.244 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-16T15:38:50.244 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-16T15:38:50.244 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-16T15:38:50.244 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.245 INFO:teuthology.orchestra.run.smithi135.stdout: "op_fullpathname": { 2024-09-16T15:38:50.245 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 1, 2024-09-16T15:38:50.245 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000999980, 2024-09-16T15:38:50.245 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000999980 2024-09-16T15:38:50.245 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.245 INFO:teuthology.orchestra.run.smithi135.stdout: "op_currenttime": { 2024-09-16T15:38:50.245 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 4, 2024-09-16T15:38:50.245 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-16T15:38:50.245 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-16T15:38:50.245 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.245 INFO:teuthology.orchestra.run.smithi135.stdout: "opf_close": { 2024-09-16T15:38:50.245 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-16T15:38:50.245 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-16T15:38:50.245 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-16T15:38:50.245 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.246 INFO:teuthology.orchestra.run.smithi135.stdout: "opf_read": { 2024-09-16T15:38:50.246 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 10, 2024-09-16T15:38:50.246 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.004999900, 2024-09-16T15:38:50.246 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000499990 2024-09-16T15:38:50.246 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.246 INFO:teuthology.orchestra.run.smithi135.stdout: "opf_write": { 2024-09-16T15:38:50.246 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 53, 2024-09-16T15:38:50.246 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.006999859, 2024-09-16T15:38:50.246 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000132072 2024-09-16T15:38:50.246 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.246 INFO:teuthology.orchestra.run.smithi135.stdout: "opf_truncate": { 2024-09-16T15:38:50.246 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-16T15:38:50.246 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-16T15:38:50.247 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-16T15:38:50.247 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.247 INFO:teuthology.orchestra.run.smithi135.stdout: "opf_sync": { 2024-09-16T15:38:50.247 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 12, 2024-09-16T15:38:50.247 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.049998994, 2024-09-16T15:38:50.247 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.004166582 2024-09-16T15:38:50.247 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.247 INFO:teuthology.orchestra.run.smithi135.stdout: "opf_filesize": { 2024-09-16T15:38:50.247 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 10, 2024-09-16T15:38:50.247 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-16T15:38:50.247 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-16T15:38:50.247 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.247 INFO:teuthology.orchestra.run.smithi135.stdout: "opf_lock": { 2024-09-16T15:38:50.247 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 14, 2024-09-16T15:38:50.247 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.012999739, 2024-09-16T15:38:50.248 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000928552 2024-09-16T15:38:50.248 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.248 INFO:teuthology.orchestra.run.smithi135.stdout: "opf_unlock": { 2024-09-16T15:38:50.248 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 10, 2024-09-16T15:38:50.248 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.010999779, 2024-09-16T15:38:50.248 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.001099977 2024-09-16T15:38:50.248 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.248 INFO:teuthology.orchestra.run.smithi135.stdout: "opf_checkreservedlock": { 2024-09-16T15:38:50.248 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 4, 2024-09-16T15:38:50.248 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-16T15:38:50.248 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-16T15:38:50.248 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.248 INFO:teuthology.orchestra.run.smithi135.stdout: "opf_filecontrol": { 2024-09-16T15:38:50.248 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 16, 2024-09-16T15:38:50.248 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-16T15:38:50.249 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-16T15:38:50.249 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.249 INFO:teuthology.orchestra.run.smithi135.stdout: "opf_sectorsize": { 2024-09-16T15:38:50.249 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-16T15:38:50.249 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-16T15:38:50.249 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-16T15:38:50.249 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.249 INFO:teuthology.orchestra.run.smithi135.stdout: "opf_devicecharacteristics": { 2024-09-16T15:38:50.249 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 17, 2024-09-16T15:38:50.249 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-16T15:38:50.249 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-16T15:38:50.249 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-16T15:38:50.249 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.249 INFO:teuthology.orchestra.run.smithi135.stdout: "mempool": { 2024-09-16T15:38:50.249 INFO:teuthology.orchestra.run.smithi135.stdout: "bloom_filter_bytes": 0, 2024-09-16T15:38:50.249 INFO:teuthology.orchestra.run.smithi135.stdout: "bloom_filter_items": 0, 2024-09-16T15:38:50.250 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_alloc_bytes": 0, 2024-09-16T15:38:50.250 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_alloc_items": 0, 2024-09-16T15:38:50.250 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_data_bytes": 0, 2024-09-16T15:38:50.250 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_data_items": 0, 2024-09-16T15:38:50.250 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-16T15:38:50.250 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_onode_items": 0, 2024-09-16T15:38:50.250 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-16T15:38:50.250 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_meta_items": 0, 2024-09-16T15:38:50.250 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_other_bytes": 0, 2024-09-16T15:38:50.250 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_other_items": 0, 2024-09-16T15:38:50.250 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-16T15:38:50.250 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_buffer_items": 0, 2024-09-16T15:38:50.250 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_extent_bytes": 0, 2024-09-16T15:38:50.250 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_extent_items": 0, 2024-09-16T15:38:50.250 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_blob_bytes": 0, 2024-09-16T15:38:50.250 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_blob_items": 0, 2024-09-16T15:38:50.251 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-16T15:38:50.251 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_shared_blob_items": 0, 2024-09-16T15:38:50.251 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-16T15:38:50.251 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_inline_bl_items": 0, 2024-09-16T15:38:50.251 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_fsck_bytes": 0, 2024-09-16T15:38:50.251 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_fsck_items": 0, 2024-09-16T15:38:50.251 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_txc_bytes": 0, 2024-09-16T15:38:50.251 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_txc_items": 0, 2024-09-16T15:38:50.251 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-16T15:38:50.251 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_deferred_items": 0, 2024-09-16T15:38:50.251 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_bytes": 0, 2024-09-16T15:38:50.251 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_items": 0, 2024-09-16T15:38:50.251 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_bytes": 0, 2024-09-16T15:38:50.251 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_items": 0, 2024-09-16T15:38:50.251 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_reader_bytes": 0, 2024-09-16T15:38:50.251 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_reader_items": 0, 2024-09-16T15:38:50.252 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_writer_bytes": 0, 2024-09-16T15:38:50.252 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_writer_items": 0, 2024-09-16T15:38:50.252 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_anon_bytes": 1703855, 2024-09-16T15:38:50.252 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_anon_items": 333, 2024-09-16T15:38:50.252 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_meta_bytes": 1496, 2024-09-16T15:38:50.252 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_meta_items": 17, 2024-09-16T15:38:50.252 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_bytes": 0, 2024-09-16T15:38:50.252 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_items": 0, 2024-09-16T15:38:50.252 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_mapbl_bytes": 0, 2024-09-16T15:38:50.252 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_mapbl_items": 0, 2024-09-16T15:38:50.252 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_pglog_bytes": 0, 2024-09-16T15:38:50.252 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_pglog_items": 0, 2024-09-16T15:38:50.252 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_bytes": 49912, 2024-09-16T15:38:50.252 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_items": 828, 2024-09-16T15:38:50.252 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_mapping_bytes": 0, 2024-09-16T15:38:50.253 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_mapping_items": 0, 2024-09-16T15:38:50.253 INFO:teuthology.orchestra.run.smithi135.stdout: "pgmap_bytes": 107192, 2024-09-16T15:38:50.253 INFO:teuthology.orchestra.run.smithi135.stdout: "pgmap_items": 483, 2024-09-16T15:38:50.253 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_co_bytes": 0, 2024-09-16T15:38:50.253 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_co_items": 0, 2024-09-16T15:38:50.253 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_1_bytes": 0, 2024-09-16T15:38:50.253 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_1_items": 0, 2024-09-16T15:38:50.253 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_2_bytes": 0, 2024-09-16T15:38:50.253 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_2_items": 0 2024-09-16T15:38:50.253 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.253 INFO:teuthology.orchestra.run.smithi135.stdout: "mgr": { 2024-09-16T15:38:50.253 INFO:teuthology.orchestra.run.smithi135.stdout: "cache_hit": 0, 2024-09-16T15:38:50.253 INFO:teuthology.orchestra.run.smithi135.stdout: "cache_miss": 0 2024-09-16T15:38:50.253 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.253 INFO:teuthology.orchestra.run.smithi135.stdout: "objectcacher-libcephfs": { 2024-09-16T15:38:50.253 INFO:teuthology.orchestra.run.smithi135.stdout: "cache_ops_hit": 0, 2024-09-16T15:38:50.254 INFO:teuthology.orchestra.run.smithi135.stdout: "cache_ops_miss": 0, 2024-09-16T15:38:50.254 INFO:teuthology.orchestra.run.smithi135.stdout: "cache_bytes_hit": 0, 2024-09-16T15:38:50.254 INFO:teuthology.orchestra.run.smithi135.stdout: "cache_bytes_miss": 0, 2024-09-16T15:38:50.254 INFO:teuthology.orchestra.run.smithi135.stdout: "data_read": 0, 2024-09-16T15:38:50.254 INFO:teuthology.orchestra.run.smithi135.stdout: "data_written": 0, 2024-09-16T15:38:50.254 INFO:teuthology.orchestra.run.smithi135.stdout: "data_flushed": 0, 2024-09-16T15:38:50.254 INFO:teuthology.orchestra.run.smithi135.stdout: "data_overwritten_while_flushing": 0, 2024-09-16T15:38:50.254 INFO:teuthology.orchestra.run.smithi135.stdout: "write_ops_blocked": 0, 2024-09-16T15:38:50.254 INFO:teuthology.orchestra.run.smithi135.stdout: "write_bytes_blocked": 0, 2024-09-16T15:38:50.254 INFO:teuthology.orchestra.run.smithi135.stdout: "write_time_blocked": 0.000000000 2024-09-16T15:38:50.254 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.254 INFO:teuthology.orchestra.run.smithi135.stdout: "objectcacher-libcephfs-0x558813e868c0": { 2024-09-16T15:38:50.254 INFO:teuthology.orchestra.run.smithi135.stdout: "cache_ops_hit": 0, 2024-09-16T15:38:50.254 INFO:teuthology.orchestra.run.smithi135.stdout: "cache_ops_miss": 0, 2024-09-16T15:38:50.254 INFO:teuthology.orchestra.run.smithi135.stdout: "cache_bytes_hit": 0, 2024-09-16T15:38:50.254 INFO:teuthology.orchestra.run.smithi135.stdout: "cache_bytes_miss": 0, 2024-09-16T15:38:50.254 INFO:teuthology.orchestra.run.smithi135.stdout: "data_read": 0, 2024-09-16T15:38:50.255 INFO:teuthology.orchestra.run.smithi135.stdout: "data_written": 0, 2024-09-16T15:38:50.255 INFO:teuthology.orchestra.run.smithi135.stdout: "data_flushed": 0, 2024-09-16T15:38:50.255 INFO:teuthology.orchestra.run.smithi135.stdout: "data_overwritten_while_flushing": 0, 2024-09-16T15:38:50.255 INFO:teuthology.orchestra.run.smithi135.stdout: "write_ops_blocked": 0, 2024-09-16T15:38:50.255 INFO:teuthology.orchestra.run.smithi135.stdout: "write_bytes_blocked": 0, 2024-09-16T15:38:50.255 INFO:teuthology.orchestra.run.smithi135.stdout: "write_time_blocked": 0.000000000 2024-09-16T15:38:50.255 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.255 INFO:teuthology.orchestra.run.smithi135.stdout: "objectcacher-libcephfs-0x558813e86be0": { 2024-09-16T15:38:50.255 INFO:teuthology.orchestra.run.smithi135.stdout: "cache_ops_hit": 0, 2024-09-16T15:38:50.255 INFO:teuthology.orchestra.run.smithi135.stdout: "cache_ops_miss": 0, 2024-09-16T15:38:50.255 INFO:teuthology.orchestra.run.smithi135.stdout: "cache_bytes_hit": 0, 2024-09-16T15:38:50.255 INFO:teuthology.orchestra.run.smithi135.stdout: "cache_bytes_miss": 0, 2024-09-16T15:38:50.255 INFO:teuthology.orchestra.run.smithi135.stdout: "data_read": 0, 2024-09-16T15:38:50.255 INFO:teuthology.orchestra.run.smithi135.stdout: "data_written": 0, 2024-09-16T15:38:50.255 INFO:teuthology.orchestra.run.smithi135.stdout: "data_flushed": 0, 2024-09-16T15:38:50.256 INFO:teuthology.orchestra.run.smithi135.stdout: "data_overwritten_while_flushing": 0, 2024-09-16T15:38:50.256 INFO:teuthology.orchestra.run.smithi135.stdout: "write_ops_blocked": 0, 2024-09-16T15:38:50.256 INFO:teuthology.orchestra.run.smithi135.stdout: "write_bytes_blocked": 0, 2024-09-16T15:38:50.256 INFO:teuthology.orchestra.run.smithi135.stdout: "write_time_blocked": 0.000000000 2024-09-16T15:38:50.256 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.256 INFO:teuthology.orchestra.run.smithi135.stdout: "objectcacher-libcephfs-0x558813e870e0": { 2024-09-16T15:38:50.256 INFO:teuthology.orchestra.run.smithi135.stdout: "cache_ops_hit": 9, 2024-09-16T15:38:50.256 INFO:teuthology.orchestra.run.smithi135.stdout: "cache_ops_miss": 0, 2024-09-16T15:38:50.256 INFO:teuthology.orchestra.run.smithi135.stdout: "cache_bytes_hit": 1215, 2024-09-16T15:38:50.256 INFO:teuthology.orchestra.run.smithi135.stdout: "cache_bytes_miss": 0, 2024-09-16T15:38:50.256 INFO:teuthology.orchestra.run.smithi135.stdout: "data_read": 1215, 2024-09-16T15:38:50.256 INFO:teuthology.orchestra.run.smithi135.stdout: "data_written": 405, 2024-09-16T15:38:50.256 INFO:teuthology.orchestra.run.smithi135.stdout: "data_flushed": 405, 2024-09-16T15:38:50.256 INFO:teuthology.orchestra.run.smithi135.stdout: "data_overwritten_while_flushing": 0, 2024-09-16T15:38:50.256 INFO:teuthology.orchestra.run.smithi135.stdout: "write_ops_blocked": 0, 2024-09-16T15:38:50.257 INFO:teuthology.orchestra.run.smithi135.stdout: "write_bytes_blocked": 0, 2024-09-16T15:38:50.257 INFO:teuthology.orchestra.run.smithi135.stdout: "write_time_blocked": 0.000000000 2024-09-16T15:38:50.257 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.257 INFO:teuthology.orchestra.run.smithi135.stdout: "objecter": { 2024-09-16T15:38:50.257 INFO:teuthology.orchestra.run.smithi135.stdout: "op_active": 0, 2024-09-16T15:38:50.257 INFO:teuthology.orchestra.run.smithi135.stdout: "op_laggy": 0, 2024-09-16T15:38:50.257 INFO:teuthology.orchestra.run.smithi135.stdout: "op_send": 0, 2024-09-16T15:38:50.257 INFO:teuthology.orchestra.run.smithi135.stdout: "op_send_bytes": 0, 2024-09-16T15:38:50.257 INFO:teuthology.orchestra.run.smithi135.stdout: "op_resend": 0, 2024-09-16T15:38:50.257 INFO:teuthology.orchestra.run.smithi135.stdout: "op_reply": 0, 2024-09-16T15:38:50.257 INFO:teuthology.orchestra.run.smithi135.stdout: "op_latency": { 2024-09-16T15:38:50.257 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-16T15:38:50.257 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-16T15:38:50.257 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-16T15:38:50.257 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.257 INFO:teuthology.orchestra.run.smithi135.stdout: "op_inflight": 0, 2024-09-16T15:38:50.258 INFO:teuthology.orchestra.run.smithi135.stdout: "oplen_avg": { 2024-09-16T15:38:50.258 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-16T15:38:50.258 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0 2024-09-16T15:38:50.258 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.258 INFO:teuthology.orchestra.run.smithi135.stdout: "op": 0, 2024-09-16T15:38:50.258 INFO:teuthology.orchestra.run.smithi135.stdout: "op_r": 0, 2024-09-16T15:38:50.258 INFO:teuthology.orchestra.run.smithi135.stdout: "op_w": 0, 2024-09-16T15:38:50.258 INFO:teuthology.orchestra.run.smithi135.stdout: "op_rmw": 0, 2024-09-16T15:38:50.258 INFO:teuthology.orchestra.run.smithi135.stdout: "op_pg": 0, 2024-09-16T15:38:50.258 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_stat": 0, 2024-09-16T15:38:50.258 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_create": 0, 2024-09-16T15:38:50.258 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_read": 0, 2024-09-16T15:38:50.258 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_write": 0, 2024-09-16T15:38:50.258 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_writefull": 0, 2024-09-16T15:38:50.258 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_writesame": 0, 2024-09-16T15:38:50.258 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_append": 0, 2024-09-16T15:38:50.259 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_zero": 0, 2024-09-16T15:38:50.259 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_truncate": 0, 2024-09-16T15:38:50.259 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_delete": 0, 2024-09-16T15:38:50.259 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_mapext": 0, 2024-09-16T15:38:50.259 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_sparse_read": 0, 2024-09-16T15:38:50.259 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_clonerange": 0, 2024-09-16T15:38:50.259 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_getxattr": 0, 2024-09-16T15:38:50.259 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_setxattr": 0, 2024-09-16T15:38:50.259 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_cmpxattr": 0, 2024-09-16T15:38:50.259 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_rmxattr": 0, 2024-09-16T15:38:50.259 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_resetxattrs": 0, 2024-09-16T15:38:50.259 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_call": 0, 2024-09-16T15:38:50.259 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_watch": 0, 2024-09-16T15:38:50.259 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_notify": 0, 2024-09-16T15:38:50.259 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_src_cmpxattr": 0, 2024-09-16T15:38:50.260 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_pgls": 0, 2024-09-16T15:38:50.260 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_pgls_filter": 0, 2024-09-16T15:38:50.260 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_other": 0, 2024-09-16T15:38:50.260 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_active": 0, 2024-09-16T15:38:50.260 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_send": 0, 2024-09-16T15:38:50.260 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_resend": 0, 2024-09-16T15:38:50.260 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_ping": 0, 2024-09-16T15:38:50.260 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_active": 0, 2024-09-16T15:38:50.260 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_send": 0, 2024-09-16T15:38:50.260 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_resend": 0, 2024-09-16T15:38:50.260 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_active": 0, 2024-09-16T15:38:50.260 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_send": 0, 2024-09-16T15:38:50.260 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_resend": 0, 2024-09-16T15:38:50.260 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_active": 0, 2024-09-16T15:38:50.260 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_send": 0, 2024-09-16T15:38:50.261 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_resend": 0, 2024-09-16T15:38:50.261 INFO:teuthology.orchestra.run.smithi135.stdout: "command_active": 0, 2024-09-16T15:38:50.261 INFO:teuthology.orchestra.run.smithi135.stdout: "command_send": 8, 2024-09-16T15:38:50.261 INFO:teuthology.orchestra.run.smithi135.stdout: "command_resend": 0, 2024-09-16T15:38:50.261 INFO:teuthology.orchestra.run.smithi135.stdout: "map_epoch": 37, 2024-09-16T15:38:50.261 INFO:teuthology.orchestra.run.smithi135.stdout: "map_full": 0, 2024-09-16T15:38:50.261 INFO:teuthology.orchestra.run.smithi135.stdout: "map_inc": 36, 2024-09-16T15:38:50.261 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_sessions": 8, 2024-09-16T15:38:50.261 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_session_open": 8, 2024-09-16T15:38:50.261 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_session_close": 0, 2024-09-16T15:38:50.261 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_laggy": 0, 2024-09-16T15:38:50.261 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_wr": 0, 2024-09-16T15:38:50.261 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_rd": 0, 2024-09-16T15:38:50.261 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_del": 0 2024-09-16T15:38:50.261 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.261 INFO:teuthology.orchestra.run.smithi135.stdout: "objecter-0x5588131f81e0": { 2024-09-16T15:38:50.262 INFO:teuthology.orchestra.run.smithi135.stdout: "op_active": 0, 2024-09-16T15:38:50.262 INFO:teuthology.orchestra.run.smithi135.stdout: "op_laggy": 0, 2024-09-16T15:38:50.262 INFO:teuthology.orchestra.run.smithi135.stdout: "op_send": 98, 2024-09-16T15:38:50.262 INFO:teuthology.orchestra.run.smithi135.stdout: "op_send_bytes": 1643971, 2024-09-16T15:38:50.262 INFO:teuthology.orchestra.run.smithi135.stdout: "op_resend": 0, 2024-09-16T15:38:50.262 INFO:teuthology.orchestra.run.smithi135.stdout: "op_reply": 98, 2024-09-16T15:38:50.262 INFO:teuthology.orchestra.run.smithi135.stdout: "op_latency": { 2024-09-16T15:38:50.262 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 98, 2024-09-16T15:38:50.262 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 1.121977451, 2024-09-16T15:38:50.262 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.011448749 2024-09-16T15:38:50.262 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.262 INFO:teuthology.orchestra.run.smithi135.stdout: "op_inflight": 0, 2024-09-16T15:38:50.262 INFO:teuthology.orchestra.run.smithi135.stdout: "oplen_avg": { 2024-09-16T15:38:50.262 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 98, 2024-09-16T15:38:50.262 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 189 2024-09-16T15:38:50.262 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.263 INFO:teuthology.orchestra.run.smithi135.stdout: "op": 98, 2024-09-16T15:38:50.263 INFO:teuthology.orchestra.run.smithi135.stdout: "op_r": 26, 2024-09-16T15:38:50.263 INFO:teuthology.orchestra.run.smithi135.stdout: "op_w": 72, 2024-09-16T15:38:50.263 INFO:teuthology.orchestra.run.smithi135.stdout: "op_rmw": 0, 2024-09-16T15:38:50.263 INFO:teuthology.orchestra.run.smithi135.stdout: "op_pg": 0, 2024-09-16T15:38:50.263 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_stat": 0, 2024-09-16T15:38:50.263 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_create": 2, 2024-09-16T15:38:50.263 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_read": 10, 2024-09-16T15:38:50.263 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_write": 53, 2024-09-16T15:38:50.263 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_writefull": 0, 2024-09-16T15:38:50.263 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_writesame": 0, 2024-09-16T15:38:50.263 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_append": 0, 2024-09-16T15:38:50.263 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_zero": 0, 2024-09-16T15:38:50.263 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_truncate": 0, 2024-09-16T15:38:50.263 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_delete": 0, 2024-09-16T15:38:50.263 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_mapext": 0, 2024-09-16T15:38:50.264 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_sparse_read": 0, 2024-09-16T15:38:50.264 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_clonerange": 0, 2024-09-16T15:38:50.264 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_getxattr": 64, 2024-09-16T15:38:50.264 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_setxattr": 36, 2024-09-16T15:38:50.264 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_cmpxattr": 12, 2024-09-16T15:38:50.264 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_rmxattr": 0, 2024-09-16T15:38:50.264 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_resetxattrs": 0, 2024-09-16T15:38:50.264 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_call": 12, 2024-09-16T15:38:50.264 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_watch": 0, 2024-09-16T15:38:50.264 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_notify": 0, 2024-09-16T15:38:50.264 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_src_cmpxattr": 0, 2024-09-16T15:38:50.264 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_pgls": 0, 2024-09-16T15:38:50.264 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_pgls_filter": 0, 2024-09-16T15:38:50.265 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_other": 0, 2024-09-16T15:38:50.265 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_active": 0, 2024-09-16T15:38:50.265 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_send": 0, 2024-09-16T15:38:50.265 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_resend": 0, 2024-09-16T15:38:50.265 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_ping": 0, 2024-09-16T15:38:50.265 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_active": 0, 2024-09-16T15:38:50.265 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_send": 0, 2024-09-16T15:38:50.265 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_resend": 0, 2024-09-16T15:38:50.265 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_active": 0, 2024-09-16T15:38:50.265 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_send": 0, 2024-09-16T15:38:50.265 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_resend": 0, 2024-09-16T15:38:50.265 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_active": 0, 2024-09-16T15:38:50.265 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_send": 0, 2024-09-16T15:38:50.265 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_resend": 0, 2024-09-16T15:38:50.265 INFO:teuthology.orchestra.run.smithi135.stdout: "command_active": 0, 2024-09-16T15:38:50.265 INFO:teuthology.orchestra.run.smithi135.stdout: "command_send": 0, 2024-09-16T15:38:50.266 INFO:teuthology.orchestra.run.smithi135.stdout: "command_resend": 0, 2024-09-16T15:38:50.266 INFO:teuthology.orchestra.run.smithi135.stdout: "map_epoch": 18, 2024-09-16T15:38:50.266 INFO:teuthology.orchestra.run.smithi135.stdout: "map_full": 0, 2024-09-16T15:38:50.266 INFO:teuthology.orchestra.run.smithi135.stdout: "map_inc": 8, 2024-09-16T15:38:50.266 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_sessions": 1, 2024-09-16T15:38:50.266 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_session_open": 1, 2024-09-16T15:38:50.266 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_session_close": 0, 2024-09-16T15:38:50.266 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_laggy": 0, 2024-09-16T15:38:50.266 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_wr": 0, 2024-09-16T15:38:50.266 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_rd": 0, 2024-09-16T15:38:50.266 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_del": 0 2024-09-16T15:38:50.266 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.266 INFO:teuthology.orchestra.run.smithi135.stdout: "objecter-0x5588131f8460": { 2024-09-16T15:38:50.266 INFO:teuthology.orchestra.run.smithi135.stdout: "op_active": 0, 2024-09-16T15:38:50.266 INFO:teuthology.orchestra.run.smithi135.stdout: "op_laggy": 0, 2024-09-16T15:38:50.266 INFO:teuthology.orchestra.run.smithi135.stdout: "op_send": 0, 2024-09-16T15:38:50.267 INFO:teuthology.orchestra.run.smithi135.stdout: "op_send_bytes": 0, 2024-09-16T15:38:50.267 INFO:teuthology.orchestra.run.smithi135.stdout: "op_resend": 0, 2024-09-16T15:38:50.267 INFO:teuthology.orchestra.run.smithi135.stdout: "op_reply": 0, 2024-09-16T15:38:50.267 INFO:teuthology.orchestra.run.smithi135.stdout: "op_latency": { 2024-09-16T15:38:50.267 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-16T15:38:50.267 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-16T15:38:50.267 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-16T15:38:50.267 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.267 INFO:teuthology.orchestra.run.smithi135.stdout: "op_inflight": 0, 2024-09-16T15:38:50.267 INFO:teuthology.orchestra.run.smithi135.stdout: "oplen_avg": { 2024-09-16T15:38:50.267 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-16T15:38:50.267 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0 2024-09-16T15:38:50.267 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.267 INFO:teuthology.orchestra.run.smithi135.stdout: "op": 0, 2024-09-16T15:38:50.267 INFO:teuthology.orchestra.run.smithi135.stdout: "op_r": 0, 2024-09-16T15:38:50.267 INFO:teuthology.orchestra.run.smithi135.stdout: "op_w": 0, 2024-09-16T15:38:50.268 INFO:teuthology.orchestra.run.smithi135.stdout: "op_rmw": 0, 2024-09-16T15:38:50.268 INFO:teuthology.orchestra.run.smithi135.stdout: "op_pg": 0, 2024-09-16T15:38:50.268 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_stat": 0, 2024-09-16T15:38:50.268 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_create": 0, 2024-09-16T15:38:50.268 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_read": 0, 2024-09-16T15:38:50.268 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_write": 0, 2024-09-16T15:38:50.268 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_writefull": 0, 2024-09-16T15:38:50.268 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_writesame": 0, 2024-09-16T15:38:50.268 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_append": 0, 2024-09-16T15:38:50.268 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_zero": 0, 2024-09-16T15:38:50.268 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_truncate": 0, 2024-09-16T15:38:50.268 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_delete": 0, 2024-09-16T15:38:50.268 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_mapext": 0, 2024-09-16T15:38:50.268 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_sparse_read": 0, 2024-09-16T15:38:50.269 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_clonerange": 0, 2024-09-16T15:38:50.269 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_getxattr": 0, 2024-09-16T15:38:50.269 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_setxattr": 0, 2024-09-16T15:38:50.269 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_cmpxattr": 0, 2024-09-16T15:38:50.269 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_rmxattr": 0, 2024-09-16T15:38:50.269 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_resetxattrs": 0, 2024-09-16T15:38:50.269 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_call": 0, 2024-09-16T15:38:50.269 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_watch": 0, 2024-09-16T15:38:50.269 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_notify": 0, 2024-09-16T15:38:50.269 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_src_cmpxattr": 0, 2024-09-16T15:38:50.269 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_pgls": 0, 2024-09-16T15:38:50.269 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_pgls_filter": 0, 2024-09-16T15:38:50.269 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_other": 0, 2024-09-16T15:38:50.269 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_active": 0, 2024-09-16T15:38:50.269 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_send": 0, 2024-09-16T15:38:50.270 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_resend": 0, 2024-09-16T15:38:50.270 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_ping": 0, 2024-09-16T15:38:50.270 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_active": 0, 2024-09-16T15:38:50.270 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_send": 0, 2024-09-16T15:38:50.270 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_resend": 0, 2024-09-16T15:38:50.270 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_active": 0, 2024-09-16T15:38:50.270 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_send": 0, 2024-09-16T15:38:50.270 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_resend": 0, 2024-09-16T15:38:50.270 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_active": 0, 2024-09-16T15:38:50.270 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_send": 0, 2024-09-16T15:38:50.270 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_resend": 0, 2024-09-16T15:38:50.270 INFO:teuthology.orchestra.run.smithi135.stdout: "command_active": 0, 2024-09-16T15:38:50.270 INFO:teuthology.orchestra.run.smithi135.stdout: "command_send": 0, 2024-09-16T15:38:50.270 INFO:teuthology.orchestra.run.smithi135.stdout: "command_resend": 0, 2024-09-16T15:38:50.271 INFO:teuthology.orchestra.run.smithi135.stdout: "map_epoch": 0, 2024-09-16T15:38:50.271 INFO:teuthology.orchestra.run.smithi135.stdout: "map_full": 0, 2024-09-16T15:38:50.271 INFO:teuthology.orchestra.run.smithi135.stdout: "map_inc": 0, 2024-09-16T15:38:50.271 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_sessions": 0, 2024-09-16T15:38:50.271 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_session_open": 0, 2024-09-16T15:38:50.271 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_session_close": 0, 2024-09-16T15:38:50.271 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_laggy": 0, 2024-09-16T15:38:50.271 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_wr": 0, 2024-09-16T15:38:50.271 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_rd": 0, 2024-09-16T15:38:50.271 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_del": 0 2024-09-16T15:38:50.271 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.271 INFO:teuthology.orchestra.run.smithi135.stdout: "objecter-0x5588131f86e0": { 2024-09-16T15:38:50.271 INFO:teuthology.orchestra.run.smithi135.stdout: "op_active": 0, 2024-09-16T15:38:50.271 INFO:teuthology.orchestra.run.smithi135.stdout: "op_laggy": 0, 2024-09-16T15:38:50.271 INFO:teuthology.orchestra.run.smithi135.stdout: "op_send": 0, 2024-09-16T15:38:50.271 INFO:teuthology.orchestra.run.smithi135.stdout: "op_send_bytes": 0, 2024-09-16T15:38:50.272 INFO:teuthology.orchestra.run.smithi135.stdout: "op_resend": 0, 2024-09-16T15:38:50.272 INFO:teuthology.orchestra.run.smithi135.stdout: "op_reply": 0, 2024-09-16T15:38:50.272 INFO:teuthology.orchestra.run.smithi135.stdout: "op_latency": { 2024-09-16T15:38:50.272 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-16T15:38:50.272 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-16T15:38:50.272 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-16T15:38:50.272 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.272 INFO:teuthology.orchestra.run.smithi135.stdout: "op_inflight": 0, 2024-09-16T15:38:50.272 INFO:teuthology.orchestra.run.smithi135.stdout: "oplen_avg": { 2024-09-16T15:38:50.272 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-16T15:38:50.272 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0 2024-09-16T15:38:50.272 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.272 INFO:teuthology.orchestra.run.smithi135.stdout: "op": 0, 2024-09-16T15:38:50.272 INFO:teuthology.orchestra.run.smithi135.stdout: "op_r": 0, 2024-09-16T15:38:50.272 INFO:teuthology.orchestra.run.smithi135.stdout: "op_w": 0, 2024-09-16T15:38:50.272 INFO:teuthology.orchestra.run.smithi135.stdout: "op_rmw": 0, 2024-09-16T15:38:50.273 INFO:teuthology.orchestra.run.smithi135.stdout: "op_pg": 0, 2024-09-16T15:38:50.273 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_stat": 0, 2024-09-16T15:38:50.273 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_create": 0, 2024-09-16T15:38:50.273 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_read": 0, 2024-09-16T15:38:50.273 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_write": 0, 2024-09-16T15:38:50.273 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_writefull": 0, 2024-09-16T15:38:50.273 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_writesame": 0, 2024-09-16T15:38:50.273 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_append": 0, 2024-09-16T15:38:50.273 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_zero": 0, 2024-09-16T15:38:50.273 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_truncate": 0, 2024-09-16T15:38:50.273 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_delete": 0, 2024-09-16T15:38:50.273 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_mapext": 0, 2024-09-16T15:38:50.273 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_sparse_read": 0, 2024-09-16T15:38:50.273 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_clonerange": 0, 2024-09-16T15:38:50.273 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_getxattr": 0, 2024-09-16T15:38:50.274 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_setxattr": 0, 2024-09-16T15:38:50.274 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_cmpxattr": 0, 2024-09-16T15:38:50.274 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_rmxattr": 0, 2024-09-16T15:38:50.274 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_resetxattrs": 0, 2024-09-16T15:38:50.274 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_call": 0, 2024-09-16T15:38:50.274 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_watch": 0, 2024-09-16T15:38:50.274 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_notify": 0, 2024-09-16T15:38:50.274 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_src_cmpxattr": 0, 2024-09-16T15:38:50.274 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_pgls": 0, 2024-09-16T15:38:50.274 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_pgls_filter": 0, 2024-09-16T15:38:50.274 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_other": 0, 2024-09-16T15:38:50.274 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_active": 0, 2024-09-16T15:38:50.274 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_send": 0, 2024-09-16T15:38:50.274 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_resend": 0, 2024-09-16T15:38:50.274 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_ping": 0, 2024-09-16T15:38:50.274 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_active": 0, 2024-09-16T15:38:50.275 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_send": 0, 2024-09-16T15:38:50.275 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_resend": 0, 2024-09-16T15:38:50.275 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_active": 0, 2024-09-16T15:38:50.275 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_send": 0, 2024-09-16T15:38:50.275 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_resend": 0, 2024-09-16T15:38:50.275 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_active": 0, 2024-09-16T15:38:50.275 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_send": 0, 2024-09-16T15:38:50.275 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_resend": 0, 2024-09-16T15:38:50.275 INFO:teuthology.orchestra.run.smithi135.stdout: "command_active": 0, 2024-09-16T15:38:50.275 INFO:teuthology.orchestra.run.smithi135.stdout: "command_send": 0, 2024-09-16T15:38:50.275 INFO:teuthology.orchestra.run.smithi135.stdout: "command_resend": 0, 2024-09-16T15:38:50.275 INFO:teuthology.orchestra.run.smithi135.stdout: "map_epoch": 0, 2024-09-16T15:38:50.275 INFO:teuthology.orchestra.run.smithi135.stdout: "map_full": 0, 2024-09-16T15:38:50.275 INFO:teuthology.orchestra.run.smithi135.stdout: "map_inc": 0, 2024-09-16T15:38:50.275 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_sessions": 0, 2024-09-16T15:38:50.275 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_session_open": 0, 2024-09-16T15:38:50.276 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_session_close": 0, 2024-09-16T15:38:50.276 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_laggy": 0, 2024-09-16T15:38:50.276 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_wr": 0, 2024-09-16T15:38:50.276 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_rd": 0, 2024-09-16T15:38:50.276 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_del": 0 2024-09-16T15:38:50.276 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.276 INFO:teuthology.orchestra.run.smithi135.stdout: "objecter-0x5588131f8e60": { 2024-09-16T15:38:50.276 INFO:teuthology.orchestra.run.smithi135.stdout: "op_active": 0, 2024-09-16T15:38:50.276 INFO:teuthology.orchestra.run.smithi135.stdout: "op_laggy": 0, 2024-09-16T15:38:50.276 INFO:teuthology.orchestra.run.smithi135.stdout: "op_send": 1, 2024-09-16T15:38:50.276 INFO:teuthology.orchestra.run.smithi135.stdout: "op_send_bytes": 39, 2024-09-16T15:38:50.276 INFO:teuthology.orchestra.run.smithi135.stdout: "op_resend": 0, 2024-09-16T15:38:50.276 INFO:teuthology.orchestra.run.smithi135.stdout: "op_reply": 1, 2024-09-16T15:38:50.276 INFO:teuthology.orchestra.run.smithi135.stdout: "op_latency": { 2024-09-16T15:38:50.276 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 1, 2024-09-16T15:38:50.276 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000999980, 2024-09-16T15:38:50.277 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000999980 2024-09-16T15:38:50.277 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.277 INFO:teuthology.orchestra.run.smithi135.stdout: "op_inflight": 0, 2024-09-16T15:38:50.277 INFO:teuthology.orchestra.run.smithi135.stdout: "oplen_avg": { 2024-09-16T15:38:50.277 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 1, 2024-09-16T15:38:50.277 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 1 2024-09-16T15:38:50.277 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.277 INFO:teuthology.orchestra.run.smithi135.stdout: "op": 1, 2024-09-16T15:38:50.277 INFO:teuthology.orchestra.run.smithi135.stdout: "op_r": 1, 2024-09-16T15:38:50.277 INFO:teuthology.orchestra.run.smithi135.stdout: "op_w": 0, 2024-09-16T15:38:50.277 INFO:teuthology.orchestra.run.smithi135.stdout: "op_rmw": 0, 2024-09-16T15:38:50.277 INFO:teuthology.orchestra.run.smithi135.stdout: "op_pg": 0, 2024-09-16T15:38:50.277 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_stat": 0, 2024-09-16T15:38:50.277 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_create": 0, 2024-09-16T15:38:50.277 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_read": 0, 2024-09-16T15:38:50.278 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_write": 0, 2024-09-16T15:38:50.278 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_writefull": 0, 2024-09-16T15:38:50.278 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_writesame": 0, 2024-09-16T15:38:50.278 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_append": 0, 2024-09-16T15:38:50.278 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_zero": 0, 2024-09-16T15:38:50.278 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_truncate": 0, 2024-09-16T15:38:50.278 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_delete": 0, 2024-09-16T15:38:50.278 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_mapext": 0, 2024-09-16T15:38:50.278 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_sparse_read": 0, 2024-09-16T15:38:50.278 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_clonerange": 0, 2024-09-16T15:38:50.278 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_getxattr": 0, 2024-09-16T15:38:50.278 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_setxattr": 0, 2024-09-16T15:38:50.278 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_cmpxattr": 0, 2024-09-16T15:38:50.278 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_rmxattr": 0, 2024-09-16T15:38:50.278 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_resetxattrs": 0, 2024-09-16T15:38:50.278 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_call": 0, 2024-09-16T15:38:50.279 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_watch": 0, 2024-09-16T15:38:50.279 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_notify": 0, 2024-09-16T15:38:50.279 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_src_cmpxattr": 0, 2024-09-16T15:38:50.279 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_pgls": 0, 2024-09-16T15:38:50.279 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_pgls_filter": 0, 2024-09-16T15:38:50.279 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_other": 1, 2024-09-16T15:38:50.279 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_active": 0, 2024-09-16T15:38:50.279 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_send": 0, 2024-09-16T15:38:50.279 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_resend": 0, 2024-09-16T15:38:50.279 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_ping": 0, 2024-09-16T15:38:50.279 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_active": 0, 2024-09-16T15:38:50.279 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_send": 0, 2024-09-16T15:38:50.279 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_resend": 0, 2024-09-16T15:38:50.279 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_active": 0, 2024-09-16T15:38:50.279 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_send": 0, 2024-09-16T15:38:50.280 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_resend": 0, 2024-09-16T15:38:50.280 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_active": 0, 2024-09-16T15:38:50.280 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_send": 0, 2024-09-16T15:38:50.280 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_resend": 0, 2024-09-16T15:38:50.280 INFO:teuthology.orchestra.run.smithi135.stdout: "command_active": 0, 2024-09-16T15:38:50.280 INFO:teuthology.orchestra.run.smithi135.stdout: "command_send": 0, 2024-09-16T15:38:50.280 INFO:teuthology.orchestra.run.smithi135.stdout: "command_resend": 0, 2024-09-16T15:38:50.280 INFO:teuthology.orchestra.run.smithi135.stdout: "map_epoch": 0, 2024-09-16T15:38:50.280 INFO:teuthology.orchestra.run.smithi135.stdout: "map_full": 0, 2024-09-16T15:38:50.280 INFO:teuthology.orchestra.run.smithi135.stdout: "map_inc": 0, 2024-09-16T15:38:50.280 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_sessions": 1, 2024-09-16T15:38:50.280 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_session_open": 1, 2024-09-16T15:38:50.280 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_session_close": 0, 2024-09-16T15:38:50.280 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_laggy": 0, 2024-09-16T15:38:50.280 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_wr": 0, 2024-09-16T15:38:50.281 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_rd": 0, 2024-09-16T15:38:50.281 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_del": 0 2024-09-16T15:38:50.281 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.281 INFO:teuthology.orchestra.run.smithi135.stdout: "objecter-0x5588131f94a0": { 2024-09-16T15:38:50.281 INFO:teuthology.orchestra.run.smithi135.stdout: "op_active": 0, 2024-09-16T15:38:50.281 INFO:teuthology.orchestra.run.smithi135.stdout: "op_laggy": 0, 2024-09-16T15:38:50.281 INFO:teuthology.orchestra.run.smithi135.stdout: "op_send": 0, 2024-09-16T15:38:50.281 INFO:teuthology.orchestra.run.smithi135.stdout: "op_send_bytes": 0, 2024-09-16T15:38:50.281 INFO:teuthology.orchestra.run.smithi135.stdout: "op_resend": 0, 2024-09-16T15:38:50.281 INFO:teuthology.orchestra.run.smithi135.stdout: "op_reply": 0, 2024-09-16T15:38:50.281 INFO:teuthology.orchestra.run.smithi135.stdout: "op_latency": { 2024-09-16T15:38:50.281 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-16T15:38:50.281 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-16T15:38:50.281 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-16T15:38:50.281 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.281 INFO:teuthology.orchestra.run.smithi135.stdout: "op_inflight": 0, 2024-09-16T15:38:50.282 INFO:teuthology.orchestra.run.smithi135.stdout: "oplen_avg": { 2024-09-16T15:38:50.282 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-16T15:38:50.282 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0 2024-09-16T15:38:50.282 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.282 INFO:teuthology.orchestra.run.smithi135.stdout: "op": 0, 2024-09-16T15:38:50.282 INFO:teuthology.orchestra.run.smithi135.stdout: "op_r": 0, 2024-09-16T15:38:50.282 INFO:teuthology.orchestra.run.smithi135.stdout: "op_w": 0, 2024-09-16T15:38:50.282 INFO:teuthology.orchestra.run.smithi135.stdout: "op_rmw": 0, 2024-09-16T15:38:50.282 INFO:teuthology.orchestra.run.smithi135.stdout: "op_pg": 0, 2024-09-16T15:38:50.282 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_stat": 0, 2024-09-16T15:38:50.282 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_create": 0, 2024-09-16T15:38:50.282 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_read": 0, 2024-09-16T15:38:50.282 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_write": 0, 2024-09-16T15:38:50.282 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_writefull": 0, 2024-09-16T15:38:50.282 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_writesame": 0, 2024-09-16T15:38:50.282 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_append": 0, 2024-09-16T15:38:50.283 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_zero": 0, 2024-09-16T15:38:50.283 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_truncate": 0, 2024-09-16T15:38:50.283 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_delete": 0, 2024-09-16T15:38:50.283 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_mapext": 0, 2024-09-16T15:38:50.283 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_sparse_read": 0, 2024-09-16T15:38:50.283 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_clonerange": 0, 2024-09-16T15:38:50.283 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_getxattr": 0, 2024-09-16T15:38:50.283 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_setxattr": 0, 2024-09-16T15:38:50.283 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_cmpxattr": 0, 2024-09-16T15:38:50.283 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_rmxattr": 0, 2024-09-16T15:38:50.283 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_resetxattrs": 0, 2024-09-16T15:38:50.283 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_call": 0, 2024-09-16T15:38:50.283 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_watch": 0, 2024-09-16T15:38:50.283 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_notify": 0, 2024-09-16T15:38:50.283 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_src_cmpxattr": 0, 2024-09-16T15:38:50.283 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_pgls": 0, 2024-09-16T15:38:50.284 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_pgls_filter": 0, 2024-09-16T15:38:50.284 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_other": 0, 2024-09-16T15:38:50.284 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_active": 0, 2024-09-16T15:38:50.284 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_send": 0, 2024-09-16T15:38:50.284 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_resend": 0, 2024-09-16T15:38:50.284 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_ping": 0, 2024-09-16T15:38:50.284 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_active": 0, 2024-09-16T15:38:50.284 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_send": 0, 2024-09-16T15:38:50.284 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_resend": 0, 2024-09-16T15:38:50.284 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_active": 0, 2024-09-16T15:38:50.284 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_send": 0, 2024-09-16T15:38:50.284 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_resend": 0, 2024-09-16T15:38:50.284 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_active": 0, 2024-09-16T15:38:50.284 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_send": 0, 2024-09-16T15:38:50.284 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_resend": 0, 2024-09-16T15:38:50.285 INFO:teuthology.orchestra.run.smithi135.stdout: "command_active": 0, 2024-09-16T15:38:50.285 INFO:teuthology.orchestra.run.smithi135.stdout: "command_send": 0, 2024-09-16T15:38:50.285 INFO:teuthology.orchestra.run.smithi135.stdout: "command_resend": 0, 2024-09-16T15:38:50.285 INFO:teuthology.orchestra.run.smithi135.stdout: "map_epoch": 0, 2024-09-16T15:38:50.285 INFO:teuthology.orchestra.run.smithi135.stdout: "map_full": 0, 2024-09-16T15:38:50.285 INFO:teuthology.orchestra.run.smithi135.stdout: "map_inc": 0, 2024-09-16T15:38:50.285 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_sessions": 0, 2024-09-16T15:38:50.285 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_session_open": 0, 2024-09-16T15:38:50.285 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_session_close": 0, 2024-09-16T15:38:50.285 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_laggy": 0, 2024-09-16T15:38:50.285 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_wr": 0, 2024-09-16T15:38:50.285 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_rd": 0, 2024-09-16T15:38:50.285 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_del": 0 2024-09-16T15:38:50.285 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.285 INFO:teuthology.orchestra.run.smithi135.stdout: "objecter-0x558813e86960": { 2024-09-16T15:38:50.285 INFO:teuthology.orchestra.run.smithi135.stdout: "op_active": 0, 2024-09-16T15:38:50.286 INFO:teuthology.orchestra.run.smithi135.stdout: "op_laggy": 0, 2024-09-16T15:38:50.286 INFO:teuthology.orchestra.run.smithi135.stdout: "op_send": 0, 2024-09-16T15:38:50.286 INFO:teuthology.orchestra.run.smithi135.stdout: "op_send_bytes": 0, 2024-09-16T15:38:50.286 INFO:teuthology.orchestra.run.smithi135.stdout: "op_resend": 0, 2024-09-16T15:38:50.286 INFO:teuthology.orchestra.run.smithi135.stdout: "op_reply": 0, 2024-09-16T15:38:50.286 INFO:teuthology.orchestra.run.smithi135.stdout: "op_latency": { 2024-09-16T15:38:50.286 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-16T15:38:50.286 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-16T15:38:50.286 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-16T15:38:50.286 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.286 INFO:teuthology.orchestra.run.smithi135.stdout: "op_inflight": 0, 2024-09-16T15:38:50.286 INFO:teuthology.orchestra.run.smithi135.stdout: "oplen_avg": { 2024-09-16T15:38:50.286 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-16T15:38:50.286 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0 2024-09-16T15:38:50.286 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.286 INFO:teuthology.orchestra.run.smithi135.stdout: "op": 0, 2024-09-16T15:38:50.287 INFO:teuthology.orchestra.run.smithi135.stdout: "op_r": 0, 2024-09-16T15:38:50.287 INFO:teuthology.orchestra.run.smithi135.stdout: "op_w": 0, 2024-09-16T15:38:50.287 INFO:teuthology.orchestra.run.smithi135.stdout: "op_rmw": 0, 2024-09-16T15:38:50.287 INFO:teuthology.orchestra.run.smithi135.stdout: "op_pg": 0, 2024-09-16T15:38:50.287 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_stat": 0, 2024-09-16T15:38:50.287 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_create": 0, 2024-09-16T15:38:50.287 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_read": 0, 2024-09-16T15:38:50.287 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_write": 0, 2024-09-16T15:38:50.287 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_writefull": 0, 2024-09-16T15:38:50.287 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_writesame": 0, 2024-09-16T15:38:50.287 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_append": 0, 2024-09-16T15:38:50.287 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_zero": 0, 2024-09-16T15:38:50.287 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_truncate": 0, 2024-09-16T15:38:50.287 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_delete": 0, 2024-09-16T15:38:50.288 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_mapext": 0, 2024-09-16T15:38:50.288 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_sparse_read": 0, 2024-09-16T15:38:50.288 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_clonerange": 0, 2024-09-16T15:38:50.288 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_getxattr": 0, 2024-09-16T15:38:50.288 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_setxattr": 0, 2024-09-16T15:38:50.288 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_cmpxattr": 0, 2024-09-16T15:38:50.288 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_rmxattr": 0, 2024-09-16T15:38:50.288 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_resetxattrs": 0, 2024-09-16T15:38:50.288 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_call": 0, 2024-09-16T15:38:50.288 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_watch": 0, 2024-09-16T15:38:50.288 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_notify": 0, 2024-09-16T15:38:50.288 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_src_cmpxattr": 0, 2024-09-16T15:38:50.288 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_pgls": 0, 2024-09-16T15:38:50.288 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_pgls_filter": 0, 2024-09-16T15:38:50.288 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_other": 0, 2024-09-16T15:38:50.289 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_active": 0, 2024-09-16T15:38:50.289 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_send": 0, 2024-09-16T15:38:50.289 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_resend": 0, 2024-09-16T15:38:50.289 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_ping": 0, 2024-09-16T15:38:50.289 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_active": 0, 2024-09-16T15:38:50.289 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_send": 0, 2024-09-16T15:38:50.289 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_resend": 0, 2024-09-16T15:38:50.289 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_active": 0, 2024-09-16T15:38:50.289 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_send": 0, 2024-09-16T15:38:50.289 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_resend": 0, 2024-09-16T15:38:50.289 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_active": 0, 2024-09-16T15:38:50.289 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_send": 0, 2024-09-16T15:38:50.289 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_resend": 0, 2024-09-16T15:38:50.289 INFO:teuthology.orchestra.run.smithi135.stdout: "command_active": 0, 2024-09-16T15:38:50.289 INFO:teuthology.orchestra.run.smithi135.stdout: "command_send": 0, 2024-09-16T15:38:50.289 INFO:teuthology.orchestra.run.smithi135.stdout: "command_resend": 0, 2024-09-16T15:38:50.290 INFO:teuthology.orchestra.run.smithi135.stdout: "map_epoch": 0, 2024-09-16T15:38:50.290 INFO:teuthology.orchestra.run.smithi135.stdout: "map_full": 0, 2024-09-16T15:38:50.290 INFO:teuthology.orchestra.run.smithi135.stdout: "map_inc": 0, 2024-09-16T15:38:50.290 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_sessions": 0, 2024-09-16T15:38:50.290 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_session_open": 0, 2024-09-16T15:38:50.290 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_session_close": 0, 2024-09-16T15:38:50.290 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_laggy": 0, 2024-09-16T15:38:50.290 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_wr": 0, 2024-09-16T15:38:50.290 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_rd": 0, 2024-09-16T15:38:50.290 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_del": 0 2024-09-16T15:38:50.290 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.290 INFO:teuthology.orchestra.run.smithi135.stdout: "objecter-0x558813e87180": { 2024-09-16T15:38:50.290 INFO:teuthology.orchestra.run.smithi135.stdout: "op_active": 0, 2024-09-16T15:38:50.290 INFO:teuthology.orchestra.run.smithi135.stdout: "op_laggy": 0, 2024-09-16T15:38:50.290 INFO:teuthology.orchestra.run.smithi135.stdout: "op_send": 3, 2024-09-16T15:38:50.290 INFO:teuthology.orchestra.run.smithi135.stdout: "op_send_bytes": 405, 2024-09-16T15:38:50.291 INFO:teuthology.orchestra.run.smithi135.stdout: "op_resend": 0, 2024-09-16T15:38:50.291 INFO:teuthology.orchestra.run.smithi135.stdout: "op_reply": 3, 2024-09-16T15:38:50.291 INFO:teuthology.orchestra.run.smithi135.stdout: "op_latency": { 2024-09-16T15:38:50.291 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 3, 2024-09-16T15:38:50.291 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.005999878, 2024-09-16T15:38:50.291 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.001999959 2024-09-16T15:38:50.291 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.291 INFO:teuthology.orchestra.run.smithi135.stdout: "op_inflight": 0, 2024-09-16T15:38:50.291 INFO:teuthology.orchestra.run.smithi135.stdout: "oplen_avg": { 2024-09-16T15:38:50.291 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 3, 2024-09-16T15:38:50.291 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 3 2024-09-16T15:38:50.291 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.291 INFO:teuthology.orchestra.run.smithi135.stdout: "op": 3, 2024-09-16T15:38:50.291 INFO:teuthology.orchestra.run.smithi135.stdout: "op_r": 0, 2024-09-16T15:38:50.291 INFO:teuthology.orchestra.run.smithi135.stdout: "op_w": 3, 2024-09-16T15:38:50.291 INFO:teuthology.orchestra.run.smithi135.stdout: "op_rmw": 0, 2024-09-16T15:38:50.292 INFO:teuthology.orchestra.run.smithi135.stdout: "op_pg": 0, 2024-09-16T15:38:50.292 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_stat": 0, 2024-09-16T15:38:50.292 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_create": 0, 2024-09-16T15:38:50.292 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_read": 0, 2024-09-16T15:38:50.292 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_write": 3, 2024-09-16T15:38:50.292 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_writefull": 0, 2024-09-16T15:38:50.292 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_writesame": 0, 2024-09-16T15:38:50.292 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_append": 0, 2024-09-16T15:38:50.292 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_zero": 0, 2024-09-16T15:38:50.292 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_truncate": 0, 2024-09-16T15:38:50.292 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_delete": 0, 2024-09-16T15:38:50.292 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_mapext": 0, 2024-09-16T15:38:50.292 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_sparse_read": 0, 2024-09-16T15:38:50.292 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_clonerange": 0, 2024-09-16T15:38:50.292 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_getxattr": 0, 2024-09-16T15:38:50.292 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_setxattr": 0, 2024-09-16T15:38:50.293 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_cmpxattr": 0, 2024-09-16T15:38:50.293 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_rmxattr": 0, 2024-09-16T15:38:50.293 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_resetxattrs": 0, 2024-09-16T15:38:50.293 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_call": 0, 2024-09-16T15:38:50.293 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_watch": 0, 2024-09-16T15:38:50.293 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_notify": 0, 2024-09-16T15:38:50.293 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_src_cmpxattr": 0, 2024-09-16T15:38:50.293 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_pgls": 0, 2024-09-16T15:38:50.293 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_pgls_filter": 0, 2024-09-16T15:38:50.293 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_other": 0, 2024-09-16T15:38:50.293 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_active": 0, 2024-09-16T15:38:50.293 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_send": 0, 2024-09-16T15:38:50.293 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_resend": 0, 2024-09-16T15:38:50.293 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_ping": 0, 2024-09-16T15:38:50.293 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_active": 0, 2024-09-16T15:38:50.293 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_send": 0, 2024-09-16T15:38:50.294 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_resend": 0, 2024-09-16T15:38:50.294 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_active": 0, 2024-09-16T15:38:50.294 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_send": 0, 2024-09-16T15:38:50.294 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_resend": 0, 2024-09-16T15:38:50.294 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_active": 0, 2024-09-16T15:38:50.294 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_send": 0, 2024-09-16T15:38:50.294 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_resend": 0, 2024-09-16T15:38:50.294 INFO:teuthology.orchestra.run.smithi135.stdout: "command_active": 0, 2024-09-16T15:38:50.294 INFO:teuthology.orchestra.run.smithi135.stdout: "command_send": 0, 2024-09-16T15:38:50.294 INFO:teuthology.orchestra.run.smithi135.stdout: "command_resend": 0, 2024-09-16T15:38:50.294 INFO:teuthology.orchestra.run.smithi135.stdout: "map_epoch": 0, 2024-09-16T15:38:50.294 INFO:teuthology.orchestra.run.smithi135.stdout: "map_full": 0, 2024-09-16T15:38:50.294 INFO:teuthology.orchestra.run.smithi135.stdout: "map_inc": 0, 2024-09-16T15:38:50.294 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_sessions": 3, 2024-09-16T15:38:50.294 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_session_open": 3, 2024-09-16T15:38:50.294 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_session_close": 0, 2024-09-16T15:38:50.295 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_laggy": 0, 2024-09-16T15:38:50.295 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_wr": 0, 2024-09-16T15:38:50.295 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_rd": 0, 2024-09-16T15:38:50.295 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_del": 0 2024-09-16T15:38:50.295 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.295 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-mgr_client_bytes": { 2024-09-16T15:38:50.295 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-09-16T15:38:50.295 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 134217728, 2024-09-16T15:38:50.295 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-09-16T15:38:50.295 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 57, 2024-09-16T15:38:50.295 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 174994, 2024-09-16T15:38:50.295 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-09-16T15:38:50.295 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 57, 2024-09-16T15:38:50.295 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-09-16T15:38:50.295 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-09-16T15:38:50.296 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 79, 2024-09-16T15:38:50.296 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 174994, 2024-09-16T15:38:50.296 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-09-16T15:38:50.296 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-16T15:38:50.296 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-16T15:38:50.296 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-16T15:38:50.296 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-16T15:38:50.296 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.296 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-mgr_client_messages": { 2024-09-16T15:38:50.296 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-09-16T15:38:50.296 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 512, 2024-09-16T15:38:50.296 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-09-16T15:38:50.297 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 57, 2024-09-16T15:38:50.297 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 57, 2024-09-16T15:38:50.297 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-09-16T15:38:50.297 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 57, 2024-09-16T15:38:50.297 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-09-16T15:38:50.297 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-09-16T15:38:50.297 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 57, 2024-09-16T15:38:50.297 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 57, 2024-09-16T15:38:50.297 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-09-16T15:38:50.297 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-16T15:38:50.297 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-16T15:38:50.297 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-16T15:38:50.297 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-16T15:38:50.298 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.298 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-mgr_mds_bytes": { 2024-09-16T15:38:50.298 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-09-16T15:38:50.298 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 134217728, 2024-09-16T15:38:50.298 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-09-16T15:38:50.298 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 71, 2024-09-16T15:38:50.298 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 842014, 2024-09-16T15:38:50.298 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-09-16T15:38:50.298 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 71, 2024-09-16T15:38:50.298 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-09-16T15:38:50.298 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-09-16T15:38:50.298 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 71, 2024-09-16T15:38:50.298 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 842014, 2024-09-16T15:38:50.299 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-09-16T15:38:50.299 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-16T15:38:50.299 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-16T15:38:50.299 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-16T15:38:50.299 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-16T15:38:50.299 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.299 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-mgr_mds_messsages": { 2024-09-16T15:38:50.299 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-09-16T15:38:50.299 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 128, 2024-09-16T15:38:50.299 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-09-16T15:38:50.299 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 71, 2024-09-16T15:38:50.299 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 71, 2024-09-16T15:38:50.299 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-09-16T15:38:50.299 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 71, 2024-09-16T15:38:50.299 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-09-16T15:38:50.300 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-09-16T15:38:50.300 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 71, 2024-09-16T15:38:50.300 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 71, 2024-09-16T15:38:50.300 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-09-16T15:38:50.300 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-16T15:38:50.300 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-16T15:38:50.300 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-16T15:38:50.300 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-16T15:38:50.300 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.300 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-mgr_mon_bytes": { 2024-09-16T15:38:50.300 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-09-16T15:38:50.300 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 134217728, 2024-09-16T15:38:50.300 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-09-16T15:38:50.300 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 54, 2024-09-16T15:38:50.301 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 434840, 2024-09-16T15:38:50.301 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-09-16T15:38:50.301 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 54, 2024-09-16T15:38:50.301 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-09-16T15:38:50.301 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-09-16T15:38:50.301 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 54, 2024-09-16T15:38:50.301 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 434840, 2024-09-16T15:38:50.301 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-09-16T15:38:50.301 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-16T15:38:50.301 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-16T15:38:50.301 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-16T15:38:50.301 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-16T15:38:50.301 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.301 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-mgr_mon_messsages": { 2024-09-16T15:38:50.301 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-09-16T15:38:50.302 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 128, 2024-09-16T15:38:50.302 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-09-16T15:38:50.302 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 54, 2024-09-16T15:38:50.302 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 54, 2024-09-16T15:38:50.302 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-09-16T15:38:50.302 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 54, 2024-09-16T15:38:50.302 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-09-16T15:38:50.302 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-09-16T15:38:50.302 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 54, 2024-09-16T15:38:50.302 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 54, 2024-09-16T15:38:50.302 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-09-16T15:38:50.302 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-16T15:38:50.302 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-16T15:38:50.302 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-16T15:38:50.302 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-16T15:38:50.303 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.303 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-mgr_osd_bytes": { 2024-09-16T15:38:50.303 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-09-16T15:38:50.303 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 536870912, 2024-09-16T15:38:50.303 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-09-16T15:38:50.303 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 295, 2024-09-16T15:38:50.303 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 4021382, 2024-09-16T15:38:50.303 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-09-16T15:38:50.303 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 295, 2024-09-16T15:38:50.303 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-09-16T15:38:50.303 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-09-16T15:38:50.303 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 295, 2024-09-16T15:38:50.303 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 4021382, 2024-09-16T15:38:50.303 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-09-16T15:38:50.303 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-16T15:38:50.303 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-16T15:38:50.304 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-16T15:38:50.304 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-16T15:38:50.304 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.304 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-mgr_osd_messsages": { 2024-09-16T15:38:50.304 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-09-16T15:38:50.304 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 8192, 2024-09-16T15:38:50.304 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-09-16T15:38:50.304 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 295, 2024-09-16T15:38:50.304 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 295, 2024-09-16T15:38:50.304 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-09-16T15:38:50.304 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 295, 2024-09-16T15:38:50.304 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-09-16T15:38:50.304 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-09-16T15:38:50.304 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 295, 2024-09-16T15:38:50.304 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 295, 2024-09-16T15:38:50.305 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-09-16T15:38:50.305 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-16T15:38:50.305 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-16T15:38:50.305 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-16T15:38:50.305 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-16T15:38:50.305 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.305 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-msgr_dispatch_throttler-client": { 2024-09-16T15:38:50.305 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-09-16T15:38:50.305 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2024-09-16T15:38:50.305 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-09-16T15:38:50.305 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 181, 2024-09-16T15:38:50.305 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 69448, 2024-09-16T15:38:50.305 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-09-16T15:38:50.305 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 181, 2024-09-16T15:38:50.305 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-09-16T15:38:50.306 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-09-16T15:38:50.306 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 181, 2024-09-16T15:38:50.306 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 69448, 2024-09-16T15:38:50.306 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-09-16T15:38:50.306 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-16T15:38:50.306 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-16T15:38:50.306 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-16T15:38:50.306 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-16T15:38:50.306 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.306 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-msgr_dispatch_throttler-client-0x5588131f9220": { 2024-09-16T15:38:50.306 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-09-16T15:38:50.306 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2024-09-16T15:38:50.306 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-09-16T15:38:50.306 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 86, 2024-09-16T15:38:50.306 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 45682, 2024-09-16T15:38:50.306 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-09-16T15:38:50.307 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 86, 2024-09-16T15:38:50.307 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-09-16T15:38:50.307 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-09-16T15:38:50.307 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 86, 2024-09-16T15:38:50.307 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 45682, 2024-09-16T15:38:50.307 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-09-16T15:38:50.307 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-16T15:38:50.307 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-16T15:38:50.307 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-16T15:38:50.307 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-16T15:38:50.307 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.307 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-msgr_dispatch_throttler-client-0x558813e87680": { 2024-09-16T15:38:50.307 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-09-16T15:38:50.307 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2024-09-16T15:38:50.307 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-09-16T15:38:50.308 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 39, 2024-09-16T15:38:50.308 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 21596, 2024-09-16T15:38:50.308 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-09-16T15:38:50.308 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 39, 2024-09-16T15:38:50.308 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-09-16T15:38:50.308 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-09-16T15:38:50.308 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 39, 2024-09-16T15:38:50.308 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 21596, 2024-09-16T15:38:50.308 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-09-16T15:38:50.308 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-16T15:38:50.308 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-16T15:38:50.308 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-16T15:38:50.308 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-16T15:38:50.308 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.309 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-msgr_dispatch_throttler-mgr": { 2024-09-16T15:38:50.309 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-09-16T15:38:50.309 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2024-09-16T15:38:50.309 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-09-16T15:38:50.309 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 345, 2024-09-16T15:38:50.309 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 914849, 2024-09-16T15:38:50.309 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-09-16T15:38:50.309 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 345, 2024-09-16T15:38:50.309 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-09-16T15:38:50.309 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-09-16T15:38:50.309 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 345, 2024-09-16T15:38:50.309 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 914849, 2024-09-16T15:38:50.309 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-09-16T15:38:50.309 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-16T15:38:50.309 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-16T15:38:50.310 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-16T15:38:50.310 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-16T15:38:50.310 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.310 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-msgr_dispatch_throttler-mgr-0x558811d08280": { 2024-09-16T15:38:50.310 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-09-16T15:38:50.310 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2024-09-16T15:38:50.310 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-09-16T15:38:50.310 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 477, 2024-09-16T15:38:50.310 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 5473230, 2024-09-16T15:38:50.310 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-09-16T15:38:50.310 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 477, 2024-09-16T15:38:50.310 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-09-16T15:38:50.310 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-09-16T15:38:50.310 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 477, 2024-09-16T15:38:50.310 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 5473230, 2024-09-16T15:38:50.310 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-09-16T15:38:50.311 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-16T15:38:50.311 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-16T15:38:50.311 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-16T15:38:50.311 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-16T15:38:50.311 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.311 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-msgr_dispatch_throttler-radosclient": { 2024-09-16T15:38:50.311 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-09-16T15:38:50.311 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2024-09-16T15:38:50.311 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-09-16T15:38:50.311 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 111, 2024-09-16T15:38:50.311 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 589407, 2024-09-16T15:38:50.311 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-09-16T15:38:50.311 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 111, 2024-09-16T15:38:50.312 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-09-16T15:38:50.312 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-09-16T15:38:50.312 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 111, 2024-09-16T15:38:50.312 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 589407, 2024-09-16T15:38:50.312 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-09-16T15:38:50.312 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-16T15:38:50.312 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-16T15:38:50.312 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-16T15:38:50.312 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-16T15:38:50.312 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.312 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-msgr_dispatch_throttler-radosclient-0x5588131f8640": { 2024-09-16T15:38:50.312 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-09-16T15:38:50.312 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2024-09-16T15:38:50.313 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-09-16T15:38:50.313 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 11, 2024-09-16T15:38:50.313 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 559755, 2024-09-16T15:38:50.313 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-09-16T15:38:50.313 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 11, 2024-09-16T15:38:50.313 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-09-16T15:38:50.313 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-09-16T15:38:50.313 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 11, 2024-09-16T15:38:50.313 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 559755, 2024-09-16T15:38:50.313 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-09-16T15:38:50.313 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-16T15:38:50.313 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-16T15:38:50.313 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-16T15:38:50.314 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-16T15:38:50.314 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.314 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-msgr_dispatch_throttler-radosclient-0x5588131f88c0": { 2024-09-16T15:38:50.314 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-09-16T15:38:50.314 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2024-09-16T15:38:50.314 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-09-16T15:38:50.314 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 12, 2024-09-16T15:38:50.314 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 559779, 2024-09-16T15:38:50.314 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-09-16T15:38:50.314 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 12, 2024-09-16T15:38:50.314 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-09-16T15:38:50.314 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-09-16T15:38:50.314 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 12, 2024-09-16T15:38:50.314 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 559779, 2024-09-16T15:38:50.314 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-09-16T15:38:50.315 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-16T15:38:50.315 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-16T15:38:50.315 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-16T15:38:50.315 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-16T15:38:50.315 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.315 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-msgr_dispatch_throttler-radosclient-0x5588131f8aa0": { 2024-09-16T15:38:50.315 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-09-16T15:38:50.315 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2024-09-16T15:38:50.315 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-09-16T15:38:50.315 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 10, 2024-09-16T15:38:50.315 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 411370, 2024-09-16T15:38:50.315 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-09-16T15:38:50.315 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 10, 2024-09-16T15:38:50.315 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-09-16T15:38:50.315 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-09-16T15:38:50.316 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 10, 2024-09-16T15:38:50.316 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 411370, 2024-09-16T15:38:50.316 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-09-16T15:38:50.316 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-16T15:38:50.316 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-16T15:38:50.316 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-16T15:38:50.316 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-16T15:38:50.316 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.316 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-objecter_bytes": { 2024-09-16T15:38:50.316 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-09-16T15:38:50.316 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2024-09-16T15:38:50.316 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-09-16T15:38:50.316 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2024-09-16T15:38:50.316 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2024-09-16T15:38:50.317 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-09-16T15:38:50.317 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2024-09-16T15:38:50.317 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-09-16T15:38:50.317 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-09-16T15:38:50.317 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 0, 2024-09-16T15:38:50.317 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 0, 2024-09-16T15:38:50.317 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-09-16T15:38:50.317 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-16T15:38:50.317 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-16T15:38:50.317 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-16T15:38:50.317 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-16T15:38:50.317 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.317 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-objecter_bytes-0x5588131f8280": { 2024-09-16T15:38:50.317 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-09-16T15:38:50.317 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2024-09-16T15:38:50.318 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-09-16T15:38:50.318 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 98, 2024-09-16T15:38:50.318 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 1643087, 2024-09-16T15:38:50.318 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-09-16T15:38:50.318 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 98, 2024-09-16T15:38:50.318 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-09-16T15:38:50.318 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-09-16T15:38:50.318 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 98, 2024-09-16T15:38:50.318 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 1643087, 2024-09-16T15:38:50.318 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-09-16T15:38:50.318 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-16T15:38:50.318 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-16T15:38:50.318 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-16T15:38:50.318 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-16T15:38:50.319 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.319 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-objecter_bytes-0x5588131f85a0": { 2024-09-16T15:38:50.319 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-09-16T15:38:50.319 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2024-09-16T15:38:50.319 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-09-16T15:38:50.319 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2024-09-16T15:38:50.319 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2024-09-16T15:38:50.319 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-09-16T15:38:50.319 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2024-09-16T15:38:50.319 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-09-16T15:38:50.319 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-09-16T15:38:50.319 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 0, 2024-09-16T15:38:50.319 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 0, 2024-09-16T15:38:50.319 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-09-16T15:38:50.319 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-16T15:38:50.320 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-16T15:38:50.320 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-16T15:38:50.320 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-16T15:38:50.320 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.320 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-objecter_bytes-0x5588131f8820": { 2024-09-16T15:38:50.320 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-09-16T15:38:50.320 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2024-09-16T15:38:50.320 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-09-16T15:38:50.320 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2024-09-16T15:38:50.320 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2024-09-16T15:38:50.320 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-09-16T15:38:50.320 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2024-09-16T15:38:50.320 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-09-16T15:38:50.320 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-09-16T15:38:50.321 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 0, 2024-09-16T15:38:50.321 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 0, 2024-09-16T15:38:50.321 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-09-16T15:38:50.321 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-16T15:38:50.321 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-16T15:38:50.321 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-16T15:38:50.321 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-16T15:38:50.321 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.321 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-objecter_bytes-0x5588131f8be0": { 2024-09-16T15:38:50.321 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-09-16T15:38:50.321 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2024-09-16T15:38:50.321 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-09-16T15:38:50.321 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 1, 2024-09-16T15:38:50.321 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2024-09-16T15:38:50.321 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-09-16T15:38:50.322 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 1, 2024-09-16T15:38:50.322 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-09-16T15:38:50.322 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-09-16T15:38:50.322 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 1, 2024-09-16T15:38:50.322 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 0, 2024-09-16T15:38:50.322 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-09-16T15:38:50.322 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-16T15:38:50.322 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-16T15:38:50.322 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-16T15:38:50.322 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-16T15:38:50.322 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.322 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-objecter_bytes-0x5588131f99a0": { 2024-09-16T15:38:50.322 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-09-16T15:38:50.322 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2024-09-16T15:38:50.323 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-09-16T15:38:50.323 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2024-09-16T15:38:50.323 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2024-09-16T15:38:50.323 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-09-16T15:38:50.323 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2024-09-16T15:38:50.323 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-09-16T15:38:50.323 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-09-16T15:38:50.323 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 0, 2024-09-16T15:38:50.323 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 0, 2024-09-16T15:38:50.323 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-09-16T15:38:50.323 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-16T15:38:50.323 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-16T15:38:50.323 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-16T15:38:50.323 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-16T15:38:50.323 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.324 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-objecter_bytes-0x558813e86fa0": { 2024-09-16T15:38:50.324 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-09-16T15:38:50.324 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2024-09-16T15:38:50.324 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-09-16T15:38:50.324 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2024-09-16T15:38:50.324 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2024-09-16T15:38:50.324 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-09-16T15:38:50.324 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2024-09-16T15:38:50.324 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 3, 2024-09-16T15:38:50.324 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 405, 2024-09-16T15:38:50.324 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 3, 2024-09-16T15:38:50.324 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 405, 2024-09-16T15:38:50.324 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-09-16T15:38:50.324 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-16T15:38:50.325 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-16T15:38:50.325 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-16T15:38:50.325 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-16T15:38:50.325 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.325 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-objecter_bytes-0x558813e875e0": { 2024-09-16T15:38:50.325 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-09-16T15:38:50.325 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2024-09-16T15:38:50.325 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-09-16T15:38:50.325 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2024-09-16T15:38:50.325 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2024-09-16T15:38:50.325 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-09-16T15:38:50.325 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2024-09-16T15:38:50.325 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-09-16T15:38:50.326 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-09-16T15:38:50.326 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 0, 2024-09-16T15:38:50.326 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 0, 2024-09-16T15:38:50.326 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-09-16T15:38:50.326 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-16T15:38:50.326 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-16T15:38:50.326 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-16T15:38:50.326 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-16T15:38:50.326 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.326 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-objecter_ops": { 2024-09-16T15:38:50.326 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-09-16T15:38:50.326 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 1024, 2024-09-16T15:38:50.326 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-09-16T15:38:50.326 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2024-09-16T15:38:50.327 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2024-09-16T15:38:50.327 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-09-16T15:38:50.327 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2024-09-16T15:38:50.327 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-09-16T15:38:50.327 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-09-16T15:38:50.327 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 0, 2024-09-16T15:38:50.327 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 0, 2024-09-16T15:38:50.327 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-09-16T15:38:50.327 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-16T15:38:50.327 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-16T15:38:50.327 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-16T15:38:50.327 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-16T15:38:50.327 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.327 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-objecter_ops-0x5588131f8320": { 2024-09-16T15:38:50.327 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-09-16T15:38:50.328 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 1024, 2024-09-16T15:38:50.328 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-09-16T15:38:50.328 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 98, 2024-09-16T15:38:50.328 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 98, 2024-09-16T15:38:50.328 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-09-16T15:38:50.328 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 98, 2024-09-16T15:38:50.328 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-09-16T15:38:50.328 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-09-16T15:38:50.328 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 98, 2024-09-16T15:38:50.328 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 98, 2024-09-16T15:38:50.328 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-09-16T15:38:50.328 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-16T15:38:50.328 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-16T15:38:50.329 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-16T15:38:50.329 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-16T15:38:50.329 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.329 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-objecter_ops-0x5588131f8500": { 2024-09-16T15:38:50.329 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-09-16T15:38:50.329 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 1024, 2024-09-16T15:38:50.329 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-09-16T15:38:50.329 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2024-09-16T15:38:50.329 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2024-09-16T15:38:50.329 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-09-16T15:38:50.329 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2024-09-16T15:38:50.329 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-09-16T15:38:50.329 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-09-16T15:38:50.329 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 0, 2024-09-16T15:38:50.329 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 0, 2024-09-16T15:38:50.330 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-09-16T15:38:50.330 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-16T15:38:50.330 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-16T15:38:50.330 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-16T15:38:50.330 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-16T15:38:50.330 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.330 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-objecter_ops-0x5588131f8780": { 2024-09-16T15:38:50.330 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-09-16T15:38:50.330 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 1024, 2024-09-16T15:38:50.330 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-09-16T15:38:50.330 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2024-09-16T15:38:50.330 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2024-09-16T15:38:50.330 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-09-16T15:38:50.330 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2024-09-16T15:38:50.331 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-09-16T15:38:50.331 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-09-16T15:38:50.331 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 0, 2024-09-16T15:38:50.331 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 0, 2024-09-16T15:38:50.331 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-09-16T15:38:50.331 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-16T15:38:50.331 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-16T15:38:50.331 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-16T15:38:50.331 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-16T15:38:50.331 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.331 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-objecter_ops-0x5588131f9680": { 2024-09-16T15:38:50.331 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-09-16T15:38:50.331 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 1024, 2024-09-16T15:38:50.331 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-09-16T15:38:50.331 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 1, 2024-09-16T15:38:50.331 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 1, 2024-09-16T15:38:50.332 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-09-16T15:38:50.332 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 1, 2024-09-16T15:38:50.332 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-09-16T15:38:50.332 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-09-16T15:38:50.332 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 1, 2024-09-16T15:38:50.332 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 1, 2024-09-16T15:38:50.332 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-09-16T15:38:50.332 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-16T15:38:50.332 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-16T15:38:50.332 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-16T15:38:50.332 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-16T15:38:50.332 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.332 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-objecter_ops-0x558813e86000": { 2024-09-16T15:38:50.332 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-09-16T15:38:50.332 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 1024, 2024-09-16T15:38:50.333 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-09-16T15:38:50.333 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2024-09-16T15:38:50.333 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2024-09-16T15:38:50.333 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-09-16T15:38:50.333 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2024-09-16T15:38:50.333 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-09-16T15:38:50.333 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-09-16T15:38:50.333 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 0, 2024-09-16T15:38:50.333 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 0, 2024-09-16T15:38:50.333 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-09-16T15:38:50.333 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-16T15:38:50.333 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-16T15:38:50.333 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-16T15:38:50.333 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-16T15:38:50.333 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.334 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-objecter_ops-0x558813e86c80": { 2024-09-16T15:38:50.334 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-09-16T15:38:50.334 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 1024, 2024-09-16T15:38:50.334 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-09-16T15:38:50.334 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2024-09-16T15:38:50.334 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2024-09-16T15:38:50.334 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-09-16T15:38:50.334 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2024-09-16T15:38:50.334 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-09-16T15:38:50.334 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-09-16T15:38:50.334 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 0, 2024-09-16T15:38:50.334 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 0, 2024-09-16T15:38:50.334 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-09-16T15:38:50.334 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-16T15:38:50.334 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-16T15:38:50.335 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-16T15:38:50.335 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-16T15:38:50.335 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.335 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-objecter_ops-0x558813e87040": { 2024-09-16T15:38:50.335 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-09-16T15:38:50.335 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 1024, 2024-09-16T15:38:50.335 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-09-16T15:38:50.335 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2024-09-16T15:38:50.335 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2024-09-16T15:38:50.335 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-09-16T15:38:50.335 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2024-09-16T15:38:50.335 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 3, 2024-09-16T15:38:50.335 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 3, 2024-09-16T15:38:50.335 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 3, 2024-09-16T15:38:50.335 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 3, 2024-09-16T15:38:50.336 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-09-16T15:38:50.336 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-16T15:38:50.336 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-16T15:38:50.336 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-16T15:38:50.336 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-16T15:38:50.336 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-16T15:38:50.336 INFO:teuthology.orchestra.run.smithi135.stdout: "trackedop": { 2024-09-16T15:38:50.336 INFO:teuthology.orchestra.run.smithi135.stdout: "slow_ops_count": 0 2024-09-16T15:38:50.336 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-16T15:38:50.336 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-16T15:38:50.338 INFO:tasks.check_counter:Daemon mgr.x finisher-volumes.complete_latency.avgcount=9 2024-09-16T15:38:50.338 INFO:tasks.check_counter:Daemon mgr.x finisher-volumes.queue_len=0 2024-09-16T15:38:50.338 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-16T15:38:50.347 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-16T15:38:50.348 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-16T15:38:50.348 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T15:38:50.367 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056023,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497456k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2510 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248724k,nr_inodes=812181,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497456k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-16T15:38:50.367 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-16T15:38:50.367 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T15:38:50.425 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056023,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497456k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2510 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248724k,nr_inodes=812181,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497456k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-16T15:38:50.425 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-16T15:38:50.425 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T15:38:50.442 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=1994704,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=3199348k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18836 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1599672k,nr_inodes=399918,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=3199348k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-16T15:38:50.442 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-16T15:38:50.442 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T15:38:50.498 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=1994704,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=3199348k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18836 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1599672k,nr_inodes=399918,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=3199348k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-16T15:38:50.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T15:38:50.498 DEBUG:teuthology.orchestra.run.smithi098:> ip netns list 2024-09-16T15:38:50.516 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-16T15:38:50.516 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-16T15:38:50.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T15:38:50.516 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-16T15:38:50.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T15:38:50.586 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-16T15:38:50.654 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T15:38:50.654 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link delete ceph-brx 2024-09-16T15:38:50.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T15:38:50.758 DEBUG:teuthology.orchestra.run.smithi098:> ip netns list 2024-09-16T15:38:50.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T15:38:50.775 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link delete ceph-brx 2024-09-16T15:38:50.843 INFO:teuthology.orchestra.run.smithi098.stderr:Cannot find device "ceph-brx" 2024-09-16T15:38:50.845 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T15:38:50.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T15:38:50.845 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list 2024-09-16T15:38:50.862 INFO:teuthology.orchestra.run.smithi135.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-16T15:38:50.862 INFO:teuthology.orchestra.run.smithi135.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-16T15:38:50.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T15:38:50.862 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-16T15:38:50.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T15:38:50.929 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-16T15:38:50.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T15:38:50.995 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link delete ceph-brx 2024-09-16T15:38:51.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T15:38:51.096 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list 2024-09-16T15:38:51.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T15:38:51.111 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link delete ceph-brx 2024-09-16T15:38:51.179 INFO:teuthology.orchestra.run.smithi135.stderr:Cannot find device "ceph-brx" 2024-09-16T15:38:51.181 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T15:38:51.181 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-16T15:38:51.190 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-16T15:38:51.190 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T15:38:51.295 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.293+0000 7fb177e57640 1 -- 172.21.15.98:0/3439640183 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb1700b3f00 msgr2=0x7fb1700b43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:51.295 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.293+0000 7fb177e57640 1 --2- 172.21.15.98:0/3439640183 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb1700b3f00 0x7fb1700b43b0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fb168005fd0 tx=0x7fb16802a5d0 comp rx=0 tx=0).stop 2024-09-16T15:38:51.295 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.293+0000 7fb177e57640 1 -- 172.21.15.98:0/3439640183 shutdown_connections 2024-09-16T15:38:51.295 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.293+0000 7fb177e57640 1 --2- 172.21.15.98:0/3439640183 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb1700b3f00 0x7fb1700b43b0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:51.295 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.293+0000 7fb177e57640 1 --2- 172.21.15.98:0/3439640183 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb1701438b0 0x7fb17006ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:51.295 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.293+0000 7fb177e57640 1 -- 172.21.15.98:0/3439640183 >> 172.21.15.98:0/3439640183 conn(0x7fb1700b1950 msgr2=0x7fb1700b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:51.295 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.293+0000 7fb177e57640 1 -- 172.21.15.98:0/3439640183 shutdown_connections 2024-09-16T15:38:51.296 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.293+0000 7fb177e57640 1 -- 172.21.15.98:0/3439640183 wait complete. 2024-09-16T15:38:51.296 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.294+0000 7fb177e57640 1 Processor -- start 2024-09-16T15:38:51.296 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.294+0000 7fb177e57640 1 -- start start 2024-09-16T15:38:51.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.295+0000 7fb177e57640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb170070920 0x7fb1700afe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:51.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.295+0000 7fb177e57640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb1700b3f00 0x7fb17015a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:51.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.295+0000 7fb177e57640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb1701438b0 0x7fb170159be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:51.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.295+0000 7fb177e57640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb1700b4df0 con 0x7fb1700b3f00 2024-09-16T15:38:51.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.295+0000 7fb177e57640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb1700b4c70 con 0x7fb170070920 2024-09-16T15:38:51.299 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.295+0000 7fb177e57640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fb1700b4f70 con 0x7fb1701438b0 2024-09-16T15:38:51.299 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.295+0000 7fb1753f2640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb1700b3f00 0x7fb17015a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:51.299 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.295+0000 7fb1753f2640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb1700b3f00 0x7fb17015a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60194/0 (socket says 172.21.15.98:60194) 2024-09-16T15:38:51.299 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.295+0000 7fb1753f2640 1 -- 172.21.15.98:0/856930825 learned_addr learned my addr 172.21.15.98:0/856930825 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:51.299 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.295+0000 7fb1763f4640 1 --2- 172.21.15.98:0/856930825 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb1701438b0 0x7fb170159be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:51.299 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.295+0000 7fb175bf3640 1 --2- 172.21.15.98:0/856930825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb170070920 0x7fb1700afe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:51.299 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.295+0000 7fb1753f2640 1 -- 172.21.15.98:0/856930825 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb1701438b0 msgr2=0x7fb170159be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:51.299 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.295+0000 7fb1753f2640 1 --2- 172.21.15.98:0/856930825 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb1701438b0 0x7fb170159be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:51.299 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.295+0000 7fb1753f2640 1 -- 172.21.15.98:0/856930825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb170070920 msgr2=0x7fb1700afe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:51.299 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.295+0000 7fb1753f2640 1 --2- 172.21.15.98:0/856930825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb170070920 0x7fb1700afe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:51.299 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.295+0000 7fb1753f2640 1 -- 172.21.15.98:0/856930825 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb17015abb0 con 0x7fb1700b3f00 2024-09-16T15:38:51.299 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.296+0000 7fb1753f2640 1 --2- 172.21.15.98:0/856930825 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb1700b3f00 0x7fb17015a670 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fb16000d750 tx=0x7fb16000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:51.299 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.296+0000 7fb1667fc640 1 -- 172.21.15.98:0/856930825 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb160017070 con 0x7fb1700b3f00 2024-09-16T15:38:51.299 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.296+0000 7fb1667fc640 1 -- 172.21.15.98:0/856930825 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb160009b20 con 0x7fb1700b3f00 2024-09-16T15:38:51.300 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.296+0000 7fb177e57640 1 -- 172.21.15.98:0/856930825 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb17015a120 con 0x7fb1700b3f00 2024-09-16T15:38:51.300 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.296+0000 7fb1667fc640 1 -- 172.21.15.98:0/856930825 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb160010460 con 0x7fb1700b3f00 2024-09-16T15:38:51.300 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.296+0000 7fb177e57640 1 -- 172.21.15.98:0/856930825 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1700cb970 con 0x7fb1700b3f00 2024-09-16T15:38:51.300 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.297+0000 7fb177e57640 1 -- 172.21.15.98:0/856930825 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1700b43b0 con 0x7fb1700b3f00 2024-09-16T15:38:51.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.298+0000 7fb1667fc640 1 -- 172.21.15.98:0/856930825 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 7) ==== 101440+0+0 (secure 0 0 0) 0x7fb16001a070 con 0x7fb1700b3f00 2024-09-16T15:38:51.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.298+0000 7fb1667fc640 1 --2- 172.21.15.98:0/856930825 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fb154078a30 0x7fb15407aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:51.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.298+0000 7fb1667fc640 1 -- 172.21.15.98:0/856930825 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7fb16009aa30 con 0x7fb1700b3f00 2024-09-16T15:38:51.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.298+0000 7fb175bf3640 1 --2- 172.21.15.98:0/856930825 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fb154078a30 0x7fb15407aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:51.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.299+0000 7fb175bf3640 1 --2- 172.21.15.98:0/856930825 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fb154078a30 0x7fb15407aef0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb170072af0 tx=0x7fb16c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:51.304 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.302+0000 7fb1667fc640 1 -- 172.21.15.98:0/856930825 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7fb17015abb0 con 0x7fb1700b3f00 2024-09-16T15:38:51.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.475+0000 7fb177e57640 1 -- 172.21.15.98:0/856930825 --> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb17015da80 con 0x7fb154078a30 2024-09-16T15:38:51.478 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.476+0000 7fb1667fc640 1 -- 172.21.15.98:0/856930825 <== mgr.4100 v2:172.21.15.135:6800/699234772 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13479 (secure 0 0 0) 0x7fb17015da80 con 0x7fb154078a30 2024-09-16T15:38:51.478 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:38:51.478 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2024-09-16T15:38:51.480 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.478+0000 7fb177e57640 1 -- 172.21.15.98:0/856930825 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fb154078a30 msgr2=0x7fb15407aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:51.481 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.478+0000 7fb177e57640 1 --2- 172.21.15.98:0/856930825 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fb154078a30 0x7fb15407aef0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb170072af0 tx=0x7fb16c009040 comp rx=0 tx=0).stop 2024-09-16T15:38:51.481 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.478+0000 7fb177e57640 1 -- 172.21.15.98:0/856930825 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb1700b3f00 msgr2=0x7fb17015a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:51.481 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.478+0000 7fb177e57640 1 --2- 172.21.15.98:0/856930825 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb1700b3f00 0x7fb17015a670 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fb16000d750 tx=0x7fb16000dc10 comp rx=0 tx=0).stop 2024-09-16T15:38:51.481 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.478+0000 7fb177e57640 1 -- 172.21.15.98:0/856930825 shutdown_connections 2024-09-16T15:38:51.481 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.478+0000 7fb177e57640 1 --2- 172.21.15.98:0/856930825 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb1701438b0 0x7fb170159be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:51.481 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.478+0000 7fb177e57640 1 --2- 172.21.15.98:0/856930825 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb1700b3f00 0x7fb17015a670 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:51.481 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.478+0000 7fb177e57640 1 --2- 172.21.15.98:0/856930825 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fb154078a30 0x7fb15407aef0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:51.481 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.478+0000 7fb177e57640 1 --2- 172.21.15.98:0/856930825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb170070920 0x7fb1700afe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:51.481 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.478+0000 7fb177e57640 1 -- 172.21.15.98:0/856930825 >> 172.21.15.98:0/856930825 conn(0x7fb1700b1950 msgr2=0x7fb1700cf230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:51.481 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.478+0000 7fb177e57640 1 -- 172.21.15.98:0/856930825 shutdown_connections 2024-09-16T15:38:51.481 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.478+0000 7fb177e57640 1 -- 172.21.15.98:0/856930825 wait complete. 2024-09-16T15:38:51.491 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":70,"stamp":"2024-09-16T15:38:50.723902+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":140,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":220668,"kb_used_data":4440,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754052,"statfs":{"total":773094113280,"available":772868149248,"internally_reserved":0,"allocated":4546560,"data_stored":2471843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-133956,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-3,"num_read_kb":-3,"num_write":-100,"num_write_kb":-173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.651769"},"pg_stats":[{"pgid":"1.0","version":"18'72","reported_seq":137,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T15:38:47.630781+0000","last_change":"2024-09-16T15:37:37.258601+0000","last_active":"2024-09-16T15:38:47.630781+0000","last_peered":"2024-09-16T15:38:47.630781+0000","last_clean":"2024-09-16T15:38:47.630781+0000","last_became_active":"2024-09-16T15:37:37.257584+0000","last_became_peered":"2024-09-16T15:37:37.257584+0000","last_unstale":"2024-09-16T15:38:47.630781+0000","last_undegraded":"2024-09-16T15:38:47.630781+0000","last_fullsized":"2024-09-16T15:38:47.630781+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:35.447043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:35.447043+0000","last_clean_scrub_stamp":"2024-09-16T15:37:35.447043+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:43:17.464894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509459,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27440,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":421888,"data_stored":162084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509459,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28020,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343820,"statfs":{"total":96636764160,"available":96608071680,"internally_reserved":0,"allocated":1015808,"data_stored":752452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509460,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27440,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":421888,"data_stored":162084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509460,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27440,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":421888,"data_stored":162084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509459,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27440,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":421888,"data_stored":162084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509460,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28024,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343816,"statfs":{"total":96636764160,"available":96608067584,"internally_reserved":0,"allocated":1015808,"data_stored":752452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509458,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27440,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":421888,"data_stored":162084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":405504,"data_stored":156519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T15:38:51.492 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T15:38:51.593 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.590+0000 7ffa86efe640 1 -- 172.21.15.98:0/2746120673 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa68004d40 msgr2=0x7ffa680051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:51.593 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.590+0000 7ffa86efe640 1 --2- 172.21.15.98:0/2746120673 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa68004d40 0x7ffa680051c0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7ffa78009ed0 tx=0x7ffa68005830 comp rx=0 tx=0).stop 2024-09-16T15:38:51.593 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.591+0000 7ffa8549b640 1 -- 172.21.15.98:0/2746120673 reap_dead start 2024-09-16T15:38:51.593 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.591+0000 7ffa86efe640 1 -- 172.21.15.98:0/2746120673 shutdown_connections 2024-09-16T15:38:51.593 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.591+0000 7ffa86efe640 1 -- 172.21.15.98:0/2746120673 >> 172.21.15.98:0/2746120673 conn(0x7ffa800b1950 msgr2=0x7ffa800b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:51.593 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.591+0000 7ffa86efe640 1 -- 172.21.15.98:0/2746120673 shutdown_connections 2024-09-16T15:38:51.593 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.591+0000 7ffa86efe640 1 -- 172.21.15.98:0/2746120673 wait complete. 2024-09-16T15:38:51.594 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.592+0000 7ffa86efe640 1 Processor -- start 2024-09-16T15:38:51.594 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.592+0000 7ffa86efe640 1 -- start start 2024-09-16T15:38:51.596 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.593+0000 7ffa86efe640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffa800ae250 0x7ffa800cb150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:51.596 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.593+0000 7ffa86efe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa801f83d0 0x7ffa801f5650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:51.596 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.593+0000 7ffa86efe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa801f5b90 0x7ffa800c90f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:51.596 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.593+0000 7ffa86efe640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ffa800cc820 con 0x7ffa801f5b90 2024-09-16T15:38:51.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.593+0000 7ffa86efe640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ffa800cc6a0 con 0x7ffa801f83d0 2024-09-16T15:38:51.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.593+0000 7ffa86efe640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7ffa800cc9a0 con 0x7ffa800ae250 2024-09-16T15:38:51.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.593+0000 7ffa8549b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa801f5b90 0x7ffa800c90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:51.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.593+0000 7ffa8549b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa801f5b90 0x7ffa800c90f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60216/0 (socket says 172.21.15.98:60216) 2024-09-16T15:38:51.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.593+0000 7ffa8549b640 1 -- 172.21.15.98:0/1209351897 learned_addr learned my addr 172.21.15.98:0/1209351897 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:51.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.593+0000 7ffa84c9a640 1 --2- 172.21.15.98:0/1209351897 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffa800ae250 0x7ffa800cb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:51.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.593+0000 7ffa7ffff640 1 --2- 172.21.15.98:0/1209351897 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa801f83d0 0x7ffa801f5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:51.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.593+0000 7ffa8549b640 1 -- 172.21.15.98:0/1209351897 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffa800ae250 msgr2=0x7ffa800cb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:51.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.593+0000 7ffa8549b640 1 --2- 172.21.15.98:0/1209351897 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffa800ae250 0x7ffa800cb150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:51.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.593+0000 7ffa8549b640 1 -- 172.21.15.98:0/1209351897 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa801f83d0 msgr2=0x7ffa801f5650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:51.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.593+0000 7ffa8549b640 1 --2- 172.21.15.98:0/1209351897 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa801f83d0 0x7ffa801f5650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:51.598 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.593+0000 7ffa8549b640 1 -- 172.21.15.98:0/1209351897 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa800ae630 con 0x7ffa801f5b90 2024-09-16T15:38:51.598 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.593+0000 7ffa7ffff640 1 --2- 172.21.15.98:0/1209351897 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa801f83d0 0x7ffa801f5650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T15:38:51.598 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.593+0000 7ffa8549b640 1 --2- 172.21.15.98:0/1209351897 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa801f5b90 0x7ffa800c90f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ffa78036040 tx=0x7ffa78033c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:51.598 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.593+0000 7ffa7d7fa640 1 -- 172.21.15.98:0/1209351897 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa78043070 con 0x7ffa801f5b90 2024-09-16T15:38:51.598 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.593+0000 7ffa7d7fa640 1 -- 172.21.15.98:0/1209351897 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffa78033d20 con 0x7ffa801f5b90 2024-09-16T15:38:51.598 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.593+0000 7ffa7d7fa640 1 -- 172.21.15.98:0/1209351897 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa78038040 con 0x7ffa801f5b90 2024-09-16T15:38:51.598 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.593+0000 7ffa86efe640 1 -- 172.21.15.98:0/1209351897 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa801f8c60 con 0x7ffa801f5b90 2024-09-16T15:38:51.598 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.593+0000 7ffa86efe640 1 -- 172.21.15.98:0/1209351897 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa801f9220 con 0x7ffa801f5b90 2024-09-16T15:38:51.598 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.594+0000 7ffa86efe640 1 -- 172.21.15.98:0/1209351897 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa800b3bf0 con 0x7ffa801f5b90 2024-09-16T15:38:51.599 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.595+0000 7ffa7d7fa640 1 -- 172.21.15.98:0/1209351897 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 7) ==== 101440+0+0 (secure 0 0 0) 0x7ffa78003bd0 con 0x7ffa801f5b90 2024-09-16T15:38:51.599 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.595+0000 7ffa7d7fa640 1 --2- 172.21.15.98:0/1209351897 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7ffa6c078a00 0x7ffa6c07aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:51.599 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.596+0000 7ffa7d7fa640 1 -- 172.21.15.98:0/1209351897 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7ffa780ba4c0 con 0x7ffa801f5b90 2024-09-16T15:38:51.599 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.596+0000 7ffa84c9a640 1 --2- 172.21.15.98:0/1209351897 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7ffa6c078a00 0x7ffa6c07aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:51.599 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.596+0000 7ffa84c9a640 1 --2- 172.21.15.98:0/1209351897 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7ffa6c078a00 0x7ffa6c07aec0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ffa801f61a0 tx=0x7ffa70006950 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:51.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.600+0000 7ffa7d7fa640 1 -- 172.21.15.98:0/1209351897 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7ffa800b3bf0 con 0x7ffa801f5b90 2024-09-16T15:38:51.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.774+0000 7ffa86efe640 1 -- 172.21.15.98:0/1209351897 --> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ffa800b47d0 con 0x7ffa6c078a00 2024-09-16T15:38:51.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.774+0000 7ffa7d7fa640 1 -- 172.21.15.98:0/1209351897 <== mgr.4100 v2:172.21.15.135:6800/699234772 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13479 (secure 0 0 0) 0x7ffa800b47d0 con 0x7ffa6c078a00 2024-09-16T15:38:51.776 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:38:51.777 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2024-09-16T15:38:51.779 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.776+0000 7ffa86efe640 1 -- 172.21.15.98:0/1209351897 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7ffa6c078a00 msgr2=0x7ffa6c07aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:51.779 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.776+0000 7ffa86efe640 1 --2- 172.21.15.98:0/1209351897 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7ffa6c078a00 0x7ffa6c07aec0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ffa801f61a0 tx=0x7ffa70006950 comp rx=0 tx=0).stop 2024-09-16T15:38:51.779 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.776+0000 7ffa86efe640 1 -- 172.21.15.98:0/1209351897 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa801f5b90 msgr2=0x7ffa800c90f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:51.779 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.776+0000 7ffa86efe640 1 --2- 172.21.15.98:0/1209351897 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa801f5b90 0x7ffa800c90f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ffa78036040 tx=0x7ffa78033c30 comp rx=0 tx=0).stop 2024-09-16T15:38:51.779 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.776+0000 7ffa86efe640 1 -- 172.21.15.98:0/1209351897 shutdown_connections 2024-09-16T15:38:51.779 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.776+0000 7ffa86efe640 1 --2- 172.21.15.98:0/1209351897 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa801f5b90 0x7ffa800c90f0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:51.779 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.776+0000 7ffa86efe640 1 --2- 172.21.15.98:0/1209351897 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7ffa6c078a00 0x7ffa6c07aec0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:51.779 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.776+0000 7ffa86efe640 1 --2- 172.21.15.98:0/1209351897 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa801f83d0 0x7ffa801f5650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:51.779 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.776+0000 7ffa86efe640 1 --2- 172.21.15.98:0/1209351897 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7ffa800ae250 0x7ffa800cb150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:51.779 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.776+0000 7ffa86efe640 1 -- 172.21.15.98:0/1209351897 >> 172.21.15.98:0/1209351897 conn(0x7ffa800b1950 msgr2=0x7ffa800735c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:51.779 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.777+0000 7ffa86efe640 1 -- 172.21.15.98:0/1209351897 shutdown_connections 2024-09-16T15:38:51.780 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.777+0000 7ffa86efe640 1 -- 172.21.15.98:0/1209351897 wait complete. 2024-09-16T15:38:51.789 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":70,"stamp":"2024-09-16T15:38:50.723902+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":140,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":220668,"kb_used_data":4440,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754052,"statfs":{"total":773094113280,"available":772868149248,"internally_reserved":0,"allocated":4546560,"data_stored":2471843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-133956,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-3,"num_read_kb":-3,"num_write":-100,"num_write_kb":-173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.651769"},"pg_stats":[{"pgid":"1.0","version":"18'72","reported_seq":137,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T15:38:47.630781+0000","last_change":"2024-09-16T15:37:37.258601+0000","last_active":"2024-09-16T15:38:47.630781+0000","last_peered":"2024-09-16T15:38:47.630781+0000","last_clean":"2024-09-16T15:38:47.630781+0000","last_became_active":"2024-09-16T15:37:37.257584+0000","last_became_peered":"2024-09-16T15:37:37.257584+0000","last_unstale":"2024-09-16T15:38:47.630781+0000","last_undegraded":"2024-09-16T15:38:47.630781+0000","last_fullsized":"2024-09-16T15:38:47.630781+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:35.447043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:35.447043+0000","last_clean_scrub_stamp":"2024-09-16T15:37:35.447043+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:43:17.464894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509459,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27440,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":421888,"data_stored":162084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509459,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28020,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343820,"statfs":{"total":96636764160,"available":96608071680,"internally_reserved":0,"allocated":1015808,"data_stored":752452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509460,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27440,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":421888,"data_stored":162084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509460,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27440,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":421888,"data_stored":162084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509459,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27440,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":421888,"data_stored":162084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509460,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28024,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343816,"statfs":{"total":96636764160,"available":96608067584,"internally_reserved":0,"allocated":1015808,"data_stored":752452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509458,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27440,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":421888,"data_stored":162084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":405504,"data_stored":156519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T15:38:51.790 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-16T15:38:51.790 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T15:38:51.890 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.888+0000 7f1a174bd640 1 -- 172.21.15.98:0/986995509 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a1015f5a0 msgr2=0x7f1a100b2440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:51.890 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.888+0000 7f1a174bd640 1 --2- 172.21.15.98:0/986995509 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a1015f5a0 0x7f1a100b2440 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1a00005fd0 tx=0x7f1a0002aa10 comp rx=0 tx=0).stop 2024-09-16T15:38:51.890 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.888+0000 7f1a174bd640 1 -- 172.21.15.98:0/986995509 shutdown_connections 2024-09-16T15:38:51.890 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.888+0000 7f1a174bd640 1 --2- 172.21.15.98:0/986995509 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1a100ccf00 0x7f1a100acd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:51.890 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.888+0000 7f1a174bd640 1 --2- 172.21.15.98:0/986995509 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a1015f5a0 0x7f1a100b2440 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:51.891 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.888+0000 7f1a174bd640 1 -- 172.21.15.98:0/986995509 >> 172.21.15.98:0/986995509 conn(0x7f1a100b1950 msgr2=0x7f1a100b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:51.891 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.888+0000 7f1a174bd640 1 -- 172.21.15.98:0/986995509 shutdown_connections 2024-09-16T15:38:51.891 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.888+0000 7f1a174bd640 1 -- 172.21.15.98:0/986995509 wait complete. 2024-09-16T15:38:51.891 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.889+0000 7f1a174bd640 1 Processor -- start 2024-09-16T15:38:51.891 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.889+0000 7f1a174bd640 1 -- start start 2024-09-16T15:38:51.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.890+0000 7f1a174bd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a100ad270 0x7f1a1014ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:51.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.890+0000 7f1a174bd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1a100ccf00 0x7f1a101520d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:51.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.890+0000 7f1a174bd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1a1015f5a0 0x7f1a10152610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:51.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.890+0000 7f1a174bd640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1a1006f2e0 con 0x7f1a1015f5a0 2024-09-16T15:38:51.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.890+0000 7f1a174bd640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1a1006f160 con 0x7f1a100ad270 2024-09-16T15:38:51.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.890+0000 7f1a174bd640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f1a1006f460 con 0x7f1a100ccf00 2024-09-16T15:38:51.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.890+0000 7f1a15a5a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1a1015f5a0 0x7f1a10152610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:51.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.890+0000 7f1a15a5a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1a1015f5a0 0x7f1a10152610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60222/0 (socket says 172.21.15.98:60222) 2024-09-16T15:38:51.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.890+0000 7f1a15a5a640 1 -- 172.21.15.98:0/2297476994 learned_addr learned my addr 172.21.15.98:0/2297476994 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:51.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.890+0000 7f1a14a58640 1 --2- 172.21.15.98:0/2297476994 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1a100ccf00 0x7f1a101520d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:51.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.890+0000 7f1a15259640 1 --2- 172.21.15.98:0/2297476994 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a100ad270 0x7f1a1014ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:51.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.891+0000 7f1a15a5a640 1 -- 172.21.15.98:0/2297476994 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1a100ccf00 msgr2=0x7f1a101520d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:51.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.891+0000 7f1a15a5a640 1 --2- 172.21.15.98:0/2297476994 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1a100ccf00 0x7f1a101520d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:51.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.891+0000 7f1a15a5a640 1 -- 172.21.15.98:0/2297476994 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a100ad270 msgr2=0x7f1a1014ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:51.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.891+0000 7f1a15a5a640 1 --2- 172.21.15.98:0/2297476994 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a100ad270 0x7f1a1014ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:51.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.891+0000 7f1a15a5a640 1 -- 172.21.15.98:0/2297476994 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a1014fc30 con 0x7f1a1015f5a0 2024-09-16T15:38:51.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.891+0000 7f1a14a58640 1 --2- 172.21.15.98:0/2297476994 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1a100ccf00 0x7f1a101520d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T15:38:51.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.891+0000 7f1a15a5a640 1 --2- 172.21.15.98:0/2297476994 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1a1015f5a0 0x7f1a10152610 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f1a0800c400 tx=0x7f1a0800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:51.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.891+0000 7f1a0dffb640 1 -- 172.21.15.98:0/2297476994 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a08017070 con 0x7f1a1015f5a0 2024-09-16T15:38:51.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.891+0000 7f1a0dffb640 1 -- 172.21.15.98:0/2297476994 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1a080053c0 con 0x7f1a1015f5a0 2024-09-16T15:38:51.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.891+0000 7f1a174bd640 1 -- 172.21.15.98:0/2297476994 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a101f6730 con 0x7f1a1015f5a0 2024-09-16T15:38:51.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.891+0000 7f1a0dffb640 1 -- 172.21.15.98:0/2297476994 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a08003850 con 0x7f1a1015f5a0 2024-09-16T15:38:51.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.891+0000 7f1a174bd640 1 -- 172.21.15.98:0/2297476994 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a1014d4f0 con 0x7f1a1015f5a0 2024-09-16T15:38:51.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.892+0000 7f1a174bd640 1 -- 172.21.15.98:0/2297476994 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a1006f9f0 con 0x7f1a1015f5a0 2024-09-16T15:38:51.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.893+0000 7f1a0dffb640 1 -- 172.21.15.98:0/2297476994 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 7) ==== 101440+0+0 (secure 0 0 0) 0x7f1a0801a070 con 0x7f1a1015f5a0 2024-09-16T15:38:51.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.893+0000 7f1a0dffb640 1 --2- 172.21.15.98:0/2297476994 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f19fc078a30 0x7f19fc07aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:51.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.893+0000 7f1a0dffb640 1 -- 172.21.15.98:0/2297476994 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f1a08099bd0 con 0x7f1a1015f5a0 2024-09-16T15:38:51.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.894+0000 7f1a15259640 1 --2- 172.21.15.98:0/2297476994 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f19fc078a30 0x7f19fc07aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:51.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.894+0000 7f1a15259640 1 --2- 172.21.15.98:0/2297476994 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f19fc078a30 0x7f19fc07aef0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1a00035000 tx=0x7f1a0003b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:51.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:51.897+0000 7f1a0dffb640 1 -- 172.21.15.98:0/2297476994 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7f1a08061ca0 con 0x7f1a1015f5a0 2024-09-16T15:38:52.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:52.070+0000 7f1a174bd640 1 -- 172.21.15.98:0/2297476994 --> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1a1014cf90 con 0x7f19fc078a30 2024-09-16T15:38:52.073 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:52.071+0000 7f1a0dffb640 1 -- 172.21.15.98:0/2297476994 <== mgr.4100 v2:172.21.15.135:6800/699234772 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13479 (secure 0 0 0) 0x7f1a1014cf90 con 0x7f19fc078a30 2024-09-16T15:38:52.073 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:38:52.073 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2024-09-16T15:38:52.075 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:52.073+0000 7f1a174bd640 1 -- 172.21.15.98:0/2297476994 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f19fc078a30 msgr2=0x7f19fc07aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:52.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:52.073+0000 7f1a174bd640 1 --2- 172.21.15.98:0/2297476994 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f19fc078a30 0x7f19fc07aef0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1a00035000 tx=0x7f1a0003b040 comp rx=0 tx=0).stop 2024-09-16T15:38:52.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:52.073+0000 7f1a174bd640 1 -- 172.21.15.98:0/2297476994 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1a1015f5a0 msgr2=0x7f1a10152610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:52.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:52.073+0000 7f1a174bd640 1 --2- 172.21.15.98:0/2297476994 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1a1015f5a0 0x7f1a10152610 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f1a0800c400 tx=0x7f1a0800c8c0 comp rx=0 tx=0).stop 2024-09-16T15:38:52.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:52.073+0000 7f1a174bd640 1 -- 172.21.15.98:0/2297476994 shutdown_connections 2024-09-16T15:38:52.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:52.073+0000 7f1a174bd640 1 --2- 172.21.15.98:0/2297476994 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1a1015f5a0 0x7f1a10152610 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:52.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:52.073+0000 7f1a174bd640 1 --2- 172.21.15.98:0/2297476994 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1a100ccf00 0x7f1a101520d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:52.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:52.073+0000 7f1a174bd640 1 --2- 172.21.15.98:0/2297476994 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f19fc078a30 0x7f19fc07aef0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:52.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:52.073+0000 7f1a174bd640 1 --2- 172.21.15.98:0/2297476994 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a100ad270 0x7f1a1014ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:52.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:52.073+0000 7f1a174bd640 1 -- 172.21.15.98:0/2297476994 >> 172.21.15.98:0/2297476994 conn(0x7f1a100b1950 msgr2=0x7f1a100b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:52.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:52.073+0000 7f1a174bd640 1 -- 172.21.15.98:0/2297476994 shutdown_connections 2024-09-16T15:38:52.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:52.073+0000 7f1a174bd640 1 -- 172.21.15.98:0/2297476994 wait complete. 2024-09-16T15:38:52.086 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":70,"stamp":"2024-09-16T15:38:50.723902+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":140,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":220668,"kb_used_data":4440,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754052,"statfs":{"total":773094113280,"available":772868149248,"internally_reserved":0,"allocated":4546560,"data_stored":2471843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-133956,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-3,"num_read_kb":-3,"num_write":-100,"num_write_kb":-173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.651769"},"pg_stats":[{"pgid":"1.0","version":"18'72","reported_seq":137,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T15:38:47.630781+0000","last_change":"2024-09-16T15:37:37.258601+0000","last_active":"2024-09-16T15:38:47.630781+0000","last_peered":"2024-09-16T15:38:47.630781+0000","last_clean":"2024-09-16T15:38:47.630781+0000","last_became_active":"2024-09-16T15:37:37.257584+0000","last_became_peered":"2024-09-16T15:37:37.257584+0000","last_unstale":"2024-09-16T15:38:47.630781+0000","last_undegraded":"2024-09-16T15:38:47.630781+0000","last_fullsized":"2024-09-16T15:38:47.630781+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:35.447043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:35.447043+0000","last_clean_scrub_stamp":"2024-09-16T15:37:35.447043+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:43:17.464894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509459,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27440,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":421888,"data_stored":162084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509459,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28020,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343820,"statfs":{"total":96636764160,"available":96608071680,"internally_reserved":0,"allocated":1015808,"data_stored":752452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509460,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27440,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":421888,"data_stored":162084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509460,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27440,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":421888,"data_stored":162084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509459,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27440,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":421888,"data_stored":162084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509460,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28024,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343816,"statfs":{"total":96636764160,"available":96608067584,"internally_reserved":0,"allocated":1015808,"data_stored":752452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509458,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27440,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":421888,"data_stored":162084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":405504,"data_stored":156519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T15:38:52.087 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T15:38:52.188 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:52.186+0000 7fd9a7447640 1 -- 172.21.15.98:0/2332545412 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd9a00ccf00 msgr2=0x7fd9a00b2440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:52.188 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:52.186+0000 7fd9a7447640 1 --2- 172.21.15.98:0/2332545412 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd9a00ccf00 0x7fd9a00b2440 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fd9a006dac0 tx=0x7fd99002a4a0 comp rx=0 tx=0).stop 2024-09-16T15:38:52.188 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:52.186+0000 7fd9a7447640 1 -- 172.21.15.98:0/2332545412 shutdown_connections 2024-09-16T15:38:52.188 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:52.186+0000 7fd9a7447640 1 --2- 172.21.15.98:0/2332545412 >> v2:172.21.15.135:3300/0 conn(0x7fd9a0073fb0 0x7fd9a0074420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:52.189 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:52.186+0000 7fd9a7447640 1 --2- 172.21.15.98:0/2332545412 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd9a00ccf00 0x7fd9a00b2440 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:52.189 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:52.186+0000 7fd9a7447640 1 -- 172.21.15.98:0/2332545412 >> 172.21.15.98:0/2332545412 conn(0x7fd9a00b1950 msgr2=0x7fd9a00b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:52.189 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:52.186+0000 7fd9a7447640 1 -- 172.21.15.98:0/2332545412 shutdown_connections 2024-09-16T15:38:52.189 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:52.186+0000 7fd9a7447640 1 -- 172.21.15.98:0/2332545412 wait complete. 2024-09-16T15:38:52.189 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:52.187+0000 7fd9a7447640 1 Processor -- start 2024-09-16T15:38:52.189 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:52.187+0000 7fd9a7447640 1 -- start start 2024-09-16T15:38:52.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:52.188+0000 7fd9a7447640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9a0073fb0 0x7fd9a0158fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:52.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:52.188+0000 7fd9a7447640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9a00ccf00 0x7fd9a014c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:52.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:52.188+0000 7fd9a7447640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd9a015f5a0 0x7fd9a01f26e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:52.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:52.188+0000 7fd9a7447640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd9a006f2e0 con 0x7fd9a015f5a0 2024-09-16T15:38:52.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:52.188+0000 7fd9a7447640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd9a006f160 con 0x7fd9a00ccf00 2024-09-16T15:38:52.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:52.188+0000 7fd9a7447640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fd9a006f460 con 0x7fd9a0073fb0 2024-09-16T15:38:52.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:52.188+0000 7fd9a59e4640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd9a015f5a0 0x7fd9a01f26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:52.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:52.188+0000 7fd9a59e4640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd9a015f5a0 0x7fd9a01f26e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60234/0 (socket says 172.21.15.98:60234) 2024-09-16T15:38:52.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:52.188+0000 7fd9a59e4640 1 -- 172.21.15.98:0/2747854093 learned_addr learned my addr 172.21.15.98:0/2747854093 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:52.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:52.188+0000 7fd9a49e2640 1 --2- 172.21.15.98:0/2747854093 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9a00ccf00 0x7fd9a014c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:52.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:52.188+0000 7fd9a51e3640 1 --2- 172.21.15.98:0/2747854093 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9a0073fb0 0x7fd9a0158fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:52.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:52.188+0000 7fd9a59e4640 1 -- 172.21.15.98:0/2747854093 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9a0073fb0 msgr2=0x7fd9a0158fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:52.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:52.188+0000 7fd9a59e4640 1 --2- 172.21.15.98:0/2747854093 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9a0073fb0 0x7fd9a0158fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:52.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:52.188+0000 7fd9a59e4640 1 -- 172.21.15.98:0/2747854093 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9a00ccf00 msgr2=0x7fd9a014c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:52.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:52.188+0000 7fd9a59e4640 1 --2- 172.21.15.98:0/2747854093 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9a00ccf00 0x7fd9a014c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:52.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:52.188+0000 7fd9a59e4640 1 -- 172.21.15.98:0/2747854093 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9a014cce0 con 0x7fd9a015f5a0 2024-09-16T15:38:52.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:52.189+0000 7fd9a59e4640 1 --2- 172.21.15.98:0/2747854093 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd9a015f5a0 0x7fd9a01f26e0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fd99800eaa0 tx=0x7fd99800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:52.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:52.189+0000 7fd995ffb640 1 -- 172.21.15.98:0/2747854093 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd99800cdb0 con 0x7fd9a015f5a0 2024-09-16T15:38:52.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:52.189+0000 7fd995ffb640 1 -- 172.21.15.98:0/2747854093 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd998004c10 con 0x7fd9a015f5a0 2024-09-16T15:38:52.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:52.189+0000 7fd9a7447640 1 -- 172.21.15.98:0/2747854093 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9a01f2f30 con 0x7fd9a015f5a0 2024-09-16T15:38:52.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:52.189+0000 7fd995ffb640 1 -- 172.21.15.98:0/2747854093 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd998005020 con 0x7fd9a015f5a0 2024-09-16T15:38:52.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:52.189+0000 7fd9a7447640 1 -- 172.21.15.98:0/2747854093 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9a01f34f0 con 0x7fd9a015f5a0 2024-09-16T15:38:52.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:52.190+0000 7fd9a7447640 1 -- 172.21.15.98:0/2747854093 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9a00cdae0 con 0x7fd9a015f5a0 2024-09-16T15:38:52.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:52.190+0000 7fd995ffb640 1 -- 172.21.15.98:0/2747854093 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 7) ==== 101440+0+0 (secure 0 0 0) 0x7fd9980051c0 con 0x7fd9a015f5a0 2024-09-16T15:38:52.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:52.191+0000 7fd995ffb640 1 --2- 172.21.15.98:0/2747854093 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fd984078a00 0x7fd98407aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:52.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:52.191+0000 7fd995ffb640 1 -- 172.21.15.98:0/2747854093 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7fd99809b200 con 0x7fd9a015f5a0 2024-09-16T15:38:52.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:52.191+0000 7fd9a51e3640 1 --2- 172.21.15.98:0/2747854093 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fd984078a00 0x7fd98407aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:52.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:52.192+0000 7fd9a51e3640 1 --2- 172.21.15.98:0/2747854093 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fd984078a00 0x7fd98407aec0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd9a00b2460 tx=0x7fd99c007e90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:52.197 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:52.195+0000 7fd995ffb640 1 -- 172.21.15.98:0/2747854093 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7fd998016030 con 0x7fd9a015f5a0 2024-09-16T15:38:52.372 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:52.370+0000 7fd9a7447640 1 -- 172.21.15.98:0/2747854093 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd9a00cc160 con 0x7fd9a015f5a0 2024-09-16T15:38:52.372 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:52.371+0000 7fd995ffb640 1 -- 172.21.15.98:0/2747854093 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) ==== 74+0+13044 (secure 0 0 0) 0x7fd9980632d0 con 0x7fd9a015f5a0 2024-09-16T15:38:52.373 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:38:52.373 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":37,"fsid":"52a38a45-21d2-4cb0-bb3a-4fb8be3a08df","created":"2024-09-16T15:37:20.387654+0000","modified":"2024-09-16T15:38:47.156370+0000","last_up_change":"2024-09-16T15:37:33.417470+0000","last_in_change":"2024-09-16T15:37:23.430578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T15:37:34.725090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a2d61df4-2577-47e6-a4ac-c36bbb85ab8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1967099790},{"type":"v1","addr":"172.21.15.98:6825","nonce":1967099790}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1967099790},{"type":"v1","addr":"172.21.15.98:6827","nonce":1967099790}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":1967099790},{"type":"v1","addr":"172.21.15.98:6831","nonce":1967099790}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1967099790},{"type":"v1","addr":"172.21.15.98:6829","nonce":1967099790}]},"public_addr":"172.21.15.98:6825/1967099790","cluster_addr":"172.21.15.98:6827/1967099790","heartbeat_back_addr":"172.21.15.98:6831/1967099790","heartbeat_front_addr":"172.21.15.98:6829/1967099790","state":["exists","up"]},{"osd":1,"uuid":"bb3a68a5-c22f-442b-b292-7c272fe01ff2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":3571460482},{"type":"v1","addr":"172.21.15.98:6809","nonce":3571460482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":3571460482},{"type":"v1","addr":"172.21.15.98:6811","nonce":3571460482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":3571460482},{"type":"v1","addr":"172.21.15.98:6815","nonce":3571460482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":3571460482},{"type":"v1","addr":"172.21.15.98:6813","nonce":3571460482}]},"public_addr":"172.21.15.98:6809/3571460482","cluster_addr":"172.21.15.98:6811/3571460482","heartbeat_back_addr":"172.21.15.98:6815/3571460482","heartbeat_front_addr":"172.21.15.98:6813/3571460482","state":["exists","up"]},{"osd":2,"uuid":"c8429195-a480-409b-8e5f-8dc4c6abc0a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":2573210695},{"type":"v1","addr":"172.21.15.98:6801","nonce":2573210695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":2573210695},{"type":"v1","addr":"172.21.15.98:6803","nonce":2573210695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":2573210695},{"type":"v1","addr":"172.21.15.98:6807","nonce":2573210695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":2573210695},{"type":"v1","addr":"172.21.15.98:6805","nonce":2573210695}]},"public_addr":"172.21.15.98:6801/2573210695","cluster_addr":"172.21.15.98:6803/2573210695","heartbeat_back_addr":"172.21.15.98:6807/2573210695","heartbeat_front_addr":"172.21.15.98:6805/2573210695","state":["exists","up"]},{"osd":3,"uuid":"0e800d7b-096f-4f65-b3cc-c7cda3870de4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":3951374837},{"type":"v1","addr":"172.21.15.98:6817","nonce":3951374837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":3951374837},{"type":"v1","addr":"172.21.15.98:6819","nonce":3951374837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":3951374837},{"type":"v1","addr":"172.21.15.98:6823","nonce":3951374837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":3951374837},{"type":"v1","addr":"172.21.15.98:6821","nonce":3951374837}]},"public_addr":"172.21.15.98:6817/3951374837","cluster_addr":"172.21.15.98:6819/3951374837","heartbeat_back_addr":"172.21.15.98:6823/3951374837","heartbeat_front_addr":"172.21.15.98:6821/3951374837","state":["exists","up"]},{"osd":4,"uuid":"c7822e9b-8e29-48d9-b92a-e8f9c7bc5247","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":724302036},{"type":"v1","addr":"172.21.15.135:6811","nonce":724302036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":724302036},{"type":"v1","addr":"172.21.15.135:6813","nonce":724302036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":724302036},{"type":"v1","addr":"172.21.15.135:6817","nonce":724302036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":724302036},{"type":"v1","addr":"172.21.15.135:6815","nonce":724302036}]},"public_addr":"172.21.15.135:6811/724302036","cluster_addr":"172.21.15.135:6813/724302036","heartbeat_back_addr":"172.21.15.135:6817/724302036","heartbeat_front_addr":"172.21.15.135:6815/724302036","state":["exists","up"]},{"osd":5,"uuid":"35805e02-484a-4404-a78f-aa44f4daa41f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3083482635},{"type":"v1","addr":"172.21.15.135:6803","nonce":3083482635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3083482635},{"type":"v1","addr":"172.21.15.135:6805","nonce":3083482635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":3083482635},{"type":"v1","addr":"172.21.15.135:6809","nonce":3083482635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3083482635},{"type":"v1","addr":"172.21.15.135:6807","nonce":3083482635}]},"public_addr":"172.21.15.135:6803/3083482635","cluster_addr":"172.21.15.135:6805/3083482635","heartbeat_back_addr":"172.21.15.135:6809/3083482635","heartbeat_front_addr":"172.21.15.135:6807/3083482635","state":["exists","up"]},{"osd":6,"uuid":"6327ba84-aaeb-41fa-9717-188988ff2c4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3376376340},{"type":"v1","addr":"172.21.15.135:6819","nonce":3376376340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3376376340},{"type":"v1","addr":"172.21.15.135:6821","nonce":3376376340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":3376376340},{"type":"v1","addr":"172.21.15.135:6825","nonce":3376376340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3376376340},{"type":"v1","addr":"172.21.15.135:6823","nonce":3376376340}]},"public_addr":"172.21.15.135:6819/3376376340","cluster_addr":"172.21.15.135:6821/3376376340","heartbeat_back_addr":"172.21.15.135:6825/3376376340","heartbeat_front_addr":"172.21.15.135:6823/3376376340","state":["exists","up"]},{"osd":7,"uuid":"392d0958-dff9-4248-b3d8-a1201c10f354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2559837727},{"type":"v1","addr":"172.21.15.135:6827","nonce":2559837727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2559837727},{"type":"v1","addr":"172.21.15.135:6829","nonce":2559837727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":2559837727},{"type":"v1","addr":"172.21.15.135:6833","nonce":2559837727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2559837727},{"type":"v1","addr":"172.21.15.135:6831","nonce":2559837727}]},"public_addr":"172.21.15.135:6827/2559837727","cluster_addr":"172.21.15.135:6829/2559837727","heartbeat_back_addr":"172.21.15.135:6833/2559837727","heartbeat_front_addr":"172.21.15.135:6831/2559837727","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.939904+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.717296+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.785817+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:30.211718+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.973359+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:30.250109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:29.699327+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T15:37:30.173063+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.98:6835/1806390493":"2024-09-17T15:38:44.070008+0000","172.21.15.98:6833/1806390493":"2024-09-17T15:38:44.070008+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T15:38:52.376 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:52.373+0000 7fd9a7447640 1 -- 172.21.15.98:0/2747854093 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fd984078a00 msgr2=0x7fd98407aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:52.376 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:52.373+0000 7fd9a7447640 1 --2- 172.21.15.98:0/2747854093 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fd984078a00 0x7fd98407aec0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd9a00b2460 tx=0x7fd99c007e90 comp rx=0 tx=0).stop 2024-09-16T15:38:52.377 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:52.373+0000 7fd9a7447640 1 -- 172.21.15.98:0/2747854093 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd9a015f5a0 msgr2=0x7fd9a01f26e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:52.377 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:52.373+0000 7fd9a7447640 1 --2- 172.21.15.98:0/2747854093 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd9a015f5a0 0x7fd9a01f26e0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fd99800eaa0 tx=0x7fd99800ef60 comp rx=0 tx=0).stop 2024-09-16T15:38:52.377 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:52.373+0000 7fd9a7447640 1 -- 172.21.15.98:0/2747854093 shutdown_connections 2024-09-16T15:38:52.377 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:52.373+0000 7fd9a7447640 1 --2- 172.21.15.98:0/2747854093 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd9a015f5a0 0x7fd9a01f26e0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:52.377 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:52.373+0000 7fd9a7447640 1 --2- 172.21.15.98:0/2747854093 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fd984078a00 0x7fd98407aec0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:52.377 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:52.373+0000 7fd9a7447640 1 --2- 172.21.15.98:0/2747854093 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9a00ccf00 0x7fd9a014c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:52.377 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:52.373+0000 7fd9a7447640 1 --2- 172.21.15.98:0/2747854093 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd9a0073fb0 0x7fd9a0158fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:52.377 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:52.373+0000 7fd9a7447640 1 -- 172.21.15.98:0/2747854093 >> 172.21.15.98:0/2747854093 conn(0x7fd9a00b1950 msgr2=0x7fd9a009cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:52.377 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:52.373+0000 7fd9a7447640 1 -- 172.21.15.98:0/2747854093 shutdown_connections 2024-09-16T15:38:52.377 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:52.373+0000 7fd9a7447640 1 -- 172.21.15.98:0/2747854093 wait complete. 2024-09-16T15:38:53.387 INFO:tasks.ceph:Scrubbing osd.0 2024-09-16T15:38:53.387 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-16T15:38:53.499 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.497+0000 7f6fd907f640 1 -- 172.21.15.98:0/2800076338 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6fd40d0970 msgr2=0x7f6fd41602c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:53.499 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.497+0000 7f6fd907f640 1 --2- 172.21.15.98:0/2800076338 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6fd40d0970 0x7f6fd41602c0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f6fd40b1110 tx=0x7f6fcc02a4d0 comp rx=0 tx=0).stop 2024-09-16T15:38:53.500 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.497+0000 7f6fd907f640 1 -- 172.21.15.98:0/2800076338 shutdown_connections 2024-09-16T15:38:53.500 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.497+0000 7f6fd907f640 1 --2- 172.21.15.98:0/2800076338 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6fd40d0970 0x7f6fd41602c0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:53.500 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.497+0000 7f6fd907f640 1 --2- 172.21.15.98:0/2800076338 >> v2:172.21.15.135:3300/0 conn(0x7f6fd40b3240 0x7f6fd415fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:53.500 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.497+0000 7f6fd907f640 1 -- 172.21.15.98:0/2800076338 >> 172.21.15.98:0/2800076338 conn(0x7f6fd40d1e30 msgr2=0x7f6fd40d2240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:53.500 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.497+0000 7f6fd907f640 1 -- 172.21.15.98:0/2800076338 shutdown_connections 2024-09-16T15:38:53.500 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.497+0000 7f6fd907f640 1 -- 172.21.15.98:0/2800076338 wait complete. 2024-09-16T15:38:53.500 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.499+0000 7f6fd907f640 1 Processor -- start 2024-09-16T15:38:53.501 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.499+0000 7f6fd907f640 1 -- start start 2024-09-16T15:38:53.503 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.499+0000 7f6fd907f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6fd40b3240 0x7f6fd40cdd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:53.503 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.499+0000 7f6fd907f640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6fd40cfe80 0x7f6fd40cae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:53.503 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.499+0000 7f6fd907f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6fd40d0970 0x7f6fd415ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:53.503 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.499+0000 7f6fd907f640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6fd40aff70 con 0x7f6fd40d0970 2024-09-16T15:38:53.503 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.499+0000 7f6fd907f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6fd40afdf0 con 0x7f6fd40b3240 2024-09-16T15:38:53.503 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.499+0000 7f6fd907f640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f6fd40b00f0 con 0x7f6fd40cfe80 2024-09-16T15:38:53.503 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.500+0000 7f6fd359e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6fd40d0970 0x7f6fd415ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:53.503 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.500+0000 7f6fd359e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6fd40d0970 0x7f6fd415ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60260/0 (socket says 172.21.15.98:60260) 2024-09-16T15:38:53.503 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.500+0000 7f6fd359e640 1 -- 172.21.15.98:0/549630206 learned_addr learned my addr 172.21.15.98:0/549630206 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:53.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.500+0000 7f6fd2d9d640 1 --2- 172.21.15.98:0/549630206 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6fd40b3240 0x7f6fd40cdd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:53.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.500+0000 7f6fd259c640 1 --2- 172.21.15.98:0/549630206 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6fd40cfe80 0x7f6fd40cae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:53.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.500+0000 7f6fd359e640 1 -- 172.21.15.98:0/549630206 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6fd40cfe80 msgr2=0x7f6fd40cae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:53.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.500+0000 7f6fd359e640 1 --2- 172.21.15.98:0/549630206 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f6fd40cfe80 0x7f6fd40cae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:53.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.500+0000 7f6fd359e640 1 -- 172.21.15.98:0/549630206 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6fd40b3240 msgr2=0x7f6fd40cdd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:53.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.500+0000 7f6fd359e640 1 --2- 172.21.15.98:0/549630206 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6fd40b3240 0x7f6fd40cdd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:53.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.500+0000 7f6fd359e640 1 -- 172.21.15.98:0/549630206 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fd41f37a0 con 0x7f6fd40d0970 2024-09-16T15:38:53.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.500+0000 7f6fd359e640 1 --2- 172.21.15.98:0/549630206 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6fd40d0970 0x7f6fd415ea00 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc034040 tx=0x7f6fcc003960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:53.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.500+0000 7f6fcb7fe640 1 -- 172.21.15.98:0/549630206 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fcc03e030 con 0x7f6fd40d0970 2024-09-16T15:38:53.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.500+0000 7f6fcb7fe640 1 -- 172.21.15.98:0/549630206 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6fcc003e50 con 0x7f6fd40d0970 2024-09-16T15:38:53.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.500+0000 7f6fd907f640 1 -- 172.21.15.98:0/549630206 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fd40ca370 con 0x7f6fd40d0970 2024-09-16T15:38:53.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.500+0000 7f6fcb7fe640 1 -- 172.21.15.98:0/549630206 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fcc035040 con 0x7f6fd40d0970 2024-09-16T15:38:53.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.500+0000 7f6fd907f640 1 -- 172.21.15.98:0/549630206 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fd40ca930 con 0x7f6fd40d0970 2024-09-16T15:38:53.505 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.501+0000 7f6fd907f640 1 -- 172.21.15.98:0/549630206 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6fd40d0260 con 0x7f6fd40d0970 2024-09-16T15:38:53.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.502+0000 7f6fcb7fe640 1 -- 172.21.15.98:0/549630206 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 7) ==== 101440+0+0 (secure 0 0 0) 0x7f6fcc041030 con 0x7f6fd40d0970 2024-09-16T15:38:53.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.502+0000 7f6fcb7fe640 1 --2- 172.21.15.98:0/549630206 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f6fb4078a00 0x7f6fb407aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:53.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.502+0000 7f6fcb7fe640 1 -- 172.21.15.98:0/549630206 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f6fcc0bb500 con 0x7f6fd40d0970 2024-09-16T15:38:53.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.503+0000 7f6fcb7fe640 1 --2- 172.21.15.98:0/549630206 >> [v2:172.21.15.98:6824/1967099790,v1:172.21.15.98:6825/1967099790] conn(0x7f6fb407e8c0 0x7f6fb4080ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:53.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.503+0000 7f6fcb7fe640 1 -- 172.21.15.98:0/549630206 --> [v2:172.21.15.98:6824/1967099790,v1:172.21.15.98:6825/1967099790] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6fcc001d30 con 0x7f6fb407e8c0 2024-09-16T15:38:53.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.503+0000 7f6fcb7fe640 1 -- 172.21.15.98:0/549630206 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f6fcc0bb990 con 0x7f6fd40d0970 2024-09-16T15:38:53.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.503+0000 7f6fd2d9d640 1 --2- 172.21.15.98:0/549630206 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f6fb4078a00 0x7f6fb407aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:53.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.503+0000 7f6fd259c640 1 --2- 172.21.15.98:0/549630206 >> [v2:172.21.15.98:6824/1967099790,v1:172.21.15.98:6825/1967099790] conn(0x7f6fb407e8c0 0x7f6fb4080ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:53.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.503+0000 7f6fd259c640 1 --2- 172.21.15.98:0/549630206 >> [v2:172.21.15.98:6824/1967099790,v1:172.21.15.98:6825/1967099790] conn(0x7f6fb407e8c0 0x7f6fb4080ce0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:53.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.503+0000 7f6fd2d9d640 1 --2- 172.21.15.98:0/549630206 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f6fb4078a00 0x7f6fb407aec0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6fd40cf180 tx=0x7f6fc4003d90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:53.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.504+0000 7f6fcb7fe640 1 -- 172.21.15.98:0/549630206 <== osd.0 v2:172.21.15.98:6824/1967099790 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6fcc001d30 con 0x7f6fb407e8c0 2024-09-16T15:38:53.518 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.516+0000 7f6fd907f640 1 -- 172.21.15.98:0/549630206 --> [v2:172.21.15.98:6824/1967099790,v1:172.21.15.98:6825/1967099790] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f6fd40b1eb0 con 0x7f6fb407e8c0 2024-09-16T15:38:53.518 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.516+0000 7f6fcb7fe640 1 -- 172.21.15.98:0/549630206 <== osd.0 v2:172.21.15.98:6824/1967099790 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f6fd40b1eb0 con 0x7f6fb407e8c0 2024-09-16T15:38:53.518 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-16T15:38:53.519 INFO:teuthology.orchestra.run.smithi098.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-16T15:38:53.519 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-16T15:38:53.519 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.516+0000 7f6fd907f640 1 -- 172.21.15.98:0/549630206 >> [v2:172.21.15.98:6824/1967099790,v1:172.21.15.98:6825/1967099790] conn(0x7f6fb407e8c0 msgr2=0x7f6fb4080ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:53.519 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.516+0000 7f6fd907f640 1 --2- 172.21.15.98:0/549630206 >> [v2:172.21.15.98:6824/1967099790,v1:172.21.15.98:6825/1967099790] conn(0x7f6fb407e8c0 0x7f6fb4080ce0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:53.520 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.517+0000 7f6fd907f640 1 -- 172.21.15.98:0/549630206 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f6fb4078a00 msgr2=0x7f6fb407aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:53.520 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.517+0000 7f6fd907f640 1 --2- 172.21.15.98:0/549630206 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f6fb4078a00 0x7f6fb407aec0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6fd40cf180 tx=0x7f6fc4003d90 comp rx=0 tx=0).stop 2024-09-16T15:38:53.520 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.517+0000 7f6fd907f640 1 -- 172.21.15.98:0/549630206 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6fd40d0970 msgr2=0x7f6fd415ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:53.520 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.517+0000 7f6fd907f640 1 --2- 172.21.15.98:0/549630206 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6fd40d0970 0x7f6fd415ea00 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc034040 tx=0x7f6fcc003960 comp rx=0 tx=0).stop 2024-09-16T15:38:53.520 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.517+0000 7f6fd359e640 1 -- 172.21.15.98:0/549630206 reap_dead start 2024-09-16T15:38:53.520 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.517+0000 7f6fd907f640 1 -- 172.21.15.98:0/549630206 shutdown_connections 2024-09-16T15:38:53.520 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.517+0000 7f6fd907f640 1 -- 172.21.15.98:0/549630206 >> 172.21.15.98:0/549630206 conn(0x7f6fd40d1e30 msgr2=0x7f6fd41553b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:53.520 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.517+0000 7f6fd907f640 1 -- 172.21.15.98:0/549630206 shutdown_connections 2024-09-16T15:38:53.520 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.517+0000 7f6fd907f640 1 -- 172.21.15.98:0/549630206 wait complete. 2024-09-16T15:38:53.529 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-16T15:38:53.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.629+0000 7f20f4b5d640 1 -- 172.21.15.98:0/3424073591 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f20f01445d0 msgr2=0x7f20f00cebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:53.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.629+0000 7f20f4b5d640 1 --2- 172.21.15.98:0/3424073591 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f20f01445d0 0x7f20f00cebf0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f20e0005fd0 tx=0x7f20e002ab70 comp rx=0 tx=0).stop 2024-09-16T15:38:53.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.629+0000 7f20f4b5d640 1 -- 172.21.15.98:0/3424073591 shutdown_connections 2024-09-16T15:38:53.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.629+0000 7f20f4b5d640 1 --2- 172.21.15.98:0/3424073591 >> v2:172.21.15.135:3300/0 conn(0x7f20f00b4ca0 0x7f20f00cf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:53.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.629+0000 7f20f4b5d640 1 --2- 172.21.15.98:0/3424073591 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f20f01445d0 0x7f20f00cebf0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:53.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.629+0000 7f20f4b5d640 1 -- 172.21.15.98:0/3424073591 >> 172.21.15.98:0/3424073591 conn(0x7f20f00b1950 msgr2=0x7f20f00b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:53.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.629+0000 7f20f4b5d640 1 -- 172.21.15.98:0/3424073591 shutdown_connections 2024-09-16T15:38:53.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.629+0000 7f20f4b5d640 1 -- 172.21.15.98:0/3424073591 wait complete. 2024-09-16T15:38:53.633 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.630+0000 7f20f4b5d640 1 Processor -- start 2024-09-16T15:38:53.633 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.631+0000 7f20f4b5d640 1 -- start start 2024-09-16T15:38:53.635 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.631+0000 7f20f4b5d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f20f00b4ca0 0x7f20f013a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:53.635 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.631+0000 7f20f4b5d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f20f00ccfd0 0x7f20f015b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:53.635 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.631+0000 7f20f4b5d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20f01445d0 0x7f20f0159b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:53.635 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.631+0000 7f20f4b5d640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f20f015f080 con 0x7f20f00b4ca0 2024-09-16T15:38:53.635 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.631+0000 7f20f4b5d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f20f0073bc0 con 0x7f20f01445d0 2024-09-16T15:38:53.635 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.631+0000 7f20f4b5d640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f20f015f200 con 0x7f20f00ccfd0 2024-09-16T15:38:53.635 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.631+0000 7f20ee59c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f20f00b4ca0 0x7f20f013a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:53.635 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.631+0000 7f20ee59c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f20f00b4ca0 0x7f20f013a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60280/0 (socket says 172.21.15.98:60280) 2024-09-16T15:38:53.635 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.631+0000 7f20ee59c640 1 -- 172.21.15.98:0/1959785423 learned_addr learned my addr 172.21.15.98:0/1959785423 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:53.635 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.631+0000 7f20edd9b640 1 --2- 172.21.15.98:0/1959785423 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f20f00ccfd0 0x7f20f015b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:53.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.631+0000 7f20eed9d640 1 --2- 172.21.15.98:0/1959785423 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20f01445d0 0x7f20f0159b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:53.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.632+0000 7f20ee59c640 1 -- 172.21.15.98:0/1959785423 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f20f00ccfd0 msgr2=0x7f20f015b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:53.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.632+0000 7f20ee59c640 1 --2- 172.21.15.98:0/1959785423 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f20f00ccfd0 0x7f20f015b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:53.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.632+0000 7f20ee59c640 1 -- 172.21.15.98:0/1959785423 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20f01445d0 msgr2=0x7f20f0159b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:53.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.632+0000 7f20ee59c640 1 --2- 172.21.15.98:0/1959785423 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20f01445d0 0x7f20f0159b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:53.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.632+0000 7f20ee59c640 1 -- 172.21.15.98:0/1959785423 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20f009d3c0 con 0x7f20f00b4ca0 2024-09-16T15:38:53.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.632+0000 7f20edd9b640 1 --2- 172.21.15.98:0/1959785423 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f20f00ccfd0 0x7f20f015b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T15:38:53.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.632+0000 7f20eed9d640 1 --2- 172.21.15.98:0/1959785423 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20f01445d0 0x7f20f0159b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T15:38:53.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.632+0000 7f20ee59c640 1 --2- 172.21.15.98:0/1959785423 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f20f00b4ca0 0x7f20f013a850 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f20e0000f80 tx=0x7f20e002cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:53.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.632+0000 7f20e6ffd640 1 -- 172.21.15.98:0/1959785423 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e0044070 con 0x7f20f00b4ca0 2024-09-16T15:38:53.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.632+0000 7f20f4b5d640 1 -- 172.21.15.98:0/1959785423 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20f009ce00 con 0x7f20f00b4ca0 2024-09-16T15:38:53.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.632+0000 7f20e6ffd640 1 -- 172.21.15.98:0/1959785423 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f20e0004250 con 0x7f20f00b4ca0 2024-09-16T15:38:53.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.632+0000 7f20e6ffd640 1 -- 172.21.15.98:0/1959785423 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e0004680 con 0x7f20f00b4ca0 2024-09-16T15:38:53.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.632+0000 7f20f4b5d640 1 -- 172.21.15.98:0/1959785423 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20f015d3c0 con 0x7f20f00b4ca0 2024-09-16T15:38:53.637 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.633+0000 7f20f4b5d640 1 -- 172.21.15.98:0/1959785423 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20f015f720 con 0x7f20f00b4ca0 2024-09-16T15:38:53.637 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.634+0000 7f20e6ffd640 1 -- 172.21.15.98:0/1959785423 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 7) ==== 101440+0+0 (secure 0 0 0) 0x7f20e0048430 con 0x7f20f00b4ca0 2024-09-16T15:38:53.637 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.634+0000 7f20e6ffd640 1 --2- 172.21.15.98:0/1959785423 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f20d0078a00 0x7f20d007aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:53.637 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.634+0000 7f20e6ffd640 1 -- 172.21.15.98:0/1959785423 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f20e00bb160 con 0x7f20f00b4ca0 2024-09-16T15:38:53.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.635+0000 7f20edd9b640 1 --2- 172.21.15.98:0/1959785423 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f20d0078a00 0x7f20d007aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:53.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.635+0000 7f20edd9b640 1 --2- 172.21.15.98:0/1959785423 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f20d0078a00 0x7f20d007aec0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f20f00d05e0 tx=0x7f20d8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:53.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.639+0000 7f20e6ffd640 1 -- 172.21.15.98:0/1959785423 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7f20e0032030 con 0x7f20f00b4ca0 2024-09-16T15:38:53.818 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.816+0000 7f20f4b5d640 1 -- 172.21.15.98:0/1959785423 --> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f20f00b0ef0 con 0x7f20d0078a00 2024-09-16T15:38:53.818 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.817+0000 7f20e6ffd640 1 -- 172.21.15.98:0/1959785423 <== mgr.4100 v2:172.21.15.135:6800/699234772 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f20f00b0ef0 con 0x7f20d0078a00 2024-09-16T15:38:53.818 INFO:teuthology.orchestra.run.smithi098.stderr:instructed osd(s) 0 to deep-scrub 2024-09-16T15:38:53.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.818+0000 7f20f4b5d640 1 -- 172.21.15.98:0/1959785423 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f20d0078a00 msgr2=0x7f20d007aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:53.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.818+0000 7f20f4b5d640 1 --2- 172.21.15.98:0/1959785423 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f20d0078a00 0x7f20d007aec0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f20f00d05e0 tx=0x7f20d8009040 comp rx=0 tx=0).stop 2024-09-16T15:38:53.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.818+0000 7f20f4b5d640 1 -- 172.21.15.98:0/1959785423 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f20f00b4ca0 msgr2=0x7f20f013a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:53.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.818+0000 7f20f4b5d640 1 --2- 172.21.15.98:0/1959785423 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f20f00b4ca0 0x7f20f013a850 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f20e0000f80 tx=0x7f20e002cf00 comp rx=0 tx=0).stop 2024-09-16T15:38:53.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.819+0000 7f20f4b5d640 1 -- 172.21.15.98:0/1959785423 shutdown_connections 2024-09-16T15:38:53.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.819+0000 7f20f4b5d640 1 --2- 172.21.15.98:0/1959785423 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f20d0078a00 0x7f20d007aec0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:53.822 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.819+0000 7f20f4b5d640 1 --2- 172.21.15.98:0/1959785423 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20f01445d0 0x7f20f0159b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:53.822 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.819+0000 7f20f4b5d640 1 --2- 172.21.15.98:0/1959785423 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f20f00ccfd0 0x7f20f015b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:53.822 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.819+0000 7f20f4b5d640 1 --2- 172.21.15.98:0/1959785423 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f20f00b4ca0 0x7f20f013a850 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:53.822 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.819+0000 7f20f4b5d640 1 -- 172.21.15.98:0/1959785423 >> 172.21.15.98:0/1959785423 conn(0x7f20f00b1950 msgr2=0x7f20f006e710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:53.822 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.819+0000 7f20f4b5d640 1 -- 172.21.15.98:0/1959785423 shutdown_connections 2024-09-16T15:38:53.822 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.819+0000 7f20f4b5d640 1 -- 172.21.15.98:0/1959785423 wait complete. 2024-09-16T15:38:53.832 INFO:tasks.ceph:Scrubbing osd.1 2024-09-16T15:38:53.832 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-16T15:38:53.938 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.936+0000 7fc7fbbec640 1 -- 172.21.15.98:0/1606510502 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7e0004d40 msgr2=0x7fc7e00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:53.939 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.936+0000 7fc7fbbec640 1 --2- 172.21.15.98:0/1606510502 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7e0004d40 0x7fc7e00051c0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec009f00 tx=0x7fc7e0005830 comp rx=0 tx=0).stop 2024-09-16T15:38:53.939 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.936+0000 7fc7fa189640 1 -- 172.21.15.98:0/1606510502 reap_dead start 2024-09-16T15:38:53.939 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.936+0000 7fc7fbbec640 1 -- 172.21.15.98:0/1606510502 shutdown_connections 2024-09-16T15:38:53.939 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.936+0000 7fc7fbbec640 1 -- 172.21.15.98:0/1606510502 >> 172.21.15.98:0/1606510502 conn(0x7fc7f406cb70 msgr2=0x7fc7f406cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:53.939 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.936+0000 7fc7fbbec640 1 -- 172.21.15.98:0/1606510502 shutdown_connections 2024-09-16T15:38:53.939 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.936+0000 7fc7fbbec640 1 -- 172.21.15.98:0/1606510502 wait complete. 2024-09-16T15:38:53.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.937+0000 7fc7fbbec640 1 Processor -- start 2024-09-16T15:38:53.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.938+0000 7fc7fbbec640 1 -- start start 2024-09-16T15:38:53.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.938+0000 7fc7fbbec640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7e0004d40 0x7fc7f40c7d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:53.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.938+0000 7fc7fbbec640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc7f40ad870 0x7fc7f41513c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:53.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.938+0000 7fc7fbbec640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7f40adcf0 0x7fc7f4151900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:53.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.938+0000 7fc7fbbec640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc7f4073400 con 0x7fc7e0004d40 2024-09-16T15:38:53.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.938+0000 7fc7fbbec640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc7f4073280 con 0x7fc7f40adcf0 2024-09-16T15:38:53.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.938+0000 7fc7fbbec640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fc7f40aeeb0 con 0x7fc7f40ad870 2024-09-16T15:38:53.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.938+0000 7fc7f9988640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7e0004d40 0x7fc7f40c7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:53.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.938+0000 7fc7f9988640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7e0004d40 0x7fc7f40c7d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60290/0 (socket says 172.21.15.98:60290) 2024-09-16T15:38:53.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.938+0000 7fc7f9988640 1 -- 172.21.15.98:0/443667131 learned_addr learned my addr 172.21.15.98:0/443667131 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:53.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.938+0000 7fc7f9187640 1 --2- 172.21.15.98:0/443667131 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc7f40ad870 0x7fc7f41513c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:53.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.938+0000 7fc7fa189640 1 --2- 172.21.15.98:0/443667131 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7f40adcf0 0x7fc7f4151900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:53.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.939+0000 7fc7f9988640 1 -- 172.21.15.98:0/443667131 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc7f40ad870 msgr2=0x7fc7f41513c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:53.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.939+0000 7fc7f9988640 1 --2- 172.21.15.98:0/443667131 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc7f40ad870 0x7fc7f41513c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:53.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.939+0000 7fc7f9988640 1 -- 172.21.15.98:0/443667131 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7f40adcf0 msgr2=0x7fc7f4151900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:53.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.939+0000 7fc7f9988640 1 --2- 172.21.15.98:0/443667131 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7f40adcf0 0x7fc7f4151900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:53.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.939+0000 7fc7f9988640 1 -- 172.21.15.98:0/443667131 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7f40ae2a0 con 0x7fc7e0004d40 2024-09-16T15:38:53.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.939+0000 7fc7fa189640 1 --2- 172.21.15.98:0/443667131 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7f40adcf0 0x7fc7f4151900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T15:38:53.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.939+0000 7fc7f9988640 1 --2- 172.21.15.98:0/443667131 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7e0004d40 0x7fc7f40c7d40 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fc7f0001c20 tx=0x7fc7f000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:53.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.939+0000 7fc7ea7fc640 1 -- 172.21.15.98:0/443667131 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7f0015070 con 0x7fc7e0004d40 2024-09-16T15:38:53.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.939+0000 7fc7ea7fc640 1 -- 172.21.15.98:0/443667131 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc7f000ca50 con 0x7fc7e0004d40 2024-09-16T15:38:53.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.939+0000 7fc7fbbec640 1 -- 172.21.15.98:0/443667131 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7f40ae580 con 0x7fc7e0004d40 2024-09-16T15:38:53.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.939+0000 7fc7ea7fc640 1 -- 172.21.15.98:0/443667131 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7f0011460 con 0x7fc7e0004d40 2024-09-16T15:38:53.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.939+0000 7fc7fbbec640 1 -- 172.21.15.98:0/443667131 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7f40aeb40 con 0x7fc7e0004d40 2024-09-16T15:38:53.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.940+0000 7fc7fbbec640 1 -- 172.21.15.98:0/443667131 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc7f406f090 con 0x7fc7e0004d40 2024-09-16T15:38:53.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.941+0000 7fc7ea7fc640 1 -- 172.21.15.98:0/443667131 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 7) ==== 101440+0+0 (secure 0 0 0) 0x7fc7f0018070 con 0x7fc7e0004d40 2024-09-16T15:38:53.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.941+0000 7fc7ea7fc640 1 --2- 172.21.15.98:0/443667131 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fc7d8078a00 0x7fc7d807aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:53.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.941+0000 7fc7ea7fc640 1 -- 172.21.15.98:0/443667131 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7fc7f009afb0 con 0x7fc7e0004d40 2024-09-16T15:38:53.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.941+0000 7fc7ea7fc640 1 --2- 172.21.15.98:0/443667131 >> [v2:172.21.15.98:6808/3571460482,v1:172.21.15.98:6809/3571460482] conn(0x7fc7d807e8c0 0x7fc7d8080ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:53.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.941+0000 7fc7ea7fc640 1 -- 172.21.15.98:0/443667131 --> [v2:172.21.15.98:6808/3571460482,v1:172.21.15.98:6809/3571460482] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc7d8081390 con 0x7fc7d807e8c0 2024-09-16T15:38:53.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.941+0000 7fc7ea7fc640 1 -- 172.21.15.98:0/443667131 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fc7f00a2050 con 0x7fc7e0004d40 2024-09-16T15:38:53.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.941+0000 7fc7f9187640 1 --2- 172.21.15.98:0/443667131 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fc7d8078a00 0x7fc7d807aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:53.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.942+0000 7fc7fa189640 1 --2- 172.21.15.98:0/443667131 >> [v2:172.21.15.98:6808/3571460482,v1:172.21.15.98:6809/3571460482] conn(0x7fc7d807e8c0 0x7fc7d8080ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:53.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.942+0000 7fc7fa189640 1 --2- 172.21.15.98:0/443667131 >> [v2:172.21.15.98:6808/3571460482,v1:172.21.15.98:6809/3571460482] conn(0x7fc7d807e8c0 0x7fc7d8080ce0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:53.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.942+0000 7fc7f9187640 1 --2- 172.21.15.98:0/443667131 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fc7d8078a00 0x7fc7d807aec0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc7f40c7aa0 tx=0x7fc7e4005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:53.947 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.942+0000 7fc7ea7fc640 1 -- 172.21.15.98:0/443667131 <== osd.1 v2:172.21.15.98:6808/3571460482 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc7d8081390 con 0x7fc7d807e8c0 2024-09-16T15:38:53.957 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.955+0000 7fc7fbbec640 1 -- 172.21.15.98:0/443667131 --> [v2:172.21.15.98:6808/3571460482,v1:172.21.15.98:6809/3571460482] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc7f415dff0 con 0x7fc7d807e8c0 2024-09-16T15:38:53.957 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.955+0000 7fc7ea7fc640 1 -- 172.21.15.98:0/443667131 <== osd.1 v2:172.21.15.98:6808/3571460482 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fc7f415dff0 con 0x7fc7d807e8c0 2024-09-16T15:38:53.957 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-16T15:38:53.957 INFO:teuthology.orchestra.run.smithi098.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-16T15:38:53.957 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-16T15:38:53.958 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.955+0000 7fc7fbbec640 1 -- 172.21.15.98:0/443667131 >> [v2:172.21.15.98:6808/3571460482,v1:172.21.15.98:6809/3571460482] conn(0x7fc7d807e8c0 msgr2=0x7fc7d8080ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:53.958 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.955+0000 7fc7fbbec640 1 --2- 172.21.15.98:0/443667131 >> [v2:172.21.15.98:6808/3571460482,v1:172.21.15.98:6809/3571460482] conn(0x7fc7d807e8c0 0x7fc7d8080ce0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:53.958 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.955+0000 7fc7fbbec640 1 -- 172.21.15.98:0/443667131 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fc7d8078a00 msgr2=0x7fc7d807aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:53.958 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.955+0000 7fc7fbbec640 1 --2- 172.21.15.98:0/443667131 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fc7d8078a00 0x7fc7d807aec0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc7f40c7aa0 tx=0x7fc7e4005f90 comp rx=0 tx=0).stop 2024-09-16T15:38:53.958 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.955+0000 7fc7fbbec640 1 -- 172.21.15.98:0/443667131 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7e0004d40 msgr2=0x7fc7f40c7d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:53.959 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.955+0000 7fc7fbbec640 1 --2- 172.21.15.98:0/443667131 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7e0004d40 0x7fc7f40c7d40 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fc7f0001c20 tx=0x7fc7f000ecd0 comp rx=0 tx=0).stop 2024-09-16T15:38:53.959 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.955+0000 7fc7fa189640 1 -- 172.21.15.98:0/443667131 reap_dead start 2024-09-16T15:38:53.959 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.955+0000 7fc7fbbec640 1 -- 172.21.15.98:0/443667131 shutdown_connections 2024-09-16T15:38:53.959 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.955+0000 7fc7fbbec640 1 -- 172.21.15.98:0/443667131 >> 172.21.15.98:0/443667131 conn(0x7fc7f406cb70 msgr2=0x7fc7f415af80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:53.959 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.955+0000 7fc7fbbec640 1 -- 172.21.15.98:0/443667131 shutdown_connections 2024-09-16T15:38:53.959 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:53.955+0000 7fc7fbbec640 1 -- 172.21.15.98:0/443667131 wait complete. 2024-09-16T15:38:53.968 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-16T15:38:54.071 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.069+0000 7f8b8269b640 1 -- 172.21.15.98:0/262947360 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b64003a00 msgr2=0x7f8b64003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:54.071 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.069+0000 7f8b8269b640 1 --2- 172.21.15.98:0/262947360 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b64003a00 0x7f8b64003e20 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c009b50 tx=0x7f8b64005830 comp rx=0 tx=0).stop 2024-09-16T15:38:54.071 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.069+0000 7f8b80c38640 1 -- 172.21.15.98:0/262947360 reap_dead start 2024-09-16T15:38:54.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.069+0000 7f8b8269b640 1 -- 172.21.15.98:0/262947360 shutdown_connections 2024-09-16T15:38:54.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.069+0000 7f8b8269b640 1 -- 172.21.15.98:0/262947360 >> 172.21.15.98:0/262947360 conn(0x7f8b7c0b2b90 msgr2=0x7f8b7c0b2f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:54.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.069+0000 7f8b8269b640 1 -- 172.21.15.98:0/262947360 shutdown_connections 2024-09-16T15:38:54.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.069+0000 7f8b8269b640 1 -- 172.21.15.98:0/262947360 wait complete. 2024-09-16T15:38:54.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.070+0000 7f8b8269b640 1 Processor -- start 2024-09-16T15:38:54.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.070+0000 7f8b8269b640 1 -- start start 2024-09-16T15:38:54.075 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.071+0000 7f8b8269b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b64003a00 0x7f8b7c14cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:54.075 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.071+0000 7f8b8269b640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8b7c14d270 0x7f8b7c1f4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:54.075 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.071+0000 7f8b8269b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b7c1f4a70 0x7f8b7c1f4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:54.075 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.071+0000 7f8b8269b640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8b7c0ce0a0 con 0x7f8b64003a00 2024-09-16T15:38:54.075 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.071+0000 7f8b8269b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8b7c0cdf20 con 0x7f8b7c1f4a70 2024-09-16T15:38:54.075 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.071+0000 7f8b8269b640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f8b7c070530 con 0x7f8b7c14d270 2024-09-16T15:38:54.075 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.071+0000 7f8b7bfff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b64003a00 0x7f8b7c14cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:54.075 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.071+0000 7f8b7bfff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b64003a00 0x7f8b7c14cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60320/0 (socket says 172.21.15.98:60320) 2024-09-16T15:38:54.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.071+0000 7f8b7bfff640 1 -- 172.21.15.98:0/2390754477 learned_addr learned my addr 172.21.15.98:0/2390754477 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:54.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.071+0000 7f8b7b7fe640 1 --2- 172.21.15.98:0/2390754477 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8b7c14d270 0x7f8b7c1f4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:54.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.071+0000 7f8b80c38640 1 --2- 172.21.15.98:0/2390754477 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b7c1f4a70 0x7f8b7c1f4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:54.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.072+0000 7f8b7bfff640 1 -- 172.21.15.98:0/2390754477 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8b7c14d270 msgr2=0x7f8b7c1f4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:54.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.072+0000 7f8b7bfff640 1 --2- 172.21.15.98:0/2390754477 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8b7c14d270 0x7f8b7c1f4530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:54.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.072+0000 7f8b7bfff640 1 -- 172.21.15.98:0/2390754477 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b7c1f4a70 msgr2=0x7f8b7c1f4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:54.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.072+0000 7f8b7bfff640 1 --2- 172.21.15.98:0/2390754477 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b7c1f4a70 0x7f8b7c1f4f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:54.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.072+0000 7f8b7bfff640 1 -- 172.21.15.98:0/2390754477 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b7c0b5a20 con 0x7f8b64003a00 2024-09-16T15:38:54.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.072+0000 7f8b80c38640 1 --2- 172.21.15.98:0/2390754477 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b7c1f4a70 0x7f8b7c1f4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T15:38:54.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.072+0000 7f8b7bfff640 1 --2- 172.21.15.98:0/2390754477 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b64003a00 0x7f8b7c14cd30 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c009c70 tx=0x7f8b6c033b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:54.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.072+0000 7f8b78ff9640 1 -- 172.21.15.98:0/2390754477 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b6c043030 con 0x7f8b64003a00 2024-09-16T15:38:54.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.072+0000 7f8b78ff9640 1 -- 172.21.15.98:0/2390754477 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8b6c02b800 con 0x7f8b64003a00 2024-09-16T15:38:54.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.072+0000 7f8b8269b640 1 -- 172.21.15.98:0/2390754477 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b7c0b5d00 con 0x7f8b64003a00 2024-09-16T15:38:54.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.072+0000 7f8b78ff9640 1 -- 172.21.15.98:0/2390754477 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b6c038040 con 0x7f8b64003a00 2024-09-16T15:38:54.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.072+0000 7f8b8269b640 1 -- 172.21.15.98:0/2390754477 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b7c0b62c0 con 0x7f8b64003a00 2024-09-16T15:38:54.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.073+0000 7f8b8269b640 1 -- 172.21.15.98:0/2390754477 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b7c0cfc40 con 0x7f8b64003a00 2024-09-16T15:38:54.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.074+0000 7f8b78ff9640 1 -- 172.21.15.98:0/2390754477 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 7) ==== 101440+0+0 (secure 0 0 0) 0x7f8b6c046070 con 0x7f8b64003a00 2024-09-16T15:38:54.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.074+0000 7f8b78ff9640 1 --2- 172.21.15.98:0/2390754477 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f8b68078a00 0x7f8b6807aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:54.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.074+0000 7f8b78ff9640 1 -- 172.21.15.98:0/2390754477 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f8b6c0bd5f0 con 0x7f8b64003a00 2024-09-16T15:38:54.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.074+0000 7f8b7b7fe640 1 --2- 172.21.15.98:0/2390754477 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f8b68078a00 0x7f8b6807aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:54.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.075+0000 7f8b7b7fe640 1 --2- 172.21.15.98:0/2390754477 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f8b68078a00 0x7f8b6807aec0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c14d670 tx=0x7f8b70005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:54.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.078+0000 7f8b78ff9640 1 -- 172.21.15.98:0/2390754477 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7f8b6c04d070 con 0x7f8b64003a00 2024-09-16T15:38:54.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.256+0000 7f8b8269b640 1 -- 172.21.15.98:0/2390754477 --> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f8b7c06ec90 con 0x7f8b68078a00 2024-09-16T15:38:54.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.256+0000 7f8b78ff9640 1 -- 172.21.15.98:0/2390754477 <== mgr.4100 v2:172.21.15.135:6800/699234772 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f8b7c06ec90 con 0x7f8b68078a00 2024-09-16T15:38:54.258 INFO:teuthology.orchestra.run.smithi098.stderr:instructed osd(s) 1 to deep-scrub 2024-09-16T15:38:54.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.259+0000 7f8b8269b640 1 -- 172.21.15.98:0/2390754477 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f8b68078a00 msgr2=0x7f8b6807aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:54.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.259+0000 7f8b8269b640 1 --2- 172.21.15.98:0/2390754477 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f8b68078a00 0x7f8b6807aec0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c14d670 tx=0x7f8b70005f90 comp rx=0 tx=0).stop 2024-09-16T15:38:54.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.259+0000 7f8b8269b640 1 -- 172.21.15.98:0/2390754477 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b64003a00 msgr2=0x7f8b7c14cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:54.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.259+0000 7f8b8269b640 1 --2- 172.21.15.98:0/2390754477 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b64003a00 0x7f8b7c14cd30 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c009c70 tx=0x7f8b6c033b10 comp rx=0 tx=0).stop 2024-09-16T15:38:54.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.259+0000 7f8b8269b640 1 -- 172.21.15.98:0/2390754477 shutdown_connections 2024-09-16T15:38:54.262 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.259+0000 7f8b8269b640 1 --2- 172.21.15.98:0/2390754477 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f8b68078a00 0x7f8b6807aec0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:54.262 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.259+0000 7f8b8269b640 1 --2- 172.21.15.98:0/2390754477 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b7c1f4a70 0x7f8b7c1f4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:54.262 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.259+0000 7f8b8269b640 1 --2- 172.21.15.98:0/2390754477 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8b7c14d270 0x7f8b7c1f4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:54.262 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.259+0000 7f8b8269b640 1 --2- 172.21.15.98:0/2390754477 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b64003a00 0x7f8b7c14cd30 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:54.262 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.259+0000 7f8b8269b640 1 -- 172.21.15.98:0/2390754477 >> 172.21.15.98:0/2390754477 conn(0x7f8b7c0b2b90 msgr2=0x7f8b7c15b530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:54.262 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.259+0000 7f8b8269b640 1 -- 172.21.15.98:0/2390754477 shutdown_connections 2024-09-16T15:38:54.262 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.259+0000 7f8b8269b640 1 -- 172.21.15.98:0/2390754477 wait complete. 2024-09-16T15:38:54.272 INFO:tasks.ceph:Scrubbing osd.2 2024-09-16T15:38:54.272 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-16T15:38:54.377 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.375+0000 7f3dd7dd3640 1 -- 172.21.15.98:0/223768984 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3dd015aba0 msgr2=0x7f3dd015af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:54.377 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.375+0000 7f3dd7dd3640 1 --2- 172.21.15.98:0/223768984 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3dd015aba0 0x7f3dd015af80 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc009860 tx=0x7f3dcc02a540 comp rx=0 tx=0).stop 2024-09-16T15:38:54.377 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.375+0000 7f3dd7dd3640 1 -- 172.21.15.98:0/223768984 shutdown_connections 2024-09-16T15:38:54.377 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.375+0000 7f3dd7dd3640 1 --2- 172.21.15.98:0/223768984 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3dd015aba0 0x7f3dd015af80 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:54.377 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.375+0000 7f3dd7dd3640 1 -- 172.21.15.98:0/223768984 >> 172.21.15.98:0/223768984 conn(0x7f3dd006cb70 msgr2=0x7f3dd006cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:54.378 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.375+0000 7f3dd7dd3640 1 -- 172.21.15.98:0/223768984 shutdown_connections 2024-09-16T15:38:54.378 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.375+0000 7f3dd7dd3640 1 -- 172.21.15.98:0/223768984 wait complete. 2024-09-16T15:38:54.380 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.376+0000 7f3dd7dd3640 1 Processor -- start 2024-09-16T15:38:54.380 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.376+0000 7f3dd7dd3640 1 -- start start 2024-09-16T15:38:54.380 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.377+0000 7f3dd7dd3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3dd0073780 0x7f3dd00c53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:54.381 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.377+0000 7f3dd7dd3640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3dd0073fd0 0x7f3dd0157a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:54.381 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.377+0000 7f3dd7dd3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3dd015aba0 0x7f3dd00d0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:54.381 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.377+0000 7f3dd7dd3640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd006fb30 con 0x7f3dd0073780 2024-09-16T15:38:54.381 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.377+0000 7f3dd7dd3640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd006f9b0 con 0x7f3dd015aba0 2024-09-16T15:38:54.381 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.377+0000 7f3dd7dd3640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f3dd006fcb0 con 0x7f3dd0073fd0 2024-09-16T15:38:54.381 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.377+0000 7f3dd5b6f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3dd0073780 0x7f3dd00c53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:54.381 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.377+0000 7f3dd5b6f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3dd0073780 0x7f3dd00c53a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60344/0 (socket says 172.21.15.98:60344) 2024-09-16T15:38:54.381 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.377+0000 7f3dd5b6f640 1 -- 172.21.15.98:0/1543918989 learned_addr learned my addr 172.21.15.98:0/1543918989 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:54.381 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.377+0000 7f3dd6370640 1 --2- 172.21.15.98:0/1543918989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3dd015aba0 0x7f3dd00d0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:54.381 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.377+0000 7f3dd536e640 1 --2- 172.21.15.98:0/1543918989 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3dd0073fd0 0x7f3dd0157a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:54.381 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.377+0000 7f3dd5b6f640 1 -- 172.21.15.98:0/1543918989 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3dd0073fd0 msgr2=0x7f3dd0157a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:54.381 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.377+0000 7f3dd5b6f640 1 --2- 172.21.15.98:0/1543918989 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3dd0073fd0 0x7f3dd0157a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:54.382 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.377+0000 7f3dd5b6f640 1 -- 172.21.15.98:0/1543918989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3dd015aba0 msgr2=0x7f3dd00d0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:54.382 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.377+0000 7f3dd5b6f640 1 --2- 172.21.15.98:0/1543918989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3dd015aba0 0x7f3dd00d0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:54.382 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.377+0000 7f3dd5b6f640 1 -- 172.21.15.98:0/1543918989 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dd01f5850 con 0x7f3dd0073780 2024-09-16T15:38:54.382 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.377+0000 7f3dd536e640 1 --2- 172.21.15.98:0/1543918989 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f3dd0073fd0 0x7f3dd0157a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T15:38:54.382 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.377+0000 7f3dd5b6f640 1 --2- 172.21.15.98:0/1543918989 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3dd0073780 0x7f3dd00c53a0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc009980 tx=0x7f3dcc033d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:54.382 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.377+0000 7f3dc67fc640 1 -- 172.21.15.98:0/1543918989 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc031d60 con 0x7f3dd0073780 2024-09-16T15:38:54.382 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.377+0000 7f3dc67fc640 1 -- 172.21.15.98:0/1543918989 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3dcc005020 con 0x7f3dd0073780 2024-09-16T15:38:54.382 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.377+0000 7f3dd7dd3640 1 -- 172.21.15.98:0/1543918989 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dd01f4a90 con 0x7f3dd0073780 2024-09-16T15:38:54.382 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.377+0000 7f3dc67fc640 1 -- 172.21.15.98:0/1543918989 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc005450 con 0x7f3dd0073780 2024-09-16T15:38:54.382 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.377+0000 7f3dd7dd3640 1 -- 172.21.15.98:0/1543918989 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dd01f5050 con 0x7f3dd0073780 2024-09-16T15:38:54.382 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.378+0000 7f3dd7dd3640 1 -- 172.21.15.98:0/1543918989 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3dd00c5980 con 0x7f3dd0073780 2024-09-16T15:38:54.384 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.379+0000 7f3dc67fc640 1 -- 172.21.15.98:0/1543918989 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 7) ==== 101440+0+0 (secure 0 0 0) 0x7f3dcc0047a0 con 0x7f3dd0073780 2024-09-16T15:38:54.384 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.380+0000 7f3dc67fc640 1 --2- 172.21.15.98:0/1543918989 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f3db4078a00 0x7f3db407aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:54.384 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.380+0000 7f3dc67fc640 1 -- 172.21.15.98:0/1543918989 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f3dcc0bc110 con 0x7f3dd0073780 2024-09-16T15:38:54.384 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.380+0000 7f3dc67fc640 1 --2- 172.21.15.98:0/1543918989 >> [v2:172.21.15.98:6800/2573210695,v1:172.21.15.98:6801/2573210695] conn(0x7f3db407e8c0 0x7f3db4080ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:54.384 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.380+0000 7f3dc67fc640 1 -- 172.21.15.98:0/1543918989 --> [v2:172.21.15.98:6800/2573210695,v1:172.21.15.98:6801/2573210695] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3dcc045e50 con 0x7f3db407e8c0 2024-09-16T15:38:54.384 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.380+0000 7f3dc67fc640 1 -- 172.21.15.98:0/1543918989 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f3dcc0bc5a0 con 0x7f3dd0073780 2024-09-16T15:38:54.384 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.380+0000 7f3dd536e640 1 --2- 172.21.15.98:0/1543918989 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f3db4078a00 0x7f3db407aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:54.384 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.380+0000 7f3dd6370640 1 --2- 172.21.15.98:0/1543918989 >> [v2:172.21.15.98:6800/2573210695,v1:172.21.15.98:6801/2573210695] conn(0x7f3db407e8c0 0x7f3db4080ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:54.384 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.380+0000 7f3dd6370640 1 --2- 172.21.15.98:0/1543918989 >> [v2:172.21.15.98:6800/2573210695,v1:172.21.15.98:6801/2573210695] conn(0x7f3db407e8c0 0x7f3db4080ce0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:54.384 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.380+0000 7f3dd536e640 1 --2- 172.21.15.98:0/1543918989 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f3db4078a00 0x7f3db407aec0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3dc0007fd0 tx=0x7f3dc0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:54.385 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.381+0000 7f3dc67fc640 1 -- 172.21.15.98:0/1543918989 <== osd.2 v2:172.21.15.98:6800/2573210695 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3dcc045e50 con 0x7f3db407e8c0 2024-09-16T15:38:54.395 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.393+0000 7f3dd7dd3640 1 -- 172.21.15.98:0/1543918989 --> [v2:172.21.15.98:6800/2573210695,v1:172.21.15.98:6801/2573210695] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f3dd00701c0 con 0x7f3db407e8c0 2024-09-16T15:38:54.395 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.393+0000 7f3dc67fc640 1 -- 172.21.15.98:0/1543918989 <== osd.2 v2:172.21.15.98:6800/2573210695 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f3dd00701c0 con 0x7f3db407e8c0 2024-09-16T15:38:54.396 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-16T15:38:54.396 INFO:teuthology.orchestra.run.smithi098.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-16T15:38:54.396 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-16T15:38:54.397 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.394+0000 7f3dd7dd3640 1 -- 172.21.15.98:0/1543918989 >> [v2:172.21.15.98:6800/2573210695,v1:172.21.15.98:6801/2573210695] conn(0x7f3db407e8c0 msgr2=0x7f3db4080ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:54.397 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.394+0000 7f3dd7dd3640 1 --2- 172.21.15.98:0/1543918989 >> [v2:172.21.15.98:6800/2573210695,v1:172.21.15.98:6801/2573210695] conn(0x7f3db407e8c0 0x7f3db4080ce0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:54.397 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.394+0000 7f3dd7dd3640 1 -- 172.21.15.98:0/1543918989 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f3db4078a00 msgr2=0x7f3db407aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:54.397 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.394+0000 7f3dd7dd3640 1 --2- 172.21.15.98:0/1543918989 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f3db4078a00 0x7f3db407aec0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3dc0007fd0 tx=0x7f3dc0009040 comp rx=0 tx=0).stop 2024-09-16T15:38:54.397 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.394+0000 7f3dd7dd3640 1 -- 172.21.15.98:0/1543918989 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3dd0073780 msgr2=0x7f3dd00c53a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:54.397 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.394+0000 7f3dd7dd3640 1 --2- 172.21.15.98:0/1543918989 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3dd0073780 0x7f3dd00c53a0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc009980 tx=0x7f3dcc033d60 comp rx=0 tx=0).stop 2024-09-16T15:38:54.397 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.394+0000 7f3dd6370640 1 -- 172.21.15.98:0/1543918989 reap_dead start 2024-09-16T15:38:54.397 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.394+0000 7f3dd7dd3640 1 -- 172.21.15.98:0/1543918989 shutdown_connections 2024-09-16T15:38:54.398 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.394+0000 7f3dd7dd3640 1 -- 172.21.15.98:0/1543918989 >> 172.21.15.98:0/1543918989 conn(0x7f3dd006cb70 msgr2=0x7f3dd00cd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:54.398 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.394+0000 7f3dd7dd3640 1 -- 172.21.15.98:0/1543918989 shutdown_connections 2024-09-16T15:38:54.398 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.394+0000 7f3dd7dd3640 1 -- 172.21.15.98:0/1543918989 wait complete. 2024-09-16T15:38:54.406 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-16T15:38:54.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.506+0000 7f100bb9c640 1 -- 172.21.15.98:0/605916972 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10040d2050 msgr2=0x7f10040d10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:54.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.506+0000 7f100bb9c640 1 --2- 172.21.15.98:0/605916972 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10040d2050 0x7f10040d10d0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f0ff8009830 tx=0x7f0ff802a510 comp rx=0 tx=0).stop 2024-09-16T15:38:54.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.506+0000 7f100bb9c640 1 -- 172.21.15.98:0/605916972 shutdown_connections 2024-09-16T15:38:54.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.506+0000 7f100bb9c640 1 --2- 172.21.15.98:0/605916972 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f10040d1610 0x7f10040cecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:54.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.506+0000 7f100bb9c640 1 --2- 172.21.15.98:0/605916972 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10040d2050 0x7f10040d10d0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:54.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.506+0000 7f100bb9c640 1 -- 172.21.15.98:0/605916972 >> 172.21.15.98:0/605916972 conn(0x7f10040d3fe0 msgr2=0x7f10040d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:54.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.506+0000 7f100bb9c640 1 -- 172.21.15.98:0/605916972 shutdown_connections 2024-09-16T15:38:54.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.506+0000 7f100bb9c640 1 -- 172.21.15.98:0/605916972 wait complete. 2024-09-16T15:38:54.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.507+0000 7f100bb9c640 1 Processor -- start 2024-09-16T15:38:54.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.508+0000 7f100bb9c640 1 -- start start 2024-09-16T15:38:54.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.508+0000 7f100bb9c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10040d1610 0x7f10040a13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:54.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.508+0000 7f100bb9c640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f10040d2050 0x7f10041f4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:54.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.508+0000 7f100bb9c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f100415e0d0 0x7f10041f5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:54.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.508+0000 7f100bb9c640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f10040cf5d0 con 0x7f100415e0d0 2024-09-16T15:38:54.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.508+0000 7f100bb9c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f10040cf450 con 0x7f10040d1610 2024-09-16T15:38:54.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.508+0000 7f100bb9c640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f10040cf750 con 0x7f10040d2050 2024-09-16T15:38:54.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.508+0000 7f100a139640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f100415e0d0 0x7f10041f5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:54.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.508+0000 7f100a139640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f100415e0d0 0x7f10041f5140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60368/0 (socket says 172.21.15.98:60368) 2024-09-16T15:38:54.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.508+0000 7f100a139640 1 -- 172.21.15.98:0/2878247180 learned_addr learned my addr 172.21.15.98:0/2878247180 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:54.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.509+0000 7f1009137640 1 --2- 172.21.15.98:0/2878247180 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f10040d2050 0x7f10041f4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:54.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.509+0000 7f1009938640 1 --2- 172.21.15.98:0/2878247180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10040d1610 0x7f10040a13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:54.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.509+0000 7f100a139640 1 -- 172.21.15.98:0/2878247180 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f10040d2050 msgr2=0x7f10041f4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:54.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.509+0000 7f100a139640 1 --2- 172.21.15.98:0/2878247180 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f10040d2050 0x7f10041f4c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:54.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.509+0000 7f100a139640 1 -- 172.21.15.98:0/2878247180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10040d1610 msgr2=0x7f10040a13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:54.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.509+0000 7f100a139640 1 --2- 172.21.15.98:0/2878247180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10040d1610 0x7f10040a13a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:54.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.509+0000 7f100a139640 1 -- 172.21.15.98:0/2878247180 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10040cda20 con 0x7f100415e0d0 2024-09-16T15:38:54.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.509+0000 7f100a139640 1 --2- 172.21.15.98:0/2878247180 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f100415e0d0 0x7f10041f5140 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f0ff400e9d0 tx=0x7f0ff400ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:54.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.509+0000 7f10027fc640 1 -- 172.21.15.98:0/2878247180 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ff400cd80 con 0x7f100415e0d0 2024-09-16T15:38:54.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.509+0000 7f10027fc640 1 -- 172.21.15.98:0/2878247180 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0ff4004c30 con 0x7f100415e0d0 2024-09-16T15:38:54.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.509+0000 7f10027fc640 1 -- 172.21.15.98:0/2878247180 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ff4005280 con 0x7f100415e0d0 2024-09-16T15:38:54.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.509+0000 7f100bb9c640 1 -- 172.21.15.98:0/2878247180 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10040ccea0 con 0x7f100415e0d0 2024-09-16T15:38:54.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.509+0000 7f100bb9c640 1 -- 172.21.15.98:0/2878247180 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10040cd460 con 0x7f100415e0d0 2024-09-16T15:38:54.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.510+0000 7f100bb9c640 1 -- 172.21.15.98:0/2878247180 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10040cfc70 con 0x7f100415e0d0 2024-09-16T15:38:54.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.511+0000 7f10027fc640 1 -- 172.21.15.98:0/2878247180 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 7) ==== 101440+0+0 (secure 0 0 0) 0x7f0ff4005420 con 0x7f100415e0d0 2024-09-16T15:38:54.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.511+0000 7f10027fc640 1 --2- 172.21.15.98:0/2878247180 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f0ff0078a00 0x7f0ff007aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:54.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.512+0000 7f10027fc640 1 -- 172.21.15.98:0/2878247180 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f0ff409b370 con 0x7f100415e0d0 2024-09-16T15:38:54.515 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.512+0000 7f1009938640 1 --2- 172.21.15.98:0/2878247180 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f0ff0078a00 0x7f0ff007aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:54.515 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.512+0000 7f1009938640 1 --2- 172.21.15.98:0/2878247180 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f0ff0078a00 0x7f0ff007aec0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc000f60 tx=0x7f0ffc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:54.517 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.516+0000 7f10027fc640 1 -- 172.21.15.98:0/2878247180 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7f0ff4016030 con 0x7f100415e0d0 2024-09-16T15:38:54.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.694+0000 7f100bb9c640 1 -- 172.21.15.98:0/2878247180 --> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f100415d970 con 0x7f0ff0078a00 2024-09-16T15:38:54.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.694+0000 7f10027fc640 1 -- 172.21.15.98:0/2878247180 <== mgr.4100 v2:172.21.15.135:6800/699234772 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f100415d970 con 0x7f0ff0078a00 2024-09-16T15:38:54.696 INFO:teuthology.orchestra.run.smithi098.stderr:instructed osd(s) 2 to deep-scrub 2024-09-16T15:38:54.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.696+0000 7f100bb9c640 1 -- 172.21.15.98:0/2878247180 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f0ff0078a00 msgr2=0x7f0ff007aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:54.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.696+0000 7f100bb9c640 1 --2- 172.21.15.98:0/2878247180 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f0ff0078a00 0x7f0ff007aec0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc000f60 tx=0x7f0ffc009040 comp rx=0 tx=0).stop 2024-09-16T15:38:54.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.696+0000 7f100bb9c640 1 -- 172.21.15.98:0/2878247180 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f100415e0d0 msgr2=0x7f10041f5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:54.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.696+0000 7f100bb9c640 1 --2- 172.21.15.98:0/2878247180 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f100415e0d0 0x7f10041f5140 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f0ff400e9d0 tx=0x7f0ff400ee90 comp rx=0 tx=0).stop 2024-09-16T15:38:54.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.696+0000 7f100bb9c640 1 -- 172.21.15.98:0/2878247180 shutdown_connections 2024-09-16T15:38:54.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.696+0000 7f100bb9c640 1 --2- 172.21.15.98:0/2878247180 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f100415e0d0 0x7f10041f5140 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:54.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.696+0000 7f100bb9c640 1 --2- 172.21.15.98:0/2878247180 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f10040d2050 0x7f10041f4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:54.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.696+0000 7f100bb9c640 1 --2- 172.21.15.98:0/2878247180 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f0ff0078a00 0x7f0ff007aec0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:54.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.696+0000 7f100bb9c640 1 --2- 172.21.15.98:0/2878247180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10040d1610 0x7f10040a13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:54.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.696+0000 7f100bb9c640 1 -- 172.21.15.98:0/2878247180 >> 172.21.15.98:0/2878247180 conn(0x7f10040d3fe0 msgr2=0x7f10040b8e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:54.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.696+0000 7f100bb9c640 1 -- 172.21.15.98:0/2878247180 shutdown_connections 2024-09-16T15:38:54.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.696+0000 7f100bb9c640 1 -- 172.21.15.98:0/2878247180 wait complete. 2024-09-16T15:38:54.709 INFO:tasks.ceph:Scrubbing osd.3 2024-09-16T15:38:54.709 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-16T15:38:54.815 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.813+0000 7efdd2fc2640 1 -- 172.21.15.98:0/446325230 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdcc0b8900 msgr2=0x7efdcc0d0d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:54.815 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.813+0000 7efdd2fc2640 1 --2- 172.21.15.98:0/446325230 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdcc0b8900 0x7efdcc0d0d40 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7efdc4005fd0 tx=0x7efdc402a670 comp rx=0 tx=0).stop 2024-09-16T15:38:54.815 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.813+0000 7efdd2fc2640 1 -- 172.21.15.98:0/446325230 shutdown_connections 2024-09-16T15:38:54.815 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.813+0000 7efdd2fc2640 1 --2- 172.21.15.98:0/446325230 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdcc0b8900 0x7efdcc0d0d40 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:54.815 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.813+0000 7efdd2fc2640 1 --2- 172.21.15.98:0/446325230 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efdcc15e340 0x7efdcc0d0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:54.815 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.813+0000 7efdd2fc2640 1 -- 172.21.15.98:0/446325230 >> 172.21.15.98:0/446325230 conn(0x7efdcc0d4050 msgr2=0x7efdcc0d4460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:54.815 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.813+0000 7efdd2fc2640 1 -- 172.21.15.98:0/446325230 shutdown_connections 2024-09-16T15:38:54.815 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.813+0000 7efdd2fc2640 1 -- 172.21.15.98:0/446325230 wait complete. 2024-09-16T15:38:54.816 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.814+0000 7efdd2fc2640 1 Processor -- start 2024-09-16T15:38:54.816 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.814+0000 7efdd2fc2640 1 -- start start 2024-09-16T15:38:54.818 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.815+0000 7efdd2fc2640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efdcc0b8900 0x7efdcc0ca470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:54.818 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.815+0000 7efdd2fc2640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efdcc15e340 0x7efdcc0b8da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:54.818 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.815+0000 7efdd2fc2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdcc160830 0x7efdcc0b92e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:54.818 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.815+0000 7efdd2fc2640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7efdcc0d2590 con 0x7efdcc15e340 2024-09-16T15:38:54.818 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.815+0000 7efdd2fc2640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7efdcc0d2410 con 0x7efdcc160830 2024-09-16T15:38:54.818 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.815+0000 7efdd2fc2640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7efdcc0d2710 con 0x7efdcc0b8900 2024-09-16T15:38:54.818 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.815+0000 7efdcbfff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efdcc15e340 0x7efdcc0b8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:54.818 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.815+0000 7efdcbfff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efdcc15e340 0x7efdcc0b8da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60382/0 (socket says 172.21.15.98:60382) 2024-09-16T15:38:54.818 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.815+0000 7efdcbfff640 1 -- 172.21.15.98:0/3616986048 learned_addr learned my addr 172.21.15.98:0/3616986048 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:54.818 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.815+0000 7efdd0d5e640 1 --2- 172.21.15.98:0/3616986048 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efdcc0b8900 0x7efdcc0ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:54.818 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.815+0000 7efdd155f640 1 --2- 172.21.15.98:0/3616986048 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdcc160830 0x7efdcc0b92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:54.818 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.815+0000 7efdcbfff640 1 -- 172.21.15.98:0/3616986048 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efdcc0b8900 msgr2=0x7efdcc0ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:54.819 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.815+0000 7efdcbfff640 1 --2- 172.21.15.98:0/3616986048 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7efdcc0b8900 0x7efdcc0ca470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:54.819 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.815+0000 7efdcbfff640 1 -- 172.21.15.98:0/3616986048 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdcc160830 msgr2=0x7efdcc0b92e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:54.819 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.815+0000 7efdcbfff640 1 --2- 172.21.15.98:0/3616986048 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdcc160830 0x7efdcc0b92e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:54.819 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.815+0000 7efdcbfff640 1 -- 172.21.15.98:0/3616986048 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdcc1f8170 con 0x7efdcc15e340 2024-09-16T15:38:54.819 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.815+0000 7efdcbfff640 1 --2- 172.21.15.98:0/3616986048 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efdcc15e340 0x7efdcc0b8da0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7efdb400c450 tx=0x7efdb400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:54.819 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.816+0000 7efdc97fa640 1 -- 172.21.15.98:0/3616986048 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb40052d0 con 0x7efdcc15e340 2024-09-16T15:38:54.819 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.816+0000 7efdc97fa640 1 -- 172.21.15.98:0/3616986048 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efdb4005470 con 0x7efdcc15e340 2024-09-16T15:38:54.819 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.816+0000 7efdd2fc2640 1 -- 172.21.15.98:0/3616986048 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdcc1f8450 con 0x7efdcc15e340 2024-09-16T15:38:54.819 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.816+0000 7efdc97fa640 1 -- 172.21.15.98:0/3616986048 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb4012870 con 0x7efdcc15e340 2024-09-16T15:38:54.819 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.816+0000 7efdd2fc2640 1 -- 172.21.15.98:0/3616986048 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdcc1f8a10 con 0x7efdcc15e340 2024-09-16T15:38:54.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.816+0000 7efdd2fc2640 1 -- 172.21.15.98:0/3616986048 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7efdcc0ca9b0 con 0x7efdcc15e340 2024-09-16T15:38:54.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.817+0000 7efdc97fa640 1 -- 172.21.15.98:0/3616986048 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 7) ==== 101440+0+0 (secure 0 0 0) 0x7efdb40035f0 con 0x7efdcc15e340 2024-09-16T15:38:54.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.818+0000 7efdc97fa640 1 --2- 172.21.15.98:0/3616986048 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7efdac078a30 0x7efdac07aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:54.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.818+0000 7efdc97fa640 1 -- 172.21.15.98:0/3616986048 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7efdb409a450 con 0x7efdcc15e340 2024-09-16T15:38:54.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.818+0000 7efdc97fa640 1 --2- 172.21.15.98:0/3616986048 >> [v2:172.21.15.98:6816/3951374837,v1:172.21.15.98:6817/3951374837] conn(0x7efdac07e8f0 0x7efdac080d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:54.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.818+0000 7efdc97fa640 1 -- 172.21.15.98:0/3616986048 --> [v2:172.21.15.98:6816/3951374837,v1:172.21.15.98:6817/3951374837] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efdac0813c0 con 0x7efdac07e8f0 2024-09-16T15:38:54.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.818+0000 7efdd0d5e640 1 --2- 172.21.15.98:0/3616986048 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7efdac078a30 0x7efdac07aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:54.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.818+0000 7efdc97fa640 1 -- 172.21.15.98:0/3616986048 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7efdb40a1050 con 0x7efdcc15e340 2024-09-16T15:38:54.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.818+0000 7efdd155f640 1 --2- 172.21.15.98:0/3616986048 >> [v2:172.21.15.98:6816/3951374837,v1:172.21.15.98:6817/3951374837] conn(0x7efdac07e8f0 0x7efdac080d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:54.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.818+0000 7efdd155f640 1 --2- 172.21.15.98:0/3616986048 >> [v2:172.21.15.98:6816/3951374837,v1:172.21.15.98:6817/3951374837] conn(0x7efdac07e8f0 0x7efdac080d10 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:54.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.818+0000 7efdd0d5e640 1 --2- 172.21.15.98:0/3616986048 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7efdac078a30 0x7efdac07aef0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7efdcc0b5400 tx=0x7efdbc009500 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:54.822 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.819+0000 7efdc97fa640 1 -- 172.21.15.98:0/3616986048 <== osd.3 v2:172.21.15.98:6816/3951374837 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7efdac0813c0 con 0x7efdac07e8f0 2024-09-16T15:38:54.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.831+0000 7efdd2fc2640 1 -- 172.21.15.98:0/3616986048 --> [v2:172.21.15.98:6816/3951374837,v1:172.21.15.98:6817/3951374837] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7efdcc0d3220 con 0x7efdac07e8f0 2024-09-16T15:38:54.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.831+0000 7efdc97fa640 1 -- 172.21.15.98:0/3616986048 <== osd.3 v2:172.21.15.98:6816/3951374837 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7efdcc0d3220 con 0x7efdac07e8f0 2024-09-16T15:38:54.834 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-16T15:38:54.834 INFO:teuthology.orchestra.run.smithi098.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-16T15:38:54.834 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-16T15:38:54.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.832+0000 7efdd2fc2640 1 -- 172.21.15.98:0/3616986048 >> [v2:172.21.15.98:6816/3951374837,v1:172.21.15.98:6817/3951374837] conn(0x7efdac07e8f0 msgr2=0x7efdac080d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:54.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.832+0000 7efdd2fc2640 1 --2- 172.21.15.98:0/3616986048 >> [v2:172.21.15.98:6816/3951374837,v1:172.21.15.98:6817/3951374837] conn(0x7efdac07e8f0 0x7efdac080d10 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:54.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.832+0000 7efdd2fc2640 1 -- 172.21.15.98:0/3616986048 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7efdac078a30 msgr2=0x7efdac07aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:54.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.832+0000 7efdd2fc2640 1 --2- 172.21.15.98:0/3616986048 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7efdac078a30 0x7efdac07aef0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7efdcc0b5400 tx=0x7efdbc009500 comp rx=0 tx=0).stop 2024-09-16T15:38:54.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.832+0000 7efdd2fc2640 1 -- 172.21.15.98:0/3616986048 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efdcc15e340 msgr2=0x7efdcc0b8da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:54.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.832+0000 7efdd2fc2640 1 --2- 172.21.15.98:0/3616986048 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efdcc15e340 0x7efdcc0b8da0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7efdb400c450 tx=0x7efdb400c910 comp rx=0 tx=0).stop 2024-09-16T15:38:54.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.832+0000 7efdd155f640 1 -- 172.21.15.98:0/3616986048 reap_dead start 2024-09-16T15:38:54.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.832+0000 7efdd2fc2640 1 -- 172.21.15.98:0/3616986048 shutdown_connections 2024-09-16T15:38:54.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.832+0000 7efdd2fc2640 1 -- 172.21.15.98:0/3616986048 >> 172.21.15.98:0/3616986048 conn(0x7efdcc0d4050 msgr2=0x7efdcc0d4430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:54.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.832+0000 7efdd2fc2640 1 -- 172.21.15.98:0/3616986048 shutdown_connections 2024-09-16T15:38:54.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.832+0000 7efdd2fc2640 1 -- 172.21.15.98:0/3616986048 wait complete. 2024-09-16T15:38:54.845 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-16T15:38:54.948 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.946+0000 7f17bd152640 1 -- 172.21.15.98:0/4172700284 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f17b8073bb0 msgr2=0x7f17b806ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:54.949 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.946+0000 7f17bd152640 1 --2- 172.21.15.98:0/4172700284 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f17b8073bb0 0x7f17b806ee70 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f17b0005fd0 tx=0x7f17b002a980 comp rx=0 tx=0).stop 2024-09-16T15:38:54.949 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.946+0000 7f17bd152640 1 -- 172.21.15.98:0/4172700284 shutdown_connections 2024-09-16T15:38:54.949 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.946+0000 7f17bd152640 1 --2- 172.21.15.98:0/4172700284 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f17b8073bb0 0x7f17b806ee70 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:54.949 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.946+0000 7f17bd152640 1 --2- 172.21.15.98:0/4172700284 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f17b80b43f0 0x7f17b80b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:54.949 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.946+0000 7f17bd152640 1 -- 172.21.15.98:0/4172700284 >> 172.21.15.98:0/4172700284 conn(0x7f17b80b1950 msgr2=0x7f17b80b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:54.949 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.946+0000 7f17bd152640 1 -- 172.21.15.98:0/4172700284 shutdown_connections 2024-09-16T15:38:54.949 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.946+0000 7f17bd152640 1 -- 172.21.15.98:0/4172700284 wait complete. 2024-09-16T15:38:54.950 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.948+0000 7f17bd152640 1 Processor -- start 2024-09-16T15:38:54.950 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.948+0000 7f17bd152640 1 -- start start 2024-09-16T15:38:54.952 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.948+0000 7f17bd152640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f17b8073bb0 0x7f17b815a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:54.952 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.948+0000 7f17bd152640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f17b8074150 0x7f17b8156360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:54.952 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.948+0000 7f17bd152640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f17b80b43f0 0x7f17b809aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:54.952 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.948+0000 7f17bd152640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f17b806f530 con 0x7f17b8073bb0 2024-09-16T15:38:54.952 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.948+0000 7f17bd152640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f17b806f3b0 con 0x7f17b80b43f0 2024-09-16T15:38:54.952 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.948+0000 7f17bd152640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f17b80746a0 con 0x7f17b8074150 2024-09-16T15:38:54.952 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.948+0000 7f17b6d9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f17b8073bb0 0x7f17b815a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:54.952 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.948+0000 7f17b6d9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f17b8073bb0 0x7f17b815a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60400/0 (socket says 172.21.15.98:60400) 2024-09-16T15:38:54.952 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.948+0000 7f17b6d9d640 1 -- 172.21.15.98:0/2155893209 learned_addr learned my addr 172.21.15.98:0/2155893209 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:54.952 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.949+0000 7f17b759e640 1 --2- 172.21.15.98:0/2155893209 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f17b80b43f0 0x7f17b809aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:54.953 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.949+0000 7f17affff640 1 --2- 172.21.15.98:0/2155893209 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f17b8074150 0x7f17b8156360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:54.953 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.949+0000 7f17b6d9d640 1 -- 172.21.15.98:0/2155893209 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f17b8074150 msgr2=0x7f17b8156360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:54.953 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.949+0000 7f17b6d9d640 1 --2- 172.21.15.98:0/2155893209 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f17b8074150 0x7f17b8156360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:54.953 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.949+0000 7f17b6d9d640 1 -- 172.21.15.98:0/2155893209 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f17b80b43f0 msgr2=0x7f17b809aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:54.953 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.949+0000 7f17b6d9d640 1 --2- 172.21.15.98:0/2155893209 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f17b80b43f0 0x7f17b809aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:54.953 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.949+0000 7f17b6d9d640 1 -- 172.21.15.98:0/2155893209 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17b81f3060 con 0x7f17b8073bb0 2024-09-16T15:38:54.953 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.949+0000 7f17b759e640 1 --2- 172.21.15.98:0/2155893209 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f17b80b43f0 0x7f17b809aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T15:38:54.953 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.949+0000 7f17b6d9d640 1 --2- 172.21.15.98:0/2155893209 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f17b8073bb0 0x7f17b815a380 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f17a800d6d0 tx=0x7f17a800db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:54.953 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.949+0000 7f17af7fe640 1 -- 172.21.15.98:0/2155893209 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17a8017070 con 0x7f17b8073bb0 2024-09-16T15:38:54.953 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.949+0000 7f17af7fe640 1 -- 172.21.15.98:0/2155893209 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f17a8005330 con 0x7f17b8073bb0 2024-09-16T15:38:54.953 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.949+0000 7f17bd152640 1 -- 172.21.15.98:0/2155893209 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17b81f3340 con 0x7f17b8073bb0 2024-09-16T15:38:54.953 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.949+0000 7f17af7fe640 1 -- 172.21.15.98:0/2155893209 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17a8009820 con 0x7f17b8073bb0 2024-09-16T15:38:54.953 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.949+0000 7f17bd152640 1 -- 172.21.15.98:0/2155893209 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17b81f3be0 con 0x7f17b8073bb0 2024-09-16T15:38:54.953 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.950+0000 7f17bd152640 1 -- 172.21.15.98:0/2155893209 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17b81f3730 con 0x7f17b8073bb0 2024-09-16T15:38:54.954 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.951+0000 7f17af7fe640 1 -- 172.21.15.98:0/2155893209 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 7) ==== 101440+0+0 (secure 0 0 0) 0x7f17a8009bd0 con 0x7f17b8073bb0 2024-09-16T15:38:54.954 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.951+0000 7f17af7fe640 1 --2- 172.21.15.98:0/2155893209 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f1798078a00 0x7f179807aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:54.954 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.951+0000 7f17af7fe640 1 -- 172.21.15.98:0/2155893209 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f17a809ad90 con 0x7f17b8073bb0 2024-09-16T15:38:54.954 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.951+0000 7f17affff640 1 --2- 172.21.15.98:0/2155893209 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f1798078a00 0x7f179807aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:54.955 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.952+0000 7f17affff640 1 --2- 172.21.15.98:0/2155893209 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f1798078a00 0x7f179807aec0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f17b8153e90 tx=0x7f17a0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:54.957 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:54.955+0000 7f17af7fe640 1 -- 172.21.15.98:0/2155893209 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7f17a8063370 con 0x7f17b8073bb0 2024-09-16T15:38:55.136 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.134+0000 7f17bd152640 1 -- 172.21.15.98:0/2155893209 --> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f17b80b3ed0 con 0x7f1798078a00 2024-09-16T15:38:55.137 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.135+0000 7f17af7fe640 1 -- 172.21.15.98:0/2155893209 <== mgr.4100 v2:172.21.15.135:6800/699234772 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f17b80b3ed0 con 0x7f1798078a00 2024-09-16T15:38:55.137 INFO:teuthology.orchestra.run.smithi098.stderr:instructed osd(s) 3 to deep-scrub 2024-09-16T15:38:55.139 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.137+0000 7f17bd152640 1 -- 172.21.15.98:0/2155893209 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f1798078a00 msgr2=0x7f179807aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:55.140 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.137+0000 7f17bd152640 1 --2- 172.21.15.98:0/2155893209 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f1798078a00 0x7f179807aec0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f17b8153e90 tx=0x7f17a0009040 comp rx=0 tx=0).stop 2024-09-16T15:38:55.140 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.137+0000 7f17bd152640 1 -- 172.21.15.98:0/2155893209 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f17b8073bb0 msgr2=0x7f17b815a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:55.140 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.137+0000 7f17bd152640 1 --2- 172.21.15.98:0/2155893209 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f17b8073bb0 0x7f17b815a380 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f17a800d6d0 tx=0x7f17a800db90 comp rx=0 tx=0).stop 2024-09-16T15:38:55.140 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.137+0000 7f17bd152640 1 -- 172.21.15.98:0/2155893209 shutdown_connections 2024-09-16T15:38:55.140 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.137+0000 7f17bd152640 1 --2- 172.21.15.98:0/2155893209 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f1798078a00 0x7f179807aec0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:55.140 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.137+0000 7f17bd152640 1 --2- 172.21.15.98:0/2155893209 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f17b80b43f0 0x7f17b809aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:55.140 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.137+0000 7f17bd152640 1 --2- 172.21.15.98:0/2155893209 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f17b8074150 0x7f17b8156360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:55.140 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.137+0000 7f17bd152640 1 --2- 172.21.15.98:0/2155893209 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f17b8073bb0 0x7f17b815a380 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:55.140 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.137+0000 7f17bd152640 1 -- 172.21.15.98:0/2155893209 >> 172.21.15.98:0/2155893209 conn(0x7f17b80b1950 msgr2=0x7f17b80b0840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:55.140 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.137+0000 7f17bd152640 1 -- 172.21.15.98:0/2155893209 shutdown_connections 2024-09-16T15:38:55.140 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.137+0000 7f17bd152640 1 -- 172.21.15.98:0/2155893209 wait complete. 2024-09-16T15:38:55.150 INFO:tasks.ceph:Scrubbing osd.4 2024-09-16T15:38:55.150 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-16T15:38:55.255 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.252+0000 7fd8a6d82640 1 -- 172.21.15.98:0/559272179 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd8a00cf2f0 msgr2=0x7fd8a00b49c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:55.255 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.252+0000 7fd8a6d82640 1 --2- 172.21.15.98:0/559272179 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd8a00cf2f0 0x7fd8a00b49c0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fd8a00cfb80 tx=0x7fd89402a4d0 comp rx=0 tx=0).stop 2024-09-16T15:38:55.255 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.252+0000 7fd8a6d82640 1 -- 172.21.15.98:0/559272179 shutdown_connections 2024-09-16T15:38:55.255 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.252+0000 7fd8a6d82640 1 --2- 172.21.15.98:0/559272179 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd8a00cf2f0 0x7fd8a00b49c0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:55.255 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.252+0000 7fd8a6d82640 1 --2- 172.21.15.98:0/559272179 >> v2:172.21.15.135:3300/0 conn(0x7fd8a006ffa0 0x7fd8a00cc290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:55.255 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.252+0000 7fd8a6d82640 1 -- 172.21.15.98:0/559272179 >> 172.21.15.98:0/559272179 conn(0x7fd8a00b18e0 msgr2=0x7fd8a00b1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:55.255 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.253+0000 7fd8a6d82640 1 -- 172.21.15.98:0/559272179 shutdown_connections 2024-09-16T15:38:55.255 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.253+0000 7fd8a6d82640 1 -- 172.21.15.98:0/559272179 wait complete. 2024-09-16T15:38:55.256 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.254+0000 7fd8a6d82640 1 Processor -- start 2024-09-16T15:38:55.256 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.254+0000 7fd8a6d82640 1 -- start start 2024-09-16T15:38:55.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.255+0000 7fd8a6d82640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd8a006ffa0 0x7fd8a009d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:55.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.255+0000 7fd8a6d82640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8a00cf2f0 0x7fd8a01f8550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:55.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.255+0000 7fd8a6d82640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd8a015ae70 0x7fd8a014c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:55.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.255+0000 7fd8a6d82640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd8a00ccb60 con 0x7fd8a015ae70 2024-09-16T15:38:55.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.255+0000 7fd8a6d82640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd8a00cc9e0 con 0x7fd8a00cf2f0 2024-09-16T15:38:55.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.255+0000 7fd8a6d82640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fd8a00ccce0 con 0x7fd8a006ffa0 2024-09-16T15:38:55.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.255+0000 7fd8a531f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd8a015ae70 0x7fd8a014c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:55.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.255+0000 7fd8a531f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd8a015ae70 0x7fd8a014c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46082/0 (socket says 172.21.15.98:46082) 2024-09-16T15:38:55.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.255+0000 7fd8a531f640 1 -- 172.21.15.98:0/493892646 learned_addr learned my addr 172.21.15.98:0/493892646 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:55.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.255+0000 7fd89ffff640 1 --2- 172.21.15.98:0/493892646 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8a00cf2f0 0x7fd8a01f8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:55.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.255+0000 7fd8a531f640 1 -- 172.21.15.98:0/493892646 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd8a006ffa0 msgr2=0x7fd8a009d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:55.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.255+0000 7fd8a531f640 1 --2- 172.21.15.98:0/493892646 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd8a006ffa0 0x7fd8a009d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:55.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.255+0000 7fd8a531f640 1 -- 172.21.15.98:0/493892646 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8a00cf2f0 msgr2=0x7fd8a01f8550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:55.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.255+0000 7fd8a531f640 1 --2- 172.21.15.98:0/493892646 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8a00cf2f0 0x7fd8a01f8550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:55.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.255+0000 7fd8a531f640 1 -- 172.21.15.98:0/493892646 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8a014f020 con 0x7fd8a015ae70 2024-09-16T15:38:55.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.255+0000 7fd8a531f640 1 --2- 172.21.15.98:0/493892646 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd8a015ae70 0x7fd8a014c210 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fd89800b970 tx=0x7fd89800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:55.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.255+0000 7fd89d7fa640 1 -- 172.21.15.98:0/493892646 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd898019070 con 0x7fd8a015ae70 2024-09-16T15:38:55.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.255+0000 7fd89d7fa640 1 -- 172.21.15.98:0/493892646 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd89800cc50 con 0x7fd8a015ae70 2024-09-16T15:38:55.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.255+0000 7fd8a6d82640 1 -- 172.21.15.98:0/493892646 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8a014f300 con 0x7fd8a015ae70 2024-09-16T15:38:55.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.255+0000 7fd89d7fa640 1 -- 172.21.15.98:0/493892646 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8980146a0 con 0x7fd8a015ae70 2024-09-16T15:38:55.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.255+0000 7fd8a6d82640 1 -- 172.21.15.98:0/493892646 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8a014f8c0 con 0x7fd8a015ae70 2024-09-16T15:38:55.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.256+0000 7fd8a6d82640 1 -- 172.21.15.98:0/493892646 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd8a00cd1f0 con 0x7fd8a015ae70 2024-09-16T15:38:55.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.257+0000 7fd89d7fa640 1 -- 172.21.15.98:0/493892646 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 7) ==== 101440+0+0 (secure 0 0 0) 0x7fd89801c070 con 0x7fd8a015ae70 2024-09-16T15:38:55.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.257+0000 7fd89d7fa640 1 --2- 172.21.15.98:0/493892646 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fd88c078a00 0x7fd88c07aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:55.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.257+0000 7fd89d7fa640 1 -- 172.21.15.98:0/493892646 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7fd89809a740 con 0x7fd8a015ae70 2024-09-16T15:38:55.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.257+0000 7fd89d7fa640 1 --2- 172.21.15.98:0/493892646 >> [v2:172.21.15.135:6810/724302036,v1:172.21.15.135:6811/724302036] conn(0x7fd88c07e8c0 0x7fd88c080ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:55.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.257+0000 7fd8a4b1e640 1 --2- 172.21.15.98:0/493892646 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fd88c078a00 0x7fd88c07aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:55.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.257+0000 7fd89d7fa640 1 -- 172.21.15.98:0/493892646 --> [v2:172.21.15.135:6810/724302036,v1:172.21.15.135:6811/724302036] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd88c081390 con 0x7fd88c07e8c0 2024-09-16T15:38:55.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.257+0000 7fd89d7fa640 1 -- 172.21.15.98:0/493892646 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fd8980a1050 con 0x7fd8a015ae70 2024-09-16T15:38:55.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.258+0000 7fd89ffff640 1 --2- 172.21.15.98:0/493892646 >> [v2:172.21.15.135:6810/724302036,v1:172.21.15.135:6811/724302036] conn(0x7fd88c07e8c0 0x7fd88c080ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:55.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.258+0000 7fd8a4b1e640 1 --2- 172.21.15.98:0/493892646 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fd88c078a00 0x7fd88c07aec0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd890009650 tx=0x7fd890006ba0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:55.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.258+0000 7fd89ffff640 1 --2- 172.21.15.98:0/493892646 >> [v2:172.21.15.135:6810/724302036,v1:172.21.15.135:6811/724302036] conn(0x7fd88c07e8c0 0x7fd88c080ce0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:55.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.259+0000 7fd89d7fa640 1 -- 172.21.15.98:0/493892646 <== osd.4 v2:172.21.15.135:6810/724302036 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd88c081390 con 0x7fd88c07e8c0 2024-09-16T15:38:55.273 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.271+0000 7fd8a6d82640 1 -- 172.21.15.98:0/493892646 --> [v2:172.21.15.135:6810/724302036,v1:172.21.15.135:6811/724302036] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd8a00b16a0 con 0x7fd88c07e8c0 2024-09-16T15:38:55.273 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.272+0000 7fd89d7fa640 1 -- 172.21.15.98:0/493892646 <== osd.4 v2:172.21.15.135:6810/724302036 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fd8a00b16a0 con 0x7fd88c07e8c0 2024-09-16T15:38:55.274 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-16T15:38:55.274 INFO:teuthology.orchestra.run.smithi098.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-16T15:38:55.274 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-16T15:38:55.275 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.272+0000 7fd8a6d82640 1 -- 172.21.15.98:0/493892646 >> [v2:172.21.15.135:6810/724302036,v1:172.21.15.135:6811/724302036] conn(0x7fd88c07e8c0 msgr2=0x7fd88c080ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:55.275 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.272+0000 7fd8a6d82640 1 --2- 172.21.15.98:0/493892646 >> [v2:172.21.15.135:6810/724302036,v1:172.21.15.135:6811/724302036] conn(0x7fd88c07e8c0 0x7fd88c080ce0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:55.275 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.272+0000 7fd8a6d82640 1 -- 172.21.15.98:0/493892646 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fd88c078a00 msgr2=0x7fd88c07aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:55.275 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.272+0000 7fd8a6d82640 1 --2- 172.21.15.98:0/493892646 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fd88c078a00 0x7fd88c07aec0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd890009650 tx=0x7fd890006ba0 comp rx=0 tx=0).stop 2024-09-16T15:38:55.275 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.272+0000 7fd8a6d82640 1 -- 172.21.15.98:0/493892646 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd8a015ae70 msgr2=0x7fd8a014c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:55.275 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.272+0000 7fd8a6d82640 1 --2- 172.21.15.98:0/493892646 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd8a015ae70 0x7fd8a014c210 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fd89800b970 tx=0x7fd89800be30 comp rx=0 tx=0).stop 2024-09-16T15:38:55.275 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.272+0000 7fd8a531f640 1 -- 172.21.15.98:0/493892646 reap_dead start 2024-09-16T15:38:55.275 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.272+0000 7fd8a6d82640 1 -- 172.21.15.98:0/493892646 shutdown_connections 2024-09-16T15:38:55.275 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.272+0000 7fd8a6d82640 1 -- 172.21.15.98:0/493892646 >> 172.21.15.98:0/493892646 conn(0x7fd8a00b18e0 msgr2=0x7fd8a00ce2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:55.275 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.272+0000 7fd8a6d82640 1 -- 172.21.15.98:0/493892646 shutdown_connections 2024-09-16T15:38:55.275 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.272+0000 7fd8a6d82640 1 -- 172.21.15.98:0/493892646 wait complete. 2024-09-16T15:38:55.284 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-16T15:38:55.387 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.384+0000 7fd5a2eef640 1 -- 172.21.15.98:0/2699717246 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd588005210 msgr2=0x7fd58800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:55.387 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.384+0000 7fd5a2eef640 1 --2- 172.21.15.98:0/2699717246 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd588005210 0x7fd58800b9c0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fd5940016c0 tx=0x7fd588005830 comp rx=0 tx=0).stop 2024-09-16T15:38:55.387 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.385+0000 7fd5a2eef640 1 -- 172.21.15.98:0/2699717246 shutdown_connections 2024-09-16T15:38:55.387 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.385+0000 7fd5a2eef640 1 --2- 172.21.15.98:0/2699717246 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd588005210 0x7fd58800b9c0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:55.387 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.385+0000 7fd5a2eef640 1 -- 172.21.15.98:0/2699717246 >> 172.21.15.98:0/2699717246 conn(0x7fd59c0b1950 msgr2=0x7fd59c0b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:55.387 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.385+0000 7fd5a2eef640 1 -- 172.21.15.98:0/2699717246 shutdown_connections 2024-09-16T15:38:55.387 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.385+0000 7fd5a2eef640 1 -- 172.21.15.98:0/2699717246 wait complete. 2024-09-16T15:38:55.388 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.386+0000 7fd5a2eef640 1 Processor -- start 2024-09-16T15:38:55.388 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.386+0000 7fd5a2eef640 1 -- start start 2024-09-16T15:38:55.389 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.387+0000 7fd5a2eef640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd588005210 0x7fd59c09b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:55.390 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.387+0000 7fd5a2eef640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd59c15ecd0 0x7fd59c13f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:55.390 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.387+0000 7fd5a2eef640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd59c13fea0 0x7fd59c0aff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:55.390 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.387+0000 7fd5a2eef640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd59c0ced70 con 0x7fd59c15ecd0 2024-09-16T15:38:55.390 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.387+0000 7fd5a2eef640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd59c0cebf0 con 0x7fd588005210 2024-09-16T15:38:55.390 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.387+0000 7fd5a2eef640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fd59c0ceef0 con 0x7fd59c13fea0 2024-09-16T15:38:55.390 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.387+0000 7fd59bfff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd59c15ecd0 0x7fd59c13f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:55.390 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.387+0000 7fd59bfff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd59c15ecd0 0x7fd59c13f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46094/0 (socket says 172.21.15.98:46094) 2024-09-16T15:38:55.390 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.387+0000 7fd59bfff640 1 -- 172.21.15.98:0/2502329449 learned_addr learned my addr 172.21.15.98:0/2502329449 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:55.390 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.387+0000 7fd5a0c8b640 1 --2- 172.21.15.98:0/2502329449 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd588005210 0x7fd59c09b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:55.390 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.387+0000 7fd5a148c640 1 --2- 172.21.15.98:0/2502329449 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd59c13fea0 0x7fd59c0aff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:55.390 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.387+0000 7fd59bfff640 1 -- 172.21.15.98:0/2502329449 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd59c13fea0 msgr2=0x7fd59c0aff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:55.390 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.387+0000 7fd59bfff640 1 --2- 172.21.15.98:0/2502329449 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd59c13fea0 0x7fd59c0aff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:55.390 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.387+0000 7fd59bfff640 1 -- 172.21.15.98:0/2502329449 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd588005210 msgr2=0x7fd59c09b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:55.391 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.387+0000 7fd59bfff640 1 --2- 172.21.15.98:0/2502329449 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd588005210 0x7fd59c09b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:55.391 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.387+0000 7fd59bfff640 1 -- 172.21.15.98:0/2502329449 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd59c140400 con 0x7fd59c15ecd0 2024-09-16T15:38:55.391 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.387+0000 7fd59bfff640 1 --2- 172.21.15.98:0/2502329449 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd59c15ecd0 0x7fd59c13f960 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fd5840065d0 tx=0x7fd5840039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:55.391 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.387+0000 7fd5997fa640 1 -- 172.21.15.98:0/2502329449 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd584015070 con 0x7fd59c15ecd0 2024-09-16T15:38:55.391 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.387+0000 7fd5997fa640 1 -- 172.21.15.98:0/2502329449 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd584011900 con 0x7fd59c15ecd0 2024-09-16T15:38:55.391 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.387+0000 7fd5a2eef640 1 -- 172.21.15.98:0/2502329449 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd59c09aaa0 con 0x7fd59c15ecd0 2024-09-16T15:38:55.391 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.387+0000 7fd5997fa640 1 -- 172.21.15.98:0/2502329449 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd584011d50 con 0x7fd59c15ecd0 2024-09-16T15:38:55.391 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.387+0000 7fd5a2eef640 1 -- 172.21.15.98:0/2502329449 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd59c15f730 con 0x7fd59c15ecd0 2024-09-16T15:38:55.392 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.388+0000 7fd5a2eef640 1 -- 172.21.15.98:0/2502329449 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd59c0cf450 con 0x7fd59c15ecd0 2024-09-16T15:38:55.392 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.389+0000 7fd5997fa640 1 -- 172.21.15.98:0/2502329449 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 7) ==== 101440+0+0 (secure 0 0 0) 0x7fd584018070 con 0x7fd59c15ecd0 2024-09-16T15:38:55.392 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.389+0000 7fd5997fa640 1 --2- 172.21.15.98:0/2502329449 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fd57c078a30 0x7fd57c07aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:55.392 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.389+0000 7fd5997fa640 1 -- 172.21.15.98:0/2502329449 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7fd58409b780 con 0x7fd59c15ecd0 2024-09-16T15:38:55.392 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.389+0000 7fd5a0c8b640 1 --2- 172.21.15.98:0/2502329449 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fd57c078a30 0x7fd57c07aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:55.392 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.390+0000 7fd5a0c8b640 1 --2- 172.21.15.98:0/2502329449 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fd57c078a30 0x7fd57c07aef0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd58c005fd0 tx=0x7fd58c009500 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:55.395 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.394+0000 7fd5997fa640 1 -- 172.21.15.98:0/2502329449 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7fd584063d70 con 0x7fd59c15ecd0 2024-09-16T15:38:55.571 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.569+0000 7fd5a2eef640 1 -- 172.21.15.98:0/2502329449 --> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7fd59c0b1170 con 0x7fd57c078a30 2024-09-16T15:38:55.572 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.570+0000 7fd5997fa640 1 -- 172.21.15.98:0/2502329449 <== mgr.4100 v2:172.21.15.135:6800/699234772 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fd59c0b1170 con 0x7fd57c078a30 2024-09-16T15:38:55.572 INFO:teuthology.orchestra.run.smithi098.stderr:instructed osd(s) 4 to deep-scrub 2024-09-16T15:38:55.574 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.572+0000 7fd5a2eef640 1 -- 172.21.15.98:0/2502329449 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fd57c078a30 msgr2=0x7fd57c07aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:55.574 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.572+0000 7fd5a2eef640 1 --2- 172.21.15.98:0/2502329449 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fd57c078a30 0x7fd57c07aef0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd58c005fd0 tx=0x7fd58c009500 comp rx=0 tx=0).stop 2024-09-16T15:38:55.574 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.572+0000 7fd5a2eef640 1 -- 172.21.15.98:0/2502329449 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd59c15ecd0 msgr2=0x7fd59c13f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:55.574 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.572+0000 7fd5a2eef640 1 --2- 172.21.15.98:0/2502329449 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd59c15ecd0 0x7fd59c13f960 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fd5840065d0 tx=0x7fd5840039c0 comp rx=0 tx=0).stop 2024-09-16T15:38:55.574 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.572+0000 7fd5a2eef640 1 -- 172.21.15.98:0/2502329449 shutdown_connections 2024-09-16T15:38:55.574 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.572+0000 7fd5a2eef640 1 --2- 172.21.15.98:0/2502329449 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fd59c13fea0 0x7fd59c0aff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:55.574 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.572+0000 7fd5a2eef640 1 --2- 172.21.15.98:0/2502329449 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd59c15ecd0 0x7fd59c13f960 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:55.574 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.572+0000 7fd5a2eef640 1 --2- 172.21.15.98:0/2502329449 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fd57c078a30 0x7fd57c07aef0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:55.574 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.572+0000 7fd5a2eef640 1 --2- 172.21.15.98:0/2502329449 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd588005210 0x7fd59c09b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:55.574 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.572+0000 7fd5a2eef640 1 -- 172.21.15.98:0/2502329449 >> 172.21.15.98:0/2502329449 conn(0x7fd59c0b1950 msgr2=0x7fd59c06ff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:55.575 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.572+0000 7fd5a2eef640 1 -- 172.21.15.98:0/2502329449 shutdown_connections 2024-09-16T15:38:55.575 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.572+0000 7fd5a2eef640 1 -- 172.21.15.98:0/2502329449 wait complete. 2024-09-16T15:38:55.585 INFO:tasks.ceph:Scrubbing osd.5 2024-09-16T15:38:55.585 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-16T15:38:55.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.688+0000 7f1dcb433640 1 -- 172.21.15.98:0/1896010622 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1dc415e340 msgr2=0x7f1dc40d0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:55.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.688+0000 7f1dcb433640 1 --2- 172.21.15.98:0/1896010622 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1dc415e340 0x7f1dc40d0800 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1db4005fd0 tx=0x7f1db402a9d0 comp rx=0 tx=0).stop 2024-09-16T15:38:55.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.688+0000 7f1dcb433640 1 -- 172.21.15.98:0/1896010622 shutdown_connections 2024-09-16T15:38:55.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.688+0000 7f1dcb433640 1 --2- 172.21.15.98:0/1896010622 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1dc415e340 0x7f1dc40d0800 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:55.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.688+0000 7f1dcb433640 1 -- 172.21.15.98:0/1896010622 >> 172.21.15.98:0/1896010622 conn(0x7f1dc40d4050 msgr2=0x7f1dc40d4460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:55.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.689+0000 7f1dcb433640 1 -- 172.21.15.98:0/1896010622 shutdown_connections 2024-09-16T15:38:55.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.689+0000 7f1dcb433640 1 -- 172.21.15.98:0/1896010622 wait complete. 2024-09-16T15:38:55.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.690+0000 7f1dcb433640 1 Processor -- start 2024-09-16T15:38:55.692 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.690+0000 7f1dcb433640 1 -- start start 2024-09-16T15:38:55.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.690+0000 7f1dcb433640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1dc40b8900 0x7f1dc41f5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:55.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.690+0000 7f1dcb433640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1dc415e340 0x7f1dc40a1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:55.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.691+0000 7f1dcb433640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1dc41f7d80 0x7f1dc41f8210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:55.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.691+0000 7f1dcb433640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1dc40d2eb0 con 0x7f1dc40b8900 2024-09-16T15:38:55.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.691+0000 7f1dcb433640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1dc40d2d30 con 0x7f1dc41f7d80 2024-09-16T15:38:55.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.691+0000 7f1dcb433640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f1dc40d4ed0 con 0x7f1dc415e340 2024-09-16T15:38:55.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.691+0000 7f1dc91cf640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1dc40b8900 0x7f1dc41f5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:55.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.691+0000 7f1dc91cf640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1dc40b8900 0x7f1dc41f5860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46100/0 (socket says 172.21.15.98:46100) 2024-09-16T15:38:55.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.691+0000 7f1dc91cf640 1 -- 172.21.15.98:0/736674612 learned_addr learned my addr 172.21.15.98:0/736674612 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:55.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.691+0000 7f1dc91cf640 1 -- 172.21.15.98:0/736674612 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1dc415e340 msgr2=0x7f1dc40a1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:55.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.691+0000 7f1dc91cf640 1 --2- 172.21.15.98:0/736674612 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f1dc415e340 0x7f1dc40a1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:55.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.691+0000 7f1dc91cf640 1 -- 172.21.15.98:0/736674612 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1dc41f7d80 msgr2=0x7f1dc41f8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:55.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.691+0000 7f1dc91cf640 1 --2- 172.21.15.98:0/736674612 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1dc41f7d80 0x7f1dc41f8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:55.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.691+0000 7f1dc91cf640 1 -- 172.21.15.98:0/736674612 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dc40a1bb0 con 0x7f1dc40b8900 2024-09-16T15:38:55.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.691+0000 7f1dc91cf640 1 --2- 172.21.15.98:0/736674612 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1dc40b8900 0x7f1dc41f5860 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f1db4000f80 tx=0x7f1db402f5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:55.695 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.691+0000 7f1dc1ffb640 1 -- 172.21.15.98:0/736674612 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1db4045070 con 0x7f1dc40b8900 2024-09-16T15:38:55.695 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.691+0000 7f1dc1ffb640 1 -- 172.21.15.98:0/736674612 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1db402fc70 con 0x7f1dc40b8900 2024-09-16T15:38:55.695 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.691+0000 7f1dcb433640 1 -- 172.21.15.98:0/736674612 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dc414d280 con 0x7f1dc40b8900 2024-09-16T15:38:55.695 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.691+0000 7f1dc1ffb640 1 -- 172.21.15.98:0/736674612 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1db4003c50 con 0x7f1dc40b8900 2024-09-16T15:38:55.695 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.692+0000 7f1dcb433640 1 -- 172.21.15.98:0/736674612 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dc414d840 con 0x7f1dc40b8900 2024-09-16T15:38:55.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.692+0000 7f1dcb433640 1 -- 172.21.15.98:0/736674612 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1dc414cdb0 con 0x7f1dc40b8900 2024-09-16T15:38:55.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.693+0000 7f1dc1ffb640 1 -- 172.21.15.98:0/736674612 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 7) ==== 101440+0+0 (secure 0 0 0) 0x7f1db4048070 con 0x7f1dc40b8900 2024-09-16T15:38:55.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.694+0000 7f1dc1ffb640 1 --2- 172.21.15.98:0/736674612 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f1db0078a30 0x7f1db007aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:55.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.694+0000 7f1dc1ffb640 1 -- 172.21.15.98:0/736674612 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f1db40bbae0 con 0x7f1dc40b8900 2024-09-16T15:38:55.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.694+0000 7f1dc1ffb640 1 --2- 172.21.15.98:0/736674612 >> [v2:172.21.15.135:6802/3083482635,v1:172.21.15.135:6803/3083482635] conn(0x7f1db007e8f0 0x7f1db0080d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:55.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.694+0000 7f1dc1ffb640 1 -- 172.21.15.98:0/736674612 --> [v2:172.21.15.135:6802/3083482635,v1:172.21.15.135:6803/3083482635] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1db4030e50 con 0x7f1db007e8f0 2024-09-16T15:38:55.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.694+0000 7f1dc1ffb640 1 -- 172.21.15.98:0/736674612 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f1db40bbed0 con 0x7f1dc40b8900 2024-09-16T15:38:55.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.694+0000 7f1dc89ce640 1 --2- 172.21.15.98:0/736674612 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f1db0078a30 0x7f1db007aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:55.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.694+0000 7f1dc99d0640 1 --2- 172.21.15.98:0/736674612 >> [v2:172.21.15.135:6802/3083482635,v1:172.21.15.135:6803/3083482635] conn(0x7f1db007e8f0 0x7f1db0080d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:55.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.695+0000 7f1dc89ce640 1 --2- 172.21.15.98:0/736674612 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f1db0078a30 0x7f1db007aef0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1dc4159140 tx=0x7f1db8007970 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:55.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.695+0000 7f1dc99d0640 1 --2- 172.21.15.98:0/736674612 >> [v2:172.21.15.135:6802/3083482635,v1:172.21.15.135:6803/3083482635] conn(0x7f1db007e8f0 0x7f1db0080d10 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:55.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.695+0000 7f1dc1ffb640 1 -- 172.21.15.98:0/736674612 <== osd.5 v2:172.21.15.135:6802/3083482635 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1db4030e50 con 0x7f1db007e8f0 2024-09-16T15:38:55.709 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.708+0000 7f1dcb433640 1 -- 172.21.15.98:0/736674612 --> [v2:172.21.15.135:6802/3083482635,v1:172.21.15.135:6803/3083482635] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f1dc40d37e0 con 0x7f1db007e8f0 2024-09-16T15:38:55.710 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.708+0000 7f1dc1ffb640 1 -- 172.21.15.98:0/736674612 <== osd.5 v2:172.21.15.135:6802/3083482635 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f1dc40d37e0 con 0x7f1db007e8f0 2024-09-16T15:38:55.710 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-16T15:38:55.710 INFO:teuthology.orchestra.run.smithi098.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-16T15:38:55.710 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-16T15:38:55.711 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.708+0000 7f1dcb433640 1 -- 172.21.15.98:0/736674612 >> [v2:172.21.15.135:6802/3083482635,v1:172.21.15.135:6803/3083482635] conn(0x7f1db007e8f0 msgr2=0x7f1db0080d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:55.711 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.708+0000 7f1dcb433640 1 --2- 172.21.15.98:0/736674612 >> [v2:172.21.15.135:6802/3083482635,v1:172.21.15.135:6803/3083482635] conn(0x7f1db007e8f0 0x7f1db0080d10 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:55.711 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.709+0000 7f1dcb433640 1 -- 172.21.15.98:0/736674612 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f1db0078a30 msgr2=0x7f1db007aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:55.711 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.709+0000 7f1dcb433640 1 --2- 172.21.15.98:0/736674612 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f1db0078a30 0x7f1db007aef0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1dc4159140 tx=0x7f1db8007970 comp rx=0 tx=0).stop 2024-09-16T15:38:55.711 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.709+0000 7f1dcb433640 1 -- 172.21.15.98:0/736674612 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1dc40b8900 msgr2=0x7f1dc41f5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:55.711 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.709+0000 7f1dcb433640 1 --2- 172.21.15.98:0/736674612 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1dc40b8900 0x7f1dc41f5860 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f1db4000f80 tx=0x7f1db402f5f0 comp rx=0 tx=0).stop 2024-09-16T15:38:55.711 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.709+0000 7f1dc99d0640 1 -- 172.21.15.98:0/736674612 reap_dead start 2024-09-16T15:38:55.712 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.709+0000 7f1dcb433640 1 -- 172.21.15.98:0/736674612 shutdown_connections 2024-09-16T15:38:55.712 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.709+0000 7f1dcb433640 1 -- 172.21.15.98:0/736674612 >> 172.21.15.98:0/736674612 conn(0x7f1dc40d4050 msgr2=0x7f1dc406e790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:55.712 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.709+0000 7f1dcb433640 1 -- 172.21.15.98:0/736674612 shutdown_connections 2024-09-16T15:38:55.712 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.709+0000 7f1dcb433640 1 -- 172.21.15.98:0/736674612 wait complete. 2024-09-16T15:38:55.721 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-16T15:38:55.823 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.820+0000 7fc548c32640 1 -- 172.21.15.98:0/452335064 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5440d2050 msgr2=0x7fc5440d10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:55.823 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.820+0000 7fc548c32640 1 --2- 172.21.15.98:0/452335064 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5440d2050 0x7fc5440d10d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc52c005fd0 tx=0x7fc52c02aa90 comp rx=0 tx=0).stop 2024-09-16T15:38:55.823 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.821+0000 7fc548c32640 1 -- 172.21.15.98:0/452335064 shutdown_connections 2024-09-16T15:38:55.823 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.821+0000 7fc548c32640 1 --2- 172.21.15.98:0/452335064 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc5440d1610 0x7fc5440cecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:55.823 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.821+0000 7fc548c32640 1 --2- 172.21.15.98:0/452335064 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5440d2050 0x7fc5440d10d0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:55.823 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.821+0000 7fc548c32640 1 -- 172.21.15.98:0/452335064 >> 172.21.15.98:0/452335064 conn(0x7fc5440d3fe0 msgr2=0x7fc5440d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:55.823 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.821+0000 7fc548c32640 1 -- 172.21.15.98:0/452335064 shutdown_connections 2024-09-16T15:38:55.823 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.821+0000 7fc548c32640 1 -- 172.21.15.98:0/452335064 wait complete. 2024-09-16T15:38:55.824 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.822+0000 7fc548c32640 1 Processor -- start 2024-09-16T15:38:55.824 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.822+0000 7fc548c32640 1 -- start start 2024-09-16T15:38:55.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.823+0000 7fc548c32640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc5440d1610 0x7fc54415eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:55.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.823+0000 7fc548c32640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5440d2050 0x7fc5440c8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:55.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.823+0000 7fc548c32640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc54415e0d0 0x7fc5440c9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:55.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.823+0000 7fc548c32640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc5440cf610 con 0x7fc54415e0d0 2024-09-16T15:38:55.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.823+0000 7fc548c32640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc5440cf490 con 0x7fc5440d2050 2024-09-16T15:38:55.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.823+0000 7fc548c32640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fc5440cf790 con 0x7fc5440d1610 2024-09-16T15:38:55.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.823+0000 7fc542d9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc54415e0d0 0x7fc5440c9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:55.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.823+0000 7fc542d9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc54415e0d0 0x7fc5440c9a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46116/0 (socket says 172.21.15.98:46116) 2024-09-16T15:38:55.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.823+0000 7fc542d9d640 1 -- 172.21.15.98:0/4237807896 learned_addr learned my addr 172.21.15.98:0/4237807896 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:55.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.823+0000 7fc54259c640 1 --2- 172.21.15.98:0/4237807896 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc5440d1610 0x7fc54415eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:55.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.823+0000 7fc541d9b640 1 --2- 172.21.15.98:0/4237807896 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5440d2050 0x7fc5440c8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:55.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.823+0000 7fc542d9d640 1 -- 172.21.15.98:0/4237807896 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc5440d1610 msgr2=0x7fc54415eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:55.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.823+0000 7fc542d9d640 1 --2- 172.21.15.98:0/4237807896 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc5440d1610 0x7fc54415eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:55.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.823+0000 7fc542d9d640 1 -- 172.21.15.98:0/4237807896 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5440d2050 msgr2=0x7fc5440c8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:55.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.823+0000 7fc542d9d640 1 --2- 172.21.15.98:0/4237807896 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5440d2050 0x7fc5440c8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:55.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.823+0000 7fc542d9d640 1 -- 172.21.15.98:0/4237807896 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5440c8a40 con 0x7fc54415e0d0 2024-09-16T15:38:55.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.823+0000 7fc542d9d640 1 --2- 172.21.15.98:0/4237807896 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc54415e0d0 0x7fc5440c9a70 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fc53400e940 tx=0x7fc53400ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:55.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.824+0000 7fc53affd640 1 -- 172.21.15.98:0/4237807896 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc53400cd80 con 0x7fc54415e0d0 2024-09-16T15:38:55.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.824+0000 7fc548c32640 1 -- 172.21.15.98:0/4237807896 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5440c8cc0 con 0x7fc54415e0d0 2024-09-16T15:38:55.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.824+0000 7fc53affd640 1 -- 172.21.15.98:0/4237807896 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc534004020 con 0x7fc54415e0d0 2024-09-16T15:38:55.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.824+0000 7fc53affd640 1 -- 172.21.15.98:0/4237807896 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc534004470 con 0x7fc54415e0d0 2024-09-16T15:38:55.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.824+0000 7fc548c32640 1 -- 172.21.15.98:0/4237807896 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5440b8300 con 0x7fc54415e0d0 2024-09-16T15:38:55.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.824+0000 7fc548c32640 1 -- 172.21.15.98:0/4237807896 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5440cfcb0 con 0x7fc54415e0d0 2024-09-16T15:38:55.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.825+0000 7fc53affd640 1 -- 172.21.15.98:0/4237807896 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 7) ==== 101440+0+0 (secure 0 0 0) 0x7fc5340035f0 con 0x7fc54415e0d0 2024-09-16T15:38:55.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.826+0000 7fc53affd640 1 --2- 172.21.15.98:0/4237807896 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fc524078a00 0x7fc52407aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:55.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.826+0000 7fc53affd640 1 -- 172.21.15.98:0/4237807896 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7fc53409b390 con 0x7fc54415e0d0 2024-09-16T15:38:55.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.826+0000 7fc54259c640 1 --2- 172.21.15.98:0/4237807896 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fc524078a00 0x7fc52407aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:55.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.826+0000 7fc54259c640 1 --2- 172.21.15.98:0/4237807896 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fc524078a00 0x7fc52407aec0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc53c001720 tx=0x7fc53c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:55.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:55.830+0000 7fc53affd640 1 -- 172.21.15.98:0/4237807896 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7fc5440c8a40 con 0x7fc54415e0d0 2024-09-16T15:38:56.005 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.003+0000 7fc548c32640 1 -- 172.21.15.98:0/4237807896 --> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7fc5440761d0 con 0x7fc524078a00 2024-09-16T15:38:56.005 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.004+0000 7fc53affd640 1 -- 172.21.15.98:0/4237807896 <== mgr.4100 v2:172.21.15.135:6800/699234772 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fc5440761d0 con 0x7fc524078a00 2024-09-16T15:38:56.006 INFO:teuthology.orchestra.run.smithi098.stderr:instructed osd(s) 5 to deep-scrub 2024-09-16T15:38:56.008 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.006+0000 7fc548c32640 1 -- 172.21.15.98:0/4237807896 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fc524078a00 msgr2=0x7fc52407aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:56.008 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.006+0000 7fc548c32640 1 --2- 172.21.15.98:0/4237807896 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fc524078a00 0x7fc52407aec0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc53c001720 tx=0x7fc53c009040 comp rx=0 tx=0).stop 2024-09-16T15:38:56.008 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.006+0000 7fc548c32640 1 -- 172.21.15.98:0/4237807896 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc54415e0d0 msgr2=0x7fc5440c9a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:56.009 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.006+0000 7fc548c32640 1 --2- 172.21.15.98:0/4237807896 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc54415e0d0 0x7fc5440c9a70 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fc53400e940 tx=0x7fc53400ee00 comp rx=0 tx=0).stop 2024-09-16T15:38:56.009 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.006+0000 7fc548c32640 1 -- 172.21.15.98:0/4237807896 shutdown_connections 2024-09-16T15:38:56.009 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.006+0000 7fc548c32640 1 --2- 172.21.15.98:0/4237807896 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc54415e0d0 0x7fc5440c9a70 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:56.009 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.006+0000 7fc548c32640 1 --2- 172.21.15.98:0/4237807896 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fc524078a00 0x7fc52407aec0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:56.009 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.006+0000 7fc548c32640 1 --2- 172.21.15.98:0/4237807896 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5440d2050 0x7fc5440c8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:56.009 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.006+0000 7fc548c32640 1 --2- 172.21.15.98:0/4237807896 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc5440d1610 0x7fc54415eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:56.009 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.006+0000 7fc548c32640 1 -- 172.21.15.98:0/4237807896 >> 172.21.15.98:0/4237807896 conn(0x7fc5440d3fe0 msgr2=0x7fc544160c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:56.009 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.006+0000 7fc548c32640 1 -- 172.21.15.98:0/4237807896 shutdown_connections 2024-09-16T15:38:56.009 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.006+0000 7fc548c32640 1 -- 172.21.15.98:0/4237807896 wait complete. 2024-09-16T15:38:56.019 INFO:tasks.ceph:Scrubbing osd.6 2024-09-16T15:38:56.019 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-16T15:38:56.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.123+0000 7f8b69724640 1 -- 172.21.15.98:0/1142686478 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b640b3240 msgr2=0x7f8b640d07a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:56.126 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.123+0000 7f8b69724640 1 --2- 172.21.15.98:0/1142686478 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b640b3240 0x7f8b640d07a0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f8b640b7ee0 tx=0x7f8b4c02a4d0 comp rx=0 tx=0).stop 2024-09-16T15:38:56.126 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.123+0000 7f8b69724640 1 -- 172.21.15.98:0/1142686478 shutdown_connections 2024-09-16T15:38:56.126 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.123+0000 7f8b69724640 1 --2- 172.21.15.98:0/1142686478 >> v2:172.21.15.135:3300/0 conn(0x7f8b640b16d0 0x7f8b640b1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:56.126 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.123+0000 7f8b69724640 1 --2- 172.21.15.98:0/1142686478 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b640b3240 0x7f8b640d07a0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:56.126 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.123+0000 7f8b69724640 1 --2- 172.21.15.98:0/1142686478 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8b640cfe80 0x7f8b640d0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:56.126 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.123+0000 7f8b69724640 1 -- 172.21.15.98:0/1142686478 >> 172.21.15.98:0/1142686478 conn(0x7f8b640d1e30 msgr2=0x7f8b640d2240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:56.126 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.123+0000 7f8b69724640 1 -- 172.21.15.98:0/1142686478 shutdown_connections 2024-09-16T15:38:56.126 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.123+0000 7f8b69724640 1 -- 172.21.15.98:0/1142686478 wait complete. 2024-09-16T15:38:56.128 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.124+0000 7f8b69724640 1 Processor -- start 2024-09-16T15:38:56.128 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.124+0000 7f8b69724640 1 -- start start 2024-09-16T15:38:56.128 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.125+0000 7f8b69724640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b640b16d0 0x7f8b64159010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:56.128 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.125+0000 7f8b69724640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8b640b3240 0x7f8b640ce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:56.128 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.125+0000 7f8b69724640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b640cfe80 0x7f8b640ce9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:56.128 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.125+0000 7f8b69724640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8b6415ff00 con 0x7f8b640cfe80 2024-09-16T15:38:56.129 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.125+0000 7f8b69724640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8b6415fd80 con 0x7f8b640b16d0 2024-09-16T15:38:56.129 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.125+0000 7f8b69724640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f8b64160080 con 0x7f8b640b3240 2024-09-16T15:38:56.129 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.125+0000 7f8b637fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b640cfe80 0x7f8b640ce9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:56.129 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.125+0000 7f8b637fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b640cfe80 0x7f8b640ce9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46138/0 (socket says 172.21.15.98:46138) 2024-09-16T15:38:56.129 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.125+0000 7f8b637fe640 1 -- 172.21.15.98:0/3958812693 learned_addr learned my addr 172.21.15.98:0/3958812693 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:56.129 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.125+0000 7f8b627fc640 1 --2- 172.21.15.98:0/3958812693 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8b640b3240 0x7f8b640ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:56.129 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.125+0000 7f8b62ffd640 1 --2- 172.21.15.98:0/3958812693 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b640b16d0 0x7f8b64159010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:56.129 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.125+0000 7f8b637fe640 1 -- 172.21.15.98:0/3958812693 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8b640b3240 msgr2=0x7f8b640ce4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:56.129 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.125+0000 7f8b637fe640 1 --2- 172.21.15.98:0/3958812693 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f8b640b3240 0x7f8b640ce4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:56.129 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.125+0000 7f8b637fe640 1 -- 172.21.15.98:0/3958812693 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b640b16d0 msgr2=0x7f8b64159010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:56.129 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.125+0000 7f8b637fe640 1 --2- 172.21.15.98:0/3958812693 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b640b16d0 0x7f8b64159010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:56.129 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.125+0000 7f8b637fe640 1 -- 172.21.15.98:0/3958812693 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b640c8990 con 0x7f8b640cfe80 2024-09-16T15:38:56.129 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.126+0000 7f8b637fe640 1 --2- 172.21.15.98:0/3958812693 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b640cfe80 0x7f8b640ce9f0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c00b450 tx=0x7f8b5c00b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:56.130 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.126+0000 7f8b5b7fe640 1 -- 172.21.15.98:0/3958812693 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b5c015020 con 0x7f8b640cfe80 2024-09-16T15:38:56.130 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.126+0000 7f8b5b7fe640 1 -- 172.21.15.98:0/3958812693 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8b5c011980 con 0x7f8b640cfe80 2024-09-16T15:38:56.130 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.126+0000 7f8b69724640 1 -- 172.21.15.98:0/3958812693 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b641f5010 con 0x7f8b640cfe80 2024-09-16T15:38:56.130 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.126+0000 7f8b5b7fe640 1 -- 172.21.15.98:0/3958812693 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b5c011db0 con 0x7f8b640cfe80 2024-09-16T15:38:56.130 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.126+0000 7f8b69724640 1 -- 172.21.15.98:0/3958812693 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b641f55d0 con 0x7f8b640cfe80 2024-09-16T15:38:56.130 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.127+0000 7f8b69724640 1 -- 172.21.15.98:0/3958812693 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8b641f4e00 con 0x7f8b640cfe80 2024-09-16T15:38:56.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.127+0000 7f8b5b7fe640 1 -- 172.21.15.98:0/3958812693 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 7) ==== 101440+0+0 (secure 0 0 0) 0x7f8b5c018020 con 0x7f8b640cfe80 2024-09-16T15:38:56.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.128+0000 7f8b5b7fe640 1 --2- 172.21.15.98:0/3958812693 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f8b44078a00 0x7f8b4407aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:56.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.128+0000 7f8b5b7fe640 1 -- 172.21.15.98:0/3958812693 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f8b5c09aac0 con 0x7f8b640cfe80 2024-09-16T15:38:56.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.128+0000 7f8b62ffd640 1 --2- 172.21.15.98:0/3958812693 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f8b44078a00 0x7f8b4407aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:56.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.128+0000 7f8b5b7fe640 1 --2- 172.21.15.98:0/3958812693 >> [v2:172.21.15.135:6818/3376376340,v1:172.21.15.135:6819/3376376340] conn(0x7f8b4407e8c0 0x7f8b44080ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:56.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.128+0000 7f8b5b7fe640 1 -- 172.21.15.98:0/3958812693 --> [v2:172.21.15.135:6818/3376376340,v1:172.21.15.135:6819/3376376340] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8b5c01be50 con 0x7f8b4407e8c0 2024-09-16T15:38:56.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.128+0000 7f8b5b7fe640 1 -- 172.21.15.98:0/3958812693 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f8b5c09f2a0 con 0x7f8b640cfe80 2024-09-16T15:38:56.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.128+0000 7f8b627fc640 1 --2- 172.21.15.98:0/3958812693 >> [v2:172.21.15.135:6818/3376376340,v1:172.21.15.135:6819/3376376340] conn(0x7f8b4407e8c0 0x7f8b44080ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:56.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.128+0000 7f8b62ffd640 1 --2- 172.21.15.98:0/3958812693 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f8b44078a00 0x7f8b4407aec0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8b640d0ad0 tx=0x7f8b5400d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:56.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.129+0000 7f8b627fc640 1 --2- 172.21.15.98:0/3958812693 >> [v2:172.21.15.135:6818/3376376340,v1:172.21.15.135:6819/3376376340] conn(0x7f8b4407e8c0 0x7f8b44080ce0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:56.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.130+0000 7f8b5b7fe640 1 -- 172.21.15.98:0/3958812693 <== osd.6 v2:172.21.15.135:6818/3376376340 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8b5c01be50 con 0x7f8b4407e8c0 2024-09-16T15:38:56.143 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.142+0000 7f8b69724640 1 -- 172.21.15.98:0/3958812693 --> [v2:172.21.15.135:6818/3376376340,v1:172.21.15.135:6819/3376376340] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f8b640b1b60 con 0x7f8b4407e8c0 2024-09-16T15:38:56.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.142+0000 7f8b5b7fe640 1 -- 172.21.15.98:0/3958812693 <== osd.6 v2:172.21.15.135:6818/3376376340 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f8b640b1b60 con 0x7f8b4407e8c0 2024-09-16T15:38:56.144 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-16T15:38:56.144 INFO:teuthology.orchestra.run.smithi098.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-16T15:38:56.144 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-16T15:38:56.145 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.142+0000 7f8b69724640 1 -- 172.21.15.98:0/3958812693 >> [v2:172.21.15.135:6818/3376376340,v1:172.21.15.135:6819/3376376340] conn(0x7f8b4407e8c0 msgr2=0x7f8b44080ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:56.145 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.142+0000 7f8b69724640 1 --2- 172.21.15.98:0/3958812693 >> [v2:172.21.15.135:6818/3376376340,v1:172.21.15.135:6819/3376376340] conn(0x7f8b4407e8c0 0x7f8b44080ce0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:56.145 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.143+0000 7f8b69724640 1 -- 172.21.15.98:0/3958812693 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f8b44078a00 msgr2=0x7f8b4407aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:56.145 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.143+0000 7f8b69724640 1 --2- 172.21.15.98:0/3958812693 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f8b44078a00 0x7f8b4407aec0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8b640d0ad0 tx=0x7f8b5400d040 comp rx=0 tx=0).stop 2024-09-16T15:38:56.145 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.143+0000 7f8b69724640 1 -- 172.21.15.98:0/3958812693 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b640cfe80 msgr2=0x7f8b640ce9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:56.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.143+0000 7f8b69724640 1 --2- 172.21.15.98:0/3958812693 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b640cfe80 0x7f8b640ce9f0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c00b450 tx=0x7f8b5c00b910 comp rx=0 tx=0).stop 2024-09-16T15:38:56.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.143+0000 7f8b637fe640 1 -- 172.21.15.98:0/3958812693 reap_dead start 2024-09-16T15:38:56.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.143+0000 7f8b69724640 1 -- 172.21.15.98:0/3958812693 shutdown_connections 2024-09-16T15:38:56.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.143+0000 7f8b69724640 1 -- 172.21.15.98:0/3958812693 >> 172.21.15.98:0/3958812693 conn(0x7f8b640d1e30 msgr2=0x7f8b640b2670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:56.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.143+0000 7f8b69724640 1 -- 172.21.15.98:0/3958812693 shutdown_connections 2024-09-16T15:38:56.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.143+0000 7f8b69724640 1 -- 172.21.15.98:0/3958812693 wait complete. 2024-09-16T15:38:56.155 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-16T15:38:56.256 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.254+0000 7fe8cb175640 1 -- 172.21.15.98:0/2822693020 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe8c415e0d0 msgr2=0x7fe8c40d09c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:56.257 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.254+0000 7fe8cb175640 1 --2- 172.21.15.98:0/2822693020 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe8c415e0d0 0x7fe8c40d09c0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc009830 tx=0x7fe8bc02a5c0 comp rx=0 tx=0).stop 2024-09-16T15:38:56.257 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.254+0000 7fe8cb175640 1 -- 172.21.15.98:0/2822693020 shutdown_connections 2024-09-16T15:38:56.257 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.254+0000 7fe8cb175640 1 --2- 172.21.15.98:0/2822693020 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe8c415e0d0 0x7fe8c40d09c0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:56.257 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.254+0000 7fe8cb175640 1 -- 172.21.15.98:0/2822693020 >> 172.21.15.98:0/2822693020 conn(0x7fe8c40d3fe0 msgr2=0x7fe8c40d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:56.257 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.254+0000 7fe8cb175640 1 -- 172.21.15.98:0/2822693020 shutdown_connections 2024-09-16T15:38:56.257 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.254+0000 7fe8cb175640 1 -- 172.21.15.98:0/2822693020 wait complete. 2024-09-16T15:38:56.257 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.255+0000 7fe8cb175640 1 Processor -- start 2024-09-16T15:38:56.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.255+0000 7fe8cb175640 1 -- start start 2024-09-16T15:38:56.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.256+0000 7fe8cb175640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe8c40d1610 0x7fe8c40cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:56.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.256+0000 7fe8cb175640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8c40d2050 0x7fe8c40cc470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:56.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.256+0000 7fe8cb175640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe8c415e0d0 0x7fe8c41f5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:56.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.256+0000 7fe8cb175640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c40cf870 con 0x7fe8c40d1610 2024-09-16T15:38:56.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.256+0000 7fe8cb175640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c40cf6f0 con 0x7fe8c40d2050 2024-09-16T15:38:56.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.256+0000 7fe8cb175640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fe8c40cf9f0 con 0x7fe8c415e0d0 2024-09-16T15:38:56.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.256+0000 7fe8c8f11640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe8c40d1610 0x7fe8c40cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:56.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.256+0000 7fe8c8f11640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe8c40d1610 0x7fe8c40cdeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46148/0 (socket says 172.21.15.98:46148) 2024-09-16T15:38:56.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.256+0000 7fe8c8f11640 1 -- 172.21.15.98:0/550393317 learned_addr learned my addr 172.21.15.98:0/550393317 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:56.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.257+0000 7fe8c3fff640 1 --2- 172.21.15.98:0/550393317 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8c40d2050 0x7fe8c40cc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:56.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.257+0000 7fe8c9712640 1 --2- 172.21.15.98:0/550393317 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe8c415e0d0 0x7fe8c41f5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:56.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.257+0000 7fe8c8f11640 1 -- 172.21.15.98:0/550393317 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe8c415e0d0 msgr2=0x7fe8c41f5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:56.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.257+0000 7fe8c8f11640 1 --2- 172.21.15.98:0/550393317 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe8c415e0d0 0x7fe8c41f5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:56.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.257+0000 7fe8c8f11640 1 -- 172.21.15.98:0/550393317 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8c40d2050 msgr2=0x7fe8c40cc470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:56.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.257+0000 7fe8c8f11640 1 --2- 172.21.15.98:0/550393317 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8c40d2050 0x7fe8c40cc470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:56.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.257+0000 7fe8c8f11640 1 -- 172.21.15.98:0/550393317 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8c41f48c0 con 0x7fe8c40d1610 2024-09-16T15:38:56.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.257+0000 7fe8c3fff640 1 --2- 172.21.15.98:0/550393317 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8c40d2050 0x7fe8c40cc470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T15:38:56.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.257+0000 7fe8c9712640 1 --2- 172.21.15.98:0/550393317 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe8c415e0d0 0x7fe8c41f5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T15:38:56.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.257+0000 7fe8c8f11640 1 --2- 172.21.15.98:0/550393317 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe8c40d1610 0x7fe8c40cdeb0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc000c00 tx=0x7fe8bc033d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:56.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.257+0000 7fe8c17fa640 1 -- 172.21.15.98:0/550393317 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8bc031d60 con 0x7fe8c40d1610 2024-09-16T15:38:56.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.257+0000 7fe8c17fa640 1 -- 172.21.15.98:0/550393317 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe8bc0330d0 con 0x7fe8c40d1610 2024-09-16T15:38:56.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.257+0000 7fe8c17fa640 1 -- 172.21.15.98:0/550393317 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8bc033520 con 0x7fe8c40d1610 2024-09-16T15:38:56.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.257+0000 7fe8cb175640 1 -- 172.21.15.98:0/550393317 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8c40cb470 con 0x7fe8c40d1610 2024-09-16T15:38:56.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.257+0000 7fe8cb175640 1 -- 172.21.15.98:0/550393317 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8c40cba30 con 0x7fe8c40d1610 2024-09-16T15:38:56.262 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.258+0000 7fe8cb175640 1 -- 172.21.15.98:0/550393317 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8c40cff10 con 0x7fe8c40d1610 2024-09-16T15:38:56.262 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.259+0000 7fe8c17fa640 1 -- 172.21.15.98:0/550393317 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 7) ==== 101440+0+0 (secure 0 0 0) 0x7fe8bc0035f0 con 0x7fe8c40d1610 2024-09-16T15:38:56.262 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.259+0000 7fe8c17fa640 1 --2- 172.21.15.98:0/550393317 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fe8a4078a00 0x7fe8a407aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:56.262 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.259+0000 7fe8c17fa640 1 -- 172.21.15.98:0/550393317 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7fe8bc0bbe80 con 0x7fe8c40d1610 2024-09-16T15:38:56.262 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.259+0000 7fe8c3fff640 1 --2- 172.21.15.98:0/550393317 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fe8a4078a00 0x7fe8a407aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:56.262 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.260+0000 7fe8c3fff640 1 --2- 172.21.15.98:0/550393317 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fe8a4078a00 0x7fe8a407aec0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe8c41f8f70 tx=0x7fe8b4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:56.265 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.263+0000 7fe8c17fa640 1 -- 172.21.15.98:0/550393317 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7fe8bc03f030 con 0x7fe8c40d1610 2024-09-16T15:38:56.439 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.437+0000 7fe8cb175640 1 -- 172.21.15.98:0/550393317 --> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7fe8c406e7d0 con 0x7fe8a4078a00 2024-09-16T15:38:56.439 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.438+0000 7fe8c17fa640 1 -- 172.21.15.98:0/550393317 <== mgr.4100 v2:172.21.15.135:6800/699234772 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fe8c406e7d0 con 0x7fe8a4078a00 2024-09-16T15:38:56.440 INFO:teuthology.orchestra.run.smithi098.stderr:instructed osd(s) 6 to deep-scrub 2024-09-16T15:38:56.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.440+0000 7fe8cb175640 1 -- 172.21.15.98:0/550393317 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fe8a4078a00 msgr2=0x7fe8a407aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:56.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.440+0000 7fe8cb175640 1 --2- 172.21.15.98:0/550393317 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fe8a4078a00 0x7fe8a407aec0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe8c41f8f70 tx=0x7fe8b4009040 comp rx=0 tx=0).stop 2024-09-16T15:38:56.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.440+0000 7fe8cb175640 1 -- 172.21.15.98:0/550393317 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe8c40d1610 msgr2=0x7fe8c40cdeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:56.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.440+0000 7fe8cb175640 1 --2- 172.21.15.98:0/550393317 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe8c40d1610 0x7fe8c40cdeb0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc000c00 tx=0x7fe8bc033d60 comp rx=0 tx=0).stop 2024-09-16T15:38:56.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.440+0000 7fe8cb175640 1 -- 172.21.15.98:0/550393317 shutdown_connections 2024-09-16T15:38:56.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.440+0000 7fe8cb175640 1 --2- 172.21.15.98:0/550393317 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fe8c415e0d0 0x7fe8c41f5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:56.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.440+0000 7fe8cb175640 1 --2- 172.21.15.98:0/550393317 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fe8a4078a00 0x7fe8a407aec0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:56.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.440+0000 7fe8cb175640 1 --2- 172.21.15.98:0/550393317 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8c40d2050 0x7fe8c40cc470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:56.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.440+0000 7fe8cb175640 1 --2- 172.21.15.98:0/550393317 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe8c40d1610 0x7fe8c40cdeb0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:56.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.440+0000 7fe8cb175640 1 -- 172.21.15.98:0/550393317 >> 172.21.15.98:0/550393317 conn(0x7fe8c40d3fe0 msgr2=0x7fe8c406ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:56.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.440+0000 7fe8cb175640 1 -- 172.21.15.98:0/550393317 shutdown_connections 2024-09-16T15:38:56.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.440+0000 7fe8cb175640 1 -- 172.21.15.98:0/550393317 wait complete. 2024-09-16T15:38:56.452 INFO:tasks.ceph:Scrubbing osd.7 2024-09-16T15:38:56.453 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-16T15:38:56.558 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.556+0000 7fb5ce62a640 1 -- 172.21.15.98:0/1713521466 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5c80d0410 msgr2=0x7fb5c80d2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:56.558 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.556+0000 7fb5ce62a640 1 --2- 172.21.15.98:0/1713521466 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5c80d0410 0x7fb5c80d2950 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fb5b0005fd0 tx=0x7fb5b002a530 comp rx=0 tx=0).stop 2024-09-16T15:38:56.558 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.556+0000 7fb5ce62a640 1 -- 172.21.15.98:0/1713521466 shutdown_connections 2024-09-16T15:38:56.559 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.556+0000 7fb5ce62a640 1 --2- 172.21.15.98:0/1713521466 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5c80b0ef0 0x7fb5c80d07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:56.559 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.556+0000 7fb5ce62a640 1 --2- 172.21.15.98:0/1713521466 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5c80d0410 0x7fb5c80d2950 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:56.559 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.556+0000 7fb5ce62a640 1 -- 172.21.15.98:0/1713521466 >> 172.21.15.98:0/1713521466 conn(0x7fb5c80d1e30 msgr2=0x7fb5c80d2240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:56.559 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.556+0000 7fb5ce62a640 1 -- 172.21.15.98:0/1713521466 shutdown_connections 2024-09-16T15:38:56.559 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.556+0000 7fb5ce62a640 1 -- 172.21.15.98:0/1713521466 wait complete. 2024-09-16T15:38:56.559 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.557+0000 7fb5ce62a640 1 Processor -- start 2024-09-16T15:38:56.559 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.557+0000 7fb5ce62a640 1 -- start start 2024-09-16T15:38:56.561 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.558+0000 7fb5ce62a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5c80b0ef0 0x7fb5c81590a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:56.561 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.558+0000 7fb5ce62a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5c80ce4e0 0x7fb5c80b4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:56.561 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.558+0000 7fb5ce62a640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5c80d0410 0x7fb5c814a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:56.562 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.558+0000 7fb5ce62a640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb5c80afc10 con 0x7fb5c80ce4e0 2024-09-16T15:38:56.562 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.558+0000 7fb5ce62a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb5c80afa90 con 0x7fb5c80b0ef0 2024-09-16T15:38:56.562 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.558+0000 7fb5ce62a640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fb5c80cf080 con 0x7fb5c80d0410 2024-09-16T15:38:56.562 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.558+0000 7fb5c77fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5c80ce4e0 0x7fb5c80b4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:56.562 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.558+0000 7fb5c77fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5c80ce4e0 0x7fb5c80b4c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46162/0 (socket says 172.21.15.98:46162) 2024-09-16T15:38:56.562 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.558+0000 7fb5c77fe640 1 -- 172.21.15.98:0/4018808936 learned_addr learned my addr 172.21.15.98:0/4018808936 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:56.562 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.558+0000 7fb5c7fff640 1 --2- 172.21.15.98:0/4018808936 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5c80b0ef0 0x7fb5c81590a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:56.562 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.558+0000 7fb5ccbc7640 1 --2- 172.21.15.98:0/4018808936 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5c80d0410 0x7fb5c814a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:56.562 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.559+0000 7fb5c77fe640 1 -- 172.21.15.98:0/4018808936 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5c80d0410 msgr2=0x7fb5c814a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:56.562 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.559+0000 7fb5c77fe640 1 --2- 172.21.15.98:0/4018808936 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb5c80d0410 0x7fb5c814a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:56.562 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.559+0000 7fb5c77fe640 1 -- 172.21.15.98:0/4018808936 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5c80b0ef0 msgr2=0x7fb5c81590a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:56.562 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.559+0000 7fb5c77fe640 1 --2- 172.21.15.98:0/4018808936 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5c80b0ef0 0x7fb5c81590a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:56.562 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.559+0000 7fb5c77fe640 1 -- 172.21.15.98:0/4018808936 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5c815c460 con 0x7fb5c80ce4e0 2024-09-16T15:38:56.562 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.559+0000 7fb5c77fe640 1 --2- 172.21.15.98:0/4018808936 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5c80ce4e0 0x7fb5c80b4c80 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fb5b800c970 tx=0x7fb5b800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:56.563 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.559+0000 7fb5c4ff9640 1 -- 172.21.15.98:0/4018808936 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b8007bb0 con 0x7fb5c80ce4e0 2024-09-16T15:38:56.563 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.559+0000 7fb5c4ff9640 1 -- 172.21.15.98:0/4018808936 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb5b8005020 con 0x7fb5c80ce4e0 2024-09-16T15:38:56.563 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.559+0000 7fb5ce62a640 1 -- 172.21.15.98:0/4018808936 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5c81f38a0 con 0x7fb5c80ce4e0 2024-09-16T15:38:56.563 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.559+0000 7fb5c4ff9640 1 -- 172.21.15.98:0/4018808936 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b8007e60 con 0x7fb5c80ce4e0 2024-09-16T15:38:56.563 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.559+0000 7fb5ce62a640 1 -- 172.21.15.98:0/4018808936 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5c80b51c0 con 0x7fb5c80ce4e0 2024-09-16T15:38:56.564 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.560+0000 7fb5ce62a640 1 -- 172.21.15.98:0/4018808936 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb5c80b7550 con 0x7fb5c80ce4e0 2024-09-16T15:38:56.564 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.561+0000 7fb5c4ff9640 1 -- 172.21.15.98:0/4018808936 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 7) ==== 101440+0+0 (secure 0 0 0) 0x7fb5b8005470 con 0x7fb5c80ce4e0 2024-09-16T15:38:56.564 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.561+0000 7fb5c4ff9640 1 --2- 172.21.15.98:0/4018808936 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fb5a8078a00 0x7fb5a807aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:56.565 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.561+0000 7fb5c4ff9640 1 -- 172.21.15.98:0/4018808936 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7fb5b809add0 con 0x7fb5c80ce4e0 2024-09-16T15:38:56.565 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.561+0000 7fb5c4ff9640 1 --2- 172.21.15.98:0/4018808936 >> [v2:172.21.15.135:6826/2559837727,v1:172.21.15.135:6827/2559837727] conn(0x7fb5a807e8c0 0x7fb5a8080ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:56.565 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.561+0000 7fb5c4ff9640 1 -- 172.21.15.98:0/4018808936 --> [v2:172.21.15.135:6826/2559837727,v1:172.21.15.135:6827/2559837727] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb5b8004490 con 0x7fb5a807e8c0 2024-09-16T15:38:56.565 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.561+0000 7fb5c4ff9640 1 -- 172.21.15.98:0/4018808936 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fb5b809d4b0 con 0x7fb5c80ce4e0 2024-09-16T15:38:56.565 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.561+0000 7fb5c7fff640 1 --2- 172.21.15.98:0/4018808936 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fb5a8078a00 0x7fb5a807aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:56.565 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.562+0000 7fb5ccbc7640 1 --2- 172.21.15.98:0/4018808936 >> [v2:172.21.15.135:6826/2559837727,v1:172.21.15.135:6827/2559837727] conn(0x7fb5a807e8c0 0x7fb5a8080ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:56.565 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.562+0000 7fb5c7fff640 1 --2- 172.21.15.98:0/4018808936 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fb5a8078a00 0x7fb5a807aec0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb5b0033000 tx=0x7fb5b0004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:56.565 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.562+0000 7fb5ccbc7640 1 --2- 172.21.15.98:0/4018808936 >> [v2:172.21.15.135:6826/2559837727,v1:172.21.15.135:6827/2559837727] conn(0x7fb5a807e8c0 0x7fb5a8080ce0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:56.565 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.563+0000 7fb5c4ff9640 1 -- 172.21.15.98:0/4018808936 <== osd.7 v2:172.21.15.135:6826/2559837727 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb5b8004490 con 0x7fb5a807e8c0 2024-09-16T15:38:56.577 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.575+0000 7fb5ce62a640 1 -- 172.21.15.98:0/4018808936 --> [v2:172.21.15.135:6826/2559837727,v1:172.21.15.135:6827/2559837727] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fb5c80d07f0 con 0x7fb5a807e8c0 2024-09-16T15:38:56.577 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.575+0000 7fb5c4ff9640 1 -- 172.21.15.98:0/4018808936 <== osd.7 v2:172.21.15.135:6826/2559837727 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fb5c80d07f0 con 0x7fb5a807e8c0 2024-09-16T15:38:56.577 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-16T15:38:56.578 INFO:teuthology.orchestra.run.smithi098.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-16T15:38:56.578 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-16T15:38:56.579 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.576+0000 7fb5ce62a640 1 -- 172.21.15.98:0/4018808936 >> [v2:172.21.15.135:6826/2559837727,v1:172.21.15.135:6827/2559837727] conn(0x7fb5a807e8c0 msgr2=0x7fb5a8080ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:56.579 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.576+0000 7fb5ce62a640 1 --2- 172.21.15.98:0/4018808936 >> [v2:172.21.15.135:6826/2559837727,v1:172.21.15.135:6827/2559837727] conn(0x7fb5a807e8c0 0x7fb5a8080ce0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:56.579 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.576+0000 7fb5ce62a640 1 -- 172.21.15.98:0/4018808936 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fb5a8078a00 msgr2=0x7fb5a807aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:56.579 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.576+0000 7fb5ce62a640 1 --2- 172.21.15.98:0/4018808936 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fb5a8078a00 0x7fb5a807aec0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb5b0033000 tx=0x7fb5b0004730 comp rx=0 tx=0).stop 2024-09-16T15:38:56.579 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.576+0000 7fb5ce62a640 1 -- 172.21.15.98:0/4018808936 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5c80ce4e0 msgr2=0x7fb5c80b4c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:56.579 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.576+0000 7fb5ce62a640 1 --2- 172.21.15.98:0/4018808936 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5c80ce4e0 0x7fb5c80b4c80 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fb5b800c970 tx=0x7fb5b800ce30 comp rx=0 tx=0).stop 2024-09-16T15:38:56.579 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.576+0000 7fb5ccbc7640 1 -- 172.21.15.98:0/4018808936 reap_dead start 2024-09-16T15:38:56.579 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.576+0000 7fb5ce62a640 1 -- 172.21.15.98:0/4018808936 shutdown_connections 2024-09-16T15:38:56.579 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.576+0000 7fb5ce62a640 1 -- 172.21.15.98:0/4018808936 >> 172.21.15.98:0/4018808936 conn(0x7fb5c80d1e30 msgr2=0x7fb5c80d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:56.579 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.576+0000 7fb5ce62a640 1 -- 172.21.15.98:0/4018808936 shutdown_connections 2024-09-16T15:38:56.579 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.576+0000 7fb5ce62a640 1 -- 172.21.15.98:0/4018808936 wait complete. 2024-09-16T15:38:56.588 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-16T15:38:56.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.688+0000 7f3255f3d640 1 -- 172.21.15.98:0/2111295645 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f32500cd330 msgr2=0x7f325006cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:56.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.688+0000 7f3255f3d640 1 --2- 172.21.15.98:0/2111295645 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f32500cd330 0x7f325006cb70 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f3238009830 tx=0x7f323802a510 comp rx=0 tx=0).stop 2024-09-16T15:38:56.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.688+0000 7f3255f3d640 1 -- 172.21.15.98:0/2111295645 shutdown_connections 2024-09-16T15:38:56.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.688+0000 7f3255f3d640 1 --2- 172.21.15.98:0/2111295645 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f32500cd330 0x7f325006cb70 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:56.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.688+0000 7f3255f3d640 1 --2- 172.21.15.98:0/2111295645 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f32500b6290 0x7f325006f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:56.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.688+0000 7f3255f3d640 1 -- 172.21.15.98:0/2111295645 >> 172.21.15.98:0/2111295645 conn(0x7f32500d0d40 msgr2=0x7f32500d1120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:56.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.688+0000 7f3255f3d640 1 -- 172.21.15.98:0/2111295645 shutdown_connections 2024-09-16T15:38:56.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.688+0000 7f3255f3d640 1 -- 172.21.15.98:0/2111295645 wait complete. 2024-09-16T15:38:56.692 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.689+0000 7f3255f3d640 1 Processor -- start 2024-09-16T15:38:56.692 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.690+0000 7f3255f3d640 1 -- start start 2024-09-16T15:38:56.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.690+0000 7f3255f3d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f325006d0b0 0x7f32501f3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:56.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.690+0000 7f3255f3d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f32500b6290 0x7f32501f2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:56.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.690+0000 7f3255f3d640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f32500cd330 0x7f32500b1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:56.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.690+0000 7f3255f3d640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3250074600 con 0x7f32500b6290 2024-09-16T15:38:56.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.690+0000 7f3255f3d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f32500cbf60 con 0x7f325006d0b0 2024-09-16T15:38:56.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.690+0000 7f3255f3d640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f32500cc0e0 con 0x7f32500cd330 2024-09-16T15:38:56.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.690+0000 7f324effd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f32500b6290 0x7f32501f2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:56.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.690+0000 7f324effd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f32500b6290 0x7f32501f2c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46192/0 (socket says 172.21.15.98:46192) 2024-09-16T15:38:56.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.690+0000 7f324effd640 1 -- 172.21.15.98:0/1717897249 learned_addr learned my addr 172.21.15.98:0/1717897249 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:56.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.691+0000 7f324ffff640 1 --2- 172.21.15.98:0/1717897249 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f32500cd330 0x7f32500b1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:56.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.691+0000 7f324f7fe640 1 --2- 172.21.15.98:0/1717897249 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f325006d0b0 0x7f32501f3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:56.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.691+0000 7f324effd640 1 -- 172.21.15.98:0/1717897249 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f32500cd330 msgr2=0x7f32500b1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:56.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.691+0000 7f324effd640 1 --2- 172.21.15.98:0/1717897249 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f32500cd330 0x7f32500b1cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:56.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.691+0000 7f324effd640 1 -- 172.21.15.98:0/1717897249 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f325006d0b0 msgr2=0x7f32501f3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:56.695 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.691+0000 7f324effd640 1 --2- 172.21.15.98:0/1717897249 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f325006d0b0 0x7f32501f3390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:56.695 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.691+0000 7f324effd640 1 -- 172.21.15.98:0/1717897249 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32500c4c40 con 0x7f32500b6290 2024-09-16T15:38:56.695 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.691+0000 7f324effd640 1 --2- 172.21.15.98:0/1717897249 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f32500b6290 0x7f32501f2c00 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f3238009950 tx=0x7f3238032c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:56.695 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.691+0000 7f3247fff640 1 -- 172.21.15.98:0/1717897249 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3238040070 con 0x7f32500b6290 2024-09-16T15:38:56.695 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.691+0000 7f3247fff640 1 -- 172.21.15.98:0/1717897249 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3238005310 con 0x7f32500b6290 2024-09-16T15:38:56.695 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.691+0000 7f3255f3d640 1 -- 172.21.15.98:0/1717897249 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32500c4f20 con 0x7f32500b6290 2024-09-16T15:38:56.695 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.691+0000 7f3247fff640 1 -- 172.21.15.98:0/1717897249 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32380047a0 con 0x7f32500b6290 2024-09-16T15:38:56.695 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.691+0000 7f3255f3d640 1 -- 172.21.15.98:0/1717897249 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32500cafc0 con 0x7f32500b6290 2024-09-16T15:38:56.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.692+0000 7f3255f3d640 1 -- 172.21.15.98:0/1717897249 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32500718e0 con 0x7f32500b6290 2024-09-16T15:38:56.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.693+0000 7f3247fff640 1 -- 172.21.15.98:0/1717897249 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 7) ==== 101440+0+0 (secure 0 0 0) 0x7f3238039040 con 0x7f32500b6290 2024-09-16T15:38:56.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.693+0000 7f3247fff640 1 --2- 172.21.15.98:0/1717897249 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f3230078a00 0x7f323007aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:56.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.693+0000 7f3247fff640 1 -- 172.21.15.98:0/1717897249 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f32380bbcf0 con 0x7f32500b6290 2024-09-16T15:38:56.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.694+0000 7f324f7fe640 1 --2- 172.21.15.98:0/1717897249 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f3230078a00 0x7f323007aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:56.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.694+0000 7f324f7fe640 1 --2- 172.21.15.98:0/1717897249 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f3230078a00 0x7f323007aec0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f32500cad90 tx=0x7f32400082b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:56.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.698+0000 7f3247fff640 1 -- 172.21.15.98:0/1717897249 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7f32500718e0 con 0x7f32500b6290 2024-09-16T15:38:56.877 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.875+0000 7f3255f3d640 1 -- 172.21.15.98:0/1717897249 --> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f32500b67b0 con 0x7f3230078a00 2024-09-16T15:38:56.878 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.876+0000 7f3247fff640 1 -- 172.21.15.98:0/1717897249 <== mgr.4100 v2:172.21.15.135:6800/699234772 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f3240008d40 con 0x7f3230078a00 2024-09-16T15:38:56.878 INFO:teuthology.orchestra.run.smithi098.stderr:instructed osd(s) 7 to deep-scrub 2024-09-16T15:38:56.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.878+0000 7f3255f3d640 1 -- 172.21.15.98:0/1717897249 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f3230078a00 msgr2=0x7f323007aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:56.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.878+0000 7f3255f3d640 1 --2- 172.21.15.98:0/1717897249 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f3230078a00 0x7f323007aec0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f32500cad90 tx=0x7f32400082b0 comp rx=0 tx=0).stop 2024-09-16T15:38:56.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.878+0000 7f3255f3d640 1 -- 172.21.15.98:0/1717897249 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f32500b6290 msgr2=0x7f32501f2c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:56.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.878+0000 7f3255f3d640 1 --2- 172.21.15.98:0/1717897249 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f32500b6290 0x7f32501f2c00 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f3238009950 tx=0x7f3238032c10 comp rx=0 tx=0).stop 2024-09-16T15:38:56.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.878+0000 7f3255f3d640 1 -- 172.21.15.98:0/1717897249 shutdown_connections 2024-09-16T15:38:56.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.878+0000 7f3255f3d640 1 --2- 172.21.15.98:0/1717897249 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f32500cd330 0x7f32500b1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:56.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.878+0000 7f3255f3d640 1 --2- 172.21.15.98:0/1717897249 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f32500b6290 0x7f32501f2c00 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:56.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.878+0000 7f3255f3d640 1 --2- 172.21.15.98:0/1717897249 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f3230078a00 0x7f323007aec0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:56.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.878+0000 7f3255f3d640 1 --2- 172.21.15.98:0/1717897249 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f325006d0b0 0x7f32501f3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:56.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.878+0000 7f3255f3d640 1 -- 172.21.15.98:0/1717897249 >> 172.21.15.98:0/1717897249 conn(0x7f32500d0d40 msgr2=0x7f325015b590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:56.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.878+0000 7f3255f3d640 1 -- 172.21.15.98:0/1717897249 shutdown_connections 2024-09-16T15:38:56.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.878+0000 7f3255f3d640 1 -- 172.21.15.98:0/1717897249 wait complete. 2024-09-16T15:38:56.891 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T15:38:56.992 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.990+0000 7fc36fadd640 1 -- 172.21.15.98:0/1239735215 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3680ccb30 msgr2=0x7fc36806f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:56.992 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.990+0000 7fc36fadd640 1 --2- 172.21.15.98:0/1239735215 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3680ccb30 0x7fc36806f850 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc358005fd0 tx=0x7fc35802b250 comp rx=0 tx=0).stop 2024-09-16T15:38:56.992 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.990+0000 7fc36fadd640 1 -- 172.21.15.98:0/1239735215 shutdown_connections 2024-09-16T15:38:56.993 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.990+0000 7fc36fadd640 1 --2- 172.21.15.98:0/1239735215 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3680ccb30 0x7fc36806f850 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:56.993 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.990+0000 7fc36fadd640 1 --2- 172.21.15.98:0/1239735215 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc3681438b0 0x7fc3680cc5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:56.993 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.990+0000 7fc36fadd640 1 -- 172.21.15.98:0/1239735215 >> 172.21.15.98:0/1239735215 conn(0x7fc3680b1950 msgr2=0x7fc3680b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:56.993 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.990+0000 7fc36fadd640 1 -- 172.21.15.98:0/1239735215 shutdown_connections 2024-09-16T15:38:56.993 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.990+0000 7fc36fadd640 1 -- 172.21.15.98:0/1239735215 wait complete. 2024-09-16T15:38:56.993 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.991+0000 7fc36fadd640 1 Processor -- start 2024-09-16T15:38:56.993 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.991+0000 7fc36fadd640 1 -- start start 2024-09-16T15:38:56.995 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.992+0000 7fc36fadd640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc36806fd90 0x7fc3680c9380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:56.995 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.992+0000 7fc36fadd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3680ccb30 0x7fc36809cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:56.995 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.992+0000 7fc36fadd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3681438b0 0x7fc36809d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:56.995 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.992+0000 7fc36fadd640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc368070920 con 0x7fc3680ccb30 2024-09-16T15:38:56.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.992+0000 7fc36fadd640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc3680b4f60 con 0x7fc3681438b0 2024-09-16T15:38:56.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.992+0000 7fc36fadd640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7fc368070aa0 con 0x7fc36806fd90 2024-09-16T15:38:56.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.992+0000 7fc36d078640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3680ccb30 0x7fc36809cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:56.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.992+0000 7fc36d078640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3680ccb30 0x7fc36809cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46194/0 (socket says 172.21.15.98:46194) 2024-09-16T15:38:56.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.992+0000 7fc36d078640 1 -- 172.21.15.98:0/2218290172 learned_addr learned my addr 172.21.15.98:0/2218290172 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:38:56.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.992+0000 7fc36d879640 1 --2- 172.21.15.98:0/2218290172 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc36806fd90 0x7fc3680c9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:56.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.992+0000 7fc36e07a640 1 --2- 172.21.15.98:0/2218290172 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3681438b0 0x7fc36809d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:56.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.993+0000 7fc36d078640 1 -- 172.21.15.98:0/2218290172 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc36806fd90 msgr2=0x7fc3680c9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:56.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.993+0000 7fc36d078640 1 --2- 172.21.15.98:0/2218290172 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc36806fd90 0x7fc3680c9380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:56.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.993+0000 7fc36d078640 1 -- 172.21.15.98:0/2218290172 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3681438b0 msgr2=0x7fc36809d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:56.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.993+0000 7fc36d078640 1 --2- 172.21.15.98:0/2218290172 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3681438b0 0x7fc36809d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:56.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.993+0000 7fc36d078640 1 -- 172.21.15.98:0/2218290172 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3681f3c70 con 0x7fc3680ccb30 2024-09-16T15:38:56.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.993+0000 7fc36d879640 1 --2- 172.21.15.98:0/2218290172 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc36806fd90 0x7fc3680c9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T15:38:56.997 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.993+0000 7fc36d078640 1 --2- 172.21.15.98:0/2218290172 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3680ccb30 0x7fc36809cc10 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fc3580075d0 tx=0x7fc358003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:56.997 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.993+0000 7fc35e7fc640 1 -- 172.21.15.98:0/2218290172 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc358041070 con 0x7fc3680ccb30 2024-09-16T15:38:56.997 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.993+0000 7fc36fadd640 1 -- 172.21.15.98:0/2218290172 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3681f66b0 con 0x7fc3680ccb30 2024-09-16T15:38:56.997 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.993+0000 7fc35e7fc640 1 -- 172.21.15.98:0/2218290172 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc358003d10 con 0x7fc3680ccb30 2024-09-16T15:38:56.997 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.993+0000 7fc35e7fc640 1 -- 172.21.15.98:0/2218290172 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc358005280 con 0x7fc3680ccb30 2024-09-16T15:38:56.997 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.993+0000 7fc36fadd640 1 -- 172.21.15.98:0/2218290172 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3681f6c70 con 0x7fc3680ccb30 2024-09-16T15:38:56.998 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.994+0000 7fc36fadd640 1 -- 172.21.15.98:0/2218290172 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3680cee40 con 0x7fc3680ccb30 2024-09-16T15:38:56.998 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.995+0000 7fc35e7fc640 1 -- 172.21.15.98:0/2218290172 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 7) ==== 101440+0+0 (secure 0 0 0) 0x7fc358044070 con 0x7fc3680ccb30 2024-09-16T15:38:56.998 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.995+0000 7fc35e7fc640 1 --2- 172.21.15.98:0/2218290172 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fc34c078a00 0x7fc34c07aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:38:56.998 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.996+0000 7fc35e7fc640 1 -- 172.21.15.98:0/2218290172 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7fc3580ba800 con 0x7fc3680ccb30 2024-09-16T15:38:56.998 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.996+0000 7fc36d879640 1 --2- 172.21.15.98:0/2218290172 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fc34c078a00 0x7fc34c07aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:38:56.998 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:56.996+0000 7fc36d879640 1 --2- 172.21.15.98:0/2218290172 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fc34c078a00 0x7fc34c07aec0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc364009b80 tx=0x7fc364005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:38:57.001 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:57.000+0000 7fc35e7fc640 1 -- 172.21.15.98:0/2218290172 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7fc3680cee40 con 0x7fc3680ccb30 2024-09-16T15:38:57.173 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:57.171+0000 7fc36fadd640 1 -- 172.21.15.98:0/2218290172 --> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc36806f850 con 0x7fc34c078a00 2024-09-16T15:38:57.173 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:57.172+0000 7fc35e7fc640 1 -- 172.21.15.98:0/2218290172 <== mgr.4100 v2:172.21.15.135:6800/699234772 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13363 (secure 0 0 0) 0x7fc36806f850 con 0x7fc34c078a00 2024-09-16T15:38:57.174 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:38:57.174 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2024-09-16T15:38:57.176 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:57.174+0000 7fc36fadd640 1 -- 172.21.15.98:0/2218290172 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fc34c078a00 msgr2=0x7fc34c07aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:57.176 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:57.174+0000 7fc36fadd640 1 --2- 172.21.15.98:0/2218290172 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fc34c078a00 0x7fc34c07aec0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc364009b80 tx=0x7fc364005f90 comp rx=0 tx=0).stop 2024-09-16T15:38:57.176 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:57.174+0000 7fc36fadd640 1 -- 172.21.15.98:0/2218290172 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3680ccb30 msgr2=0x7fc36809cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:38:57.176 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:57.174+0000 7fc36fadd640 1 --2- 172.21.15.98:0/2218290172 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3680ccb30 0x7fc36809cc10 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fc3580075d0 tx=0x7fc358003820 comp rx=0 tx=0).stop 2024-09-16T15:38:57.176 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:57.174+0000 7fc36fadd640 1 -- 172.21.15.98:0/2218290172 shutdown_connections 2024-09-16T15:38:57.176 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:57.174+0000 7fc36fadd640 1 --2- 172.21.15.98:0/2218290172 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7fc34c078a00 0x7fc34c07aec0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:57.176 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:57.174+0000 7fc36fadd640 1 --2- 172.21.15.98:0/2218290172 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3681438b0 0x7fc36809d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:57.176 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:57.174+0000 7fc36fadd640 1 --2- 172.21.15.98:0/2218290172 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3680ccb30 0x7fc36809cc10 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:57.177 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:57.174+0000 7fc36fadd640 1 --2- 172.21.15.98:0/2218290172 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fc36806fd90 0x7fc3680c9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:38:57.177 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:57.174+0000 7fc36fadd640 1 -- 172.21.15.98:0/2218290172 >> 172.21.15.98:0/2218290172 conn(0x7fc3680b1950 msgr2=0x7fc36815e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:38:57.177 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:57.174+0000 7fc36fadd640 1 -- 172.21.15.98:0/2218290172 shutdown_connections 2024-09-16T15:38:57.177 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:38:57.174+0000 7fc36fadd640 1 -- 172.21.15.98:0/2218290172 wait complete. 2024-09-16T15:38:57.187 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":73,"stamp":"2024-09-16T15:38:56.725144+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":220688,"kb_used_data":4456,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754032,"statfs":{"total":773094113280,"available":772868128768,"internally_reserved":0,"allocated":4562944,"data_stored":2477408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-6,"num_write_kb":-3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001942"},"pg_stats":[{"pgid":"1.0","version":"18'72","reported_seq":137,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T15:38:47.630781+0000","last_change":"2024-09-16T15:37:37.258601+0000","last_active":"2024-09-16T15:38:47.630781+0000","last_peered":"2024-09-16T15:38:47.630781+0000","last_clean":"2024-09-16T15:38:47.630781+0000","last_became_active":"2024-09-16T15:37:37.257584+0000","last_became_peered":"2024-09-16T15:37:37.257584+0000","last_unstale":"2024-09-16T15:38:47.630781+0000","last_undegraded":"2024-09-16T15:38:47.630781+0000","last_fullsized":"2024-09-16T15:38:47.630781+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:37:35.447043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:37:35.447043+0000","last_clean_scrub_stamp":"2024-09-16T15:37:35.447043+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:43:17.464894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509460,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27440,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":421888,"data_stored":162084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509460,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28020,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343820,"statfs":{"total":96636764160,"available":96608071680,"internally_reserved":0,"allocated":1015808,"data_stored":752452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509461,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27440,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":421888,"data_stored":162084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509461,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27440,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":421888,"data_stored":162084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509460,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27440,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":421888,"data_stored":162084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509461,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28024,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343816,"statfs":{"total":96636764160,"available":96608067584,"internally_reserved":0,"allocated":1015808,"data_stored":752452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509459,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27440,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":421888,"data_stored":162084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27444,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":421888,"data_stored":162084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T15:38:57.189 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-16T15:37:35.447043+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=15, tm_min=37, tm_sec=35, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=15, tm_min=38, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T15:38:57.189 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-16T15:39:12.857 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T15:39:12.861 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T15:39:17.190 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T15:39:17.303 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.301+0000 7f84f5dd3640 1 -- 172.21.15.98:0/835229471 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84f01445d0 msgr2=0x7f84f00cebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:39:17.303 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.301+0000 7f84f5dd3640 1 --2- 172.21.15.98:0/835229471 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84f01445d0 0x7f84f00cebf0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f84e0005fd0 tx=0x7f84e002ab20 comp rx=0 tx=0).stop 2024-09-16T15:39:17.303 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.301+0000 7f84f5dd3640 1 -- 172.21.15.98:0/835229471 shutdown_connections 2024-09-16T15:39:17.303 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.301+0000 7f84f5dd3640 1 --2- 172.21.15.98:0/835229471 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f84f00b4ca0 0x7f84f00cf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:39:17.303 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.301+0000 7f84f5dd3640 1 --2- 172.21.15.98:0/835229471 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84f01445d0 0x7f84f00cebf0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:39:17.303 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.301+0000 7f84f5dd3640 1 -- 172.21.15.98:0/835229471 >> 172.21.15.98:0/835229471 conn(0x7f84f00b1950 msgr2=0x7f84f00b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:39:17.304 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.301+0000 7f84f5dd3640 1 -- 172.21.15.98:0/835229471 shutdown_connections 2024-09-16T15:39:17.304 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.301+0000 7f84f5dd3640 1 -- 172.21.15.98:0/835229471 wait complete. 2024-09-16T15:39:17.304 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.302+0000 7f84f5dd3640 1 Processor -- start 2024-09-16T15:39:17.304 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.302+0000 7f84f5dd3640 1 -- start start 2024-09-16T15:39:17.306 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.303+0000 7f84f5dd3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84f00b4ca0 0x7f84f009ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:39:17.306 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.303+0000 7f84f5dd3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84f00ccfd0 0x7f84f009b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:39:17.306 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.303+0000 7f84f5dd3640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f84f01445d0 0x7f84f01f6b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:39:17.306 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.303+0000 7f84f5dd3640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f84f015f080 con 0x7f84f00ccfd0 2024-09-16T15:39:17.307 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.303+0000 7f84f5dd3640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f84f0073bc0 con 0x7f84f00b4ca0 2024-09-16T15:39:17.307 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.303+0000 7f84f5dd3640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f84f015f200 con 0x7f84f01445d0 2024-09-16T15:39:17.307 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.303+0000 7f84eeffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84f00ccfd0 0x7f84f009b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:39:17.307 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.303+0000 7f84eeffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84f00ccfd0 0x7f84f009b460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37882/0 (socket says 172.21.15.98:37882) 2024-09-16T15:39:17.307 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.303+0000 7f84eeffd640 1 -- 172.21.15.98:0/1640066660 learned_addr learned my addr 172.21.15.98:0/1640066660 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:39:17.307 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.303+0000 7f84effff640 1 --2- 172.21.15.98:0/1640066660 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f84f01445d0 0x7f84f01f6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:39:17.307 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.303+0000 7f84ef7fe640 1 --2- 172.21.15.98:0/1640066660 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84f00b4ca0 0x7f84f009ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:39:17.307 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.303+0000 7f84eeffd640 1 -- 172.21.15.98:0/1640066660 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f84f01445d0 msgr2=0x7f84f01f6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:39:17.307 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.303+0000 7f84eeffd640 1 --2- 172.21.15.98:0/1640066660 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f84f01445d0 0x7f84f01f6b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:39:17.307 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.303+0000 7f84eeffd640 1 -- 172.21.15.98:0/1640066660 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84f00b4ca0 msgr2=0x7f84f009ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:39:17.307 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.303+0000 7f84eeffd640 1 --2- 172.21.15.98:0/1640066660 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84f00b4ca0 0x7f84f009ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:39:17.307 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.303+0000 7f84eeffd640 1 -- 172.21.15.98:0/1640066660 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84f00adf90 con 0x7f84f00ccfd0 2024-09-16T15:39:17.307 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.304+0000 7f84eeffd640 1 --2- 172.21.15.98:0/1640066660 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84f00ccfd0 0x7f84f009b460 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f84e400c500 tx=0x7f84e400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:39:17.308 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.304+0000 7f84d7fff640 1 -- 172.21.15.98:0/1640066660 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84e40052d0 con 0x7f84f00ccfd0 2024-09-16T15:39:17.308 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.304+0000 7f84d7fff640 1 -- 172.21.15.98:0/1640066660 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f84e4005470 con 0x7f84f00ccfd0 2024-09-16T15:39:17.308 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.304+0000 7f84d7fff640 1 -- 172.21.15.98:0/1640066660 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84e4012870 con 0x7f84f00ccfd0 2024-09-16T15:39:17.308 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.304+0000 7f84f5dd3640 1 -- 172.21.15.98:0/1640066660 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84f00ae270 con 0x7f84f00ccfd0 2024-09-16T15:39:17.308 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.304+0000 7f84f5dd3640 1 -- 172.21.15.98:0/1640066660 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84f013e730 con 0x7f84f00ccfd0 2024-09-16T15:39:17.309 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.305+0000 7f84f5dd3640 1 -- 172.21.15.98:0/1640066660 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84f015f6b0 con 0x7f84f00ccfd0 2024-09-16T15:39:17.309 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.305+0000 7f84d7fff640 1 -- 172.21.15.98:0/1640066660 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 7) ==== 101440+0+0 (secure 0 0 0) 0x7f84e40035f0 con 0x7f84f00ccfd0 2024-09-16T15:39:17.309 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.306+0000 7f84d7fff640 1 --2- 172.21.15.98:0/1640066660 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f84dc078a00 0x7f84dc07aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:39:17.309 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.306+0000 7f84d7fff640 1 -- 172.21.15.98:0/1640066660 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f84e409a480 con 0x7f84f00ccfd0 2024-09-16T15:39:17.309 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.306+0000 7f84ef7fe640 1 --2- 172.21.15.98:0/1640066660 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f84dc078a00 0x7f84dc07aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:39:17.309 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.307+0000 7f84ef7fe640 1 --2- 172.21.15.98:0/1640066660 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f84dc078a00 0x7f84dc07aec0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f84e0035000 tx=0x7f84e0038040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:39:17.312 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.310+0000 7f84d7fff640 1 -- 172.21.15.98:0/1640066660 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7f84e4062420 con 0x7f84f00ccfd0 2024-09-16T15:39:17.486 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.484+0000 7f84f5dd3640 1 -- 172.21.15.98:0/1640066660 --> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f84f00b2640 con 0x7f84dc078a00 2024-09-16T15:39:17.487 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.486+0000 7f84d7fff640 1 -- 172.21.15.98:0/1640066660 <== mgr.4100 v2:172.21.15.135:6800/699234772 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13341 (secure 0 0 0) 0x7f84f00b2640 con 0x7f84dc078a00 2024-09-16T15:39:17.487 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:39:17.488 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2024-09-16T15:39:17.489 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.487+0000 7f84f5dd3640 1 -- 172.21.15.98:0/1640066660 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f84dc078a00 msgr2=0x7f84dc07aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:39:17.490 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.487+0000 7f84f5dd3640 1 --2- 172.21.15.98:0/1640066660 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f84dc078a00 0x7f84dc07aec0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f84e0035000 tx=0x7f84e0038040 comp rx=0 tx=0).stop 2024-09-16T15:39:17.490 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.487+0000 7f84f5dd3640 1 -- 172.21.15.98:0/1640066660 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84f00ccfd0 msgr2=0x7f84f009b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:39:17.490 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.487+0000 7f84f5dd3640 1 --2- 172.21.15.98:0/1640066660 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84f00ccfd0 0x7f84f009b460 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f84e400c500 tx=0x7f84e400c9c0 comp rx=0 tx=0).stop 2024-09-16T15:39:17.490 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.487+0000 7f84f5dd3640 1 -- 172.21.15.98:0/1640066660 shutdown_connections 2024-09-16T15:39:17.490 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.487+0000 7f84f5dd3640 1 --2- 172.21.15.98:0/1640066660 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f84f01445d0 0x7f84f01f6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:39:17.490 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.487+0000 7f84f5dd3640 1 --2- 172.21.15.98:0/1640066660 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84f00ccfd0 0x7f84f009b460 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:39:17.490 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.487+0000 7f84f5dd3640 1 --2- 172.21.15.98:0/1640066660 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f84dc078a00 0x7f84dc07aec0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:39:17.490 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.487+0000 7f84f5dd3640 1 --2- 172.21.15.98:0/1640066660 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84f00b4ca0 0x7f84f009ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:39:17.490 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.487+0000 7f84f5dd3640 1 -- 172.21.15.98:0/1640066660 >> 172.21.15.98:0/1640066660 conn(0x7f84f00b1950 msgr2=0x7f84f006f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:39:17.490 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.487+0000 7f84f5dd3640 1 -- 172.21.15.98:0/1640066660 shutdown_connections 2024-09-16T15:39:17.490 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.487+0000 7f84f5dd3640 1 -- 172.21.15.98:0/1640066660 wait complete. 2024-09-16T15:39:17.500 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":83,"stamp":"2024-09-16T15:39:16.729439+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":220676,"kb_used_data":4456,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754044,"statfs":{"total":773094113280,"available":772868141056,"internally_reserved":0,"allocated":4562944,"data_stored":2477408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002697"},"pg_stats":[{"pgid":"1.0","version":"37'74","reported_seq":147,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T15:38:54.926191+0000","last_change":"2024-09-16T15:38:54.926191+0000","last_active":"2024-09-16T15:38:54.926191+0000","last_peered":"2024-09-16T15:38:54.926191+0000","last_clean":"2024-09-16T15:38:54.926191+0000","last_became_active":"2024-09-16T15:37:37.257584+0000","last_became_peered":"2024-09-16T15:37:37.257584+0000","last_unstale":"2024-09-16T15:38:54.926191+0000","last_undegraded":"2024-09-16T15:38:54.926191+0000","last_fullsized":"2024-09-16T15:38:54.926191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'74","last_scrub_stamp":"2024-09-16T15:38:54.926098+0000","last_deep_scrub":"37'74","last_deep_scrub_stamp":"2024-09-16T15:38:54.926098+0000","last_clean_scrub_stamp":"2024-09-16T15:38:54.926098+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:59:28.958586+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509464,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27440,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":421888,"data_stored":162084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509464,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28016,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343824,"statfs":{"total":96636764160,"available":96608075776,"internally_reserved":0,"allocated":1015808,"data_stored":752452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509465,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27440,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":421888,"data_stored":162084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509465,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27440,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":421888,"data_stored":162084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509464,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27440,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":421888,"data_stored":162084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509465,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28016,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343824,"statfs":{"total":96636764160,"available":96608075776,"internally_reserved":0,"allocated":1015808,"data_stored":752452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509463,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27440,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":421888,"data_stored":162084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27444,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":421888,"data_stored":162084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T15:39:17.502 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-16T15:39:17.606 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.603+0000 7f68f0de2640 1 -- 172.21.15.98:0/1277766229 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f68ec1609c0 msgr2=0x7f68ec0aeac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:39:17.606 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.603+0000 7f68f0de2640 1 --2- 172.21.15.98:0/1277766229 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f68ec1609c0 0x7f68ec0aeac0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f68d4009860 tx=0x7f68d402a530 comp rx=0 tx=0).stop 2024-09-16T15:39:17.606 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.604+0000 7f68f0de2640 1 -- 172.21.15.98:0/1277766229 shutdown_connections 2024-09-16T15:39:17.606 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.604+0000 7f68f0de2640 1 --2- 172.21.15.98:0/1277766229 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f68ec1609c0 0x7f68ec0aeac0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:39:17.606 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.604+0000 7f68f0de2640 1 -- 172.21.15.98:0/1277766229 >> 172.21.15.98:0/1277766229 conn(0x7f68ec09b080 msgr2=0x7f68ec0d1e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:39:17.606 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.604+0000 7f68f0de2640 1 -- 172.21.15.98:0/1277766229 shutdown_connections 2024-09-16T15:39:17.606 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.604+0000 7f68f0de2640 1 -- 172.21.15.98:0/1277766229 wait complete. 2024-09-16T15:39:17.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.605+0000 7f68f0de2640 1 Processor -- start 2024-09-16T15:39:17.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.605+0000 7f68f0de2640 1 -- start start 2024-09-16T15:39:17.609 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.606+0000 7f68f0de2640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f68ec0d09a0 0x7f68ec1f4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:39:17.609 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.606+0000 7f68f0de2640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f68ec1605e0 0x7f68ec0c7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:39:17.609 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.606+0000 7f68f0de2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68ec1609c0 0x7f68ec0c5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:39:17.609 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.606+0000 7f68f0de2640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f68ec0d00d0 con 0x7f68ec1605e0 2024-09-16T15:39:17.609 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.606+0000 7f68f0de2640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f68ec0cff50 con 0x7f68ec1609c0 2024-09-16T15:39:17.609 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.606+0000 7f68f0de2640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f68ec0b0e20 con 0x7f68ec0d09a0 2024-09-16T15:39:17.610 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.606+0000 7f68e1d9b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f68ec1605e0 0x7f68ec0c7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:39:17.610 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.606+0000 7f68e1d9b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f68ec1605e0 0x7f68ec0c7470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37888/0 (socket says 172.21.15.98:37888) 2024-09-16T15:39:17.610 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.606+0000 7f68e1d9b640 1 -- 172.21.15.98:0/1379257813 learned_addr learned my addr 172.21.15.98:0/1379257813 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:39:17.610 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.606+0000 7f68ead9d640 1 --2- 172.21.15.98:0/1379257813 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68ec1609c0 0x7f68ec0c5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:39:17.610 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.606+0000 7f68ea59c640 1 --2- 172.21.15.98:0/1379257813 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f68ec0d09a0 0x7f68ec1f4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:39:17.610 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.606+0000 7f68e1d9b640 1 -- 172.21.15.98:0/1379257813 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f68ec0d09a0 msgr2=0x7f68ec1f4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:39:17.610 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.606+0000 7f68e1d9b640 1 --2- 172.21.15.98:0/1379257813 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f68ec0d09a0 0x7f68ec1f4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:39:17.610 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.606+0000 7f68e1d9b640 1 -- 172.21.15.98:0/1379257813 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68ec1609c0 msgr2=0x7f68ec0c5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:39:17.610 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.606+0000 7f68e1d9b640 1 --2- 172.21.15.98:0/1379257813 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68ec1609c0 0x7f68ec0c5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:39:17.610 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.606+0000 7f68e1d9b640 1 -- 172.21.15.98:0/1379257813 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68ec1f5be0 con 0x7f68ec1605e0 2024-09-16T15:39:17.610 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.606+0000 7f68e1d9b640 1 --2- 172.21.15.98:0/1379257813 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f68ec1605e0 0x7f68ec0c7470 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f68d402ab20 tx=0x7f68d4003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:39:17.610 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.607+0000 7f68e37fe640 1 -- 172.21.15.98:0/1379257813 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68d4005c90 con 0x7f68ec1605e0 2024-09-16T15:39:17.611 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.607+0000 7f68e37fe640 1 -- 172.21.15.98:0/1379257813 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f68d4005020 con 0x7f68ec1605e0 2024-09-16T15:39:17.611 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.607+0000 7f68f0de2640 1 -- 172.21.15.98:0/1379257813 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68ec1f5340 con 0x7f68ec1605e0 2024-09-16T15:39:17.611 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.607+0000 7f68e37fe640 1 -- 172.21.15.98:0/1379257813 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68d4005410 con 0x7f68ec1605e0 2024-09-16T15:39:17.611 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.607+0000 7f68f0de2640 1 -- 172.21.15.98:0/1379257813 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68ec1f5900 con 0x7f68ec1605e0 2024-09-16T15:39:17.612 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.608+0000 7f68f0de2640 1 -- 172.21.15.98:0/1379257813 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68ec0c8ce0 con 0x7f68ec1605e0 2024-09-16T15:39:17.612 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.609+0000 7f68e37fe640 1 -- 172.21.15.98:0/1379257813 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 7) ==== 101440+0+0 (secure 0 0 0) 0x7f68d40317c0 con 0x7f68ec1605e0 2024-09-16T15:39:17.612 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.609+0000 7f68e37fe640 1 --2- 172.21.15.98:0/1379257813 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f68cc078a00 0x7f68cc07aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:39:17.612 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.610+0000 7f68e37fe640 1 -- 172.21.15.98:0/1379257813 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f68d40bb760 con 0x7f68ec1605e0 2024-09-16T15:39:17.612 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.610+0000 7f68ea59c640 1 --2- 172.21.15.98:0/1379257813 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f68cc078a00 0x7f68cc07aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:39:17.612 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.610+0000 7f68ea59c640 1 --2- 172.21.15.98:0/1379257813 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f68cc078a00 0x7f68cc07aec0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f68dc000fb0 tx=0x7f68dc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:39:17.620 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.618+0000 7f68e37fe640 1 -- 172.21.15.98:0/1379257813 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7f68ec0c8ce0 con 0x7f68ec1605e0 2024-09-16T15:39:17.803 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.801+0000 7f68f0de2640 1 -- 172.21.15.98:0/1379257813 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f68ec0afaf0 con 0x7f68ec1605e0 2024-09-16T15:39:17.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.804+0000 7f68e37fe640 1 -- 172.21.15.98:0/1379257813 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v30)=0 v30) ==== 123+0+0 (secure 0 0 0) 0x7f68d403f030 con 0x7f68ec1605e0 2024-09-16T15:39:17.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.805+0000 7f68e37fe640 1 -- 172.21.15.98:0/1379257813 <== mon.0 v2:172.21.15.98:3300/0 8 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7f68d4031400 con 0x7f68ec1605e0 2024-09-16T15:39:17.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.807+0000 7f68f0de2640 1 -- 172.21.15.98:0/1379257813 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f68cc078a00 msgr2=0x7f68cc07aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:39:17.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.807+0000 7f68f0de2640 1 --2- 172.21.15.98:0/1379257813 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f68cc078a00 0x7f68cc07aec0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f68dc000fb0 tx=0x7f68dc009040 comp rx=0 tx=0).stop 2024-09-16T15:39:17.810 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.807+0000 7f68f0de2640 1 -- 172.21.15.98:0/1379257813 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f68ec1605e0 msgr2=0x7f68ec0c7470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:39:17.810 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.807+0000 7f68f0de2640 1 --2- 172.21.15.98:0/1379257813 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f68ec1605e0 0x7f68ec0c7470 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f68d402ab20 tx=0x7f68d4003c10 comp rx=0 tx=0).stop 2024-09-16T15:39:17.810 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.807+0000 7f68f0de2640 1 -- 172.21.15.98:0/1379257813 shutdown_connections 2024-09-16T15:39:17.810 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.807+0000 7f68f0de2640 1 --2- 172.21.15.98:0/1379257813 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f68cc078a00 0x7f68cc07aec0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:39:17.810 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.807+0000 7f68f0de2640 1 --2- 172.21.15.98:0/1379257813 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68ec1609c0 0x7f68ec0c5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:39:17.810 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.807+0000 7f68f0de2640 1 --2- 172.21.15.98:0/1379257813 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f68ec1605e0 0x7f68ec0c7470 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:39:17.810 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.807+0000 7f68f0de2640 1 --2- 172.21.15.98:0/1379257813 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f68ec0d09a0 0x7f68ec1f4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:39:17.810 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.807+0000 7f68f0de2640 1 -- 172.21.15.98:0/1379257813 >> 172.21.15.98:0/1379257813 conn(0x7f68ec09b080 msgr2=0x7f68ec06ece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:39:17.810 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.807+0000 7f68f0de2640 1 -- 172.21.15.98:0/1379257813 shutdown_connections 2024-09-16T15:39:17.810 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.807+0000 7f68f0de2640 1 -- 172.21.15.98:0/1379257813 wait complete. 2024-09-16T15:39:17.820 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-16T15:39:17.821 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T15:39:17.924 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.922+0000 7f4357152640 1 -- 172.21.15.98:0/3739484502 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f43500d1440 msgr2=0x7f435015e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:39:17.925 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.922+0000 7f4357152640 1 --2- 172.21.15.98:0/3739484502 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f43500d1440 0x7f435015e4b0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f435008e550 tx=0x7f434802aa30 comp rx=0 tx=0).stop 2024-09-16T15:39:17.925 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.922+0000 7f4357152640 1 -- 172.21.15.98:0/3739484502 shutdown_connections 2024-09-16T15:39:17.925 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.922+0000 7f4357152640 1 --2- 172.21.15.98:0/3739484502 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f43500d1440 0x7f435015e4b0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:39:17.925 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.922+0000 7f4357152640 1 --2- 172.21.15.98:0/3739484502 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f43500d2050 0x7f43500d0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:39:17.925 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.922+0000 7f4357152640 1 --2- 172.21.15.98:0/3739484502 >> v2:172.21.15.135:3300/0 conn(0x7f435015e0d0 0x7f43500d09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:39:17.925 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.922+0000 7f4357152640 1 -- 172.21.15.98:0/3739484502 >> 172.21.15.98:0/3739484502 conn(0x7f43500d3fe0 msgr2=0x7f43500d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:39:17.925 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.922+0000 7f4357152640 1 -- 172.21.15.98:0/3739484502 shutdown_connections 2024-09-16T15:39:17.925 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.922+0000 7f4357152640 1 -- 172.21.15.98:0/3739484502 wait complete. 2024-09-16T15:39:17.926 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.924+0000 7f4357152640 1 Processor -- start 2024-09-16T15:39:17.926 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.924+0000 7f4357152640 1 -- start start 2024-09-16T15:39:17.929 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.926+0000 7f4357152640 1 --2- >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f43500d1440 0x7f43500a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:39:17.929 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.926+0000 7f4357152640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f43500d2050 0x7f43500c9e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:39:17.929 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.926+0000 7f4357152640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f435015e0d0 0x7f435015d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:39:17.929 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.926+0000 7f4357152640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f435015ed80 con 0x7f43500d2050 2024-09-16T15:39:17.929 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.926+0000 7f4357152640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f435015ec00 con 0x7f435015e0d0 2024-09-16T15:39:17.929 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.926+0000 7f4357152640 1 -- --> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] -- mon_getmap magic: 0 -- 0x7f435015ef00 con 0x7f43500d1440 2024-09-16T15:39:17.929 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.926+0000 7f4347fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f43500d2050 0x7f43500c9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:39:17.929 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.926+0000 7f4347fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f43500d2050 0x7f43500c9e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37902/0 (socket says 172.21.15.98:37902) 2024-09-16T15:39:17.930 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.926+0000 7f4347fff640 1 -- 172.21.15.98:0/904069479 learned_addr learned my addr 172.21.15.98:0/904069479 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-16T15:39:17.930 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.926+0000 7f4354eee640 1 --2- 172.21.15.98:0/904069479 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f43500d1440 0x7f43500a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:39:17.930 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.926+0000 7f43556ef640 1 --2- 172.21.15.98:0/904069479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f435015e0d0 0x7f435015d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:39:17.930 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.926+0000 7f4347fff640 1 -- 172.21.15.98:0/904069479 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f43500d1440 msgr2=0x7f43500a1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:39:17.930 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.926+0000 7f4347fff640 1 --2- 172.21.15.98:0/904069479 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f43500d1440 0x7f43500a1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:39:17.930 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.926+0000 7f4347fff640 1 -- 172.21.15.98:0/904069479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f435015e0d0 msgr2=0x7f435015d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:39:17.930 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.926+0000 7f4347fff640 1 --2- 172.21.15.98:0/904069479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f435015e0d0 0x7f435015d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:39:17.930 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.926+0000 7f4347fff640 1 -- 172.21.15.98:0/904069479 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43501f8290 con 0x7f43500d2050 2024-09-16T15:39:17.930 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.926+0000 7f4347fff640 1 --2- 172.21.15.98:0/904069479 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f43500d2050 0x7f43500c9e40 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f434000d720 tx=0x7f434000dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:39:17.930 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.926+0000 7f43457fa640 1 -- 172.21.15.98:0/904069479 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4340017070 con 0x7f43500d2050 2024-09-16T15:39:17.930 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.926+0000 7f43457fa640 1 -- 172.21.15.98:0/904069479 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7f4340009d40 con 0x7f43500d2050 2024-09-16T15:39:17.930 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.926+0000 7f43457fa640 1 -- 172.21.15.98:0/904069479 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43400106c0 con 0x7f43500d2050 2024-09-16T15:39:17.930 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.926+0000 7f4357152640 1 -- 172.21.15.98:0/904069479 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43501f8530 con 0x7f43500d2050 2024-09-16T15:39:17.930 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.928+0000 7f4357152640 1 -- 172.21.15.98:0/904069479 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43501f8af0 con 0x7f43500d2050 2024-09-16T15:39:17.931 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.928+0000 7f4357152640 1 -- 172.21.15.98:0/904069479 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f435015e4b0 con 0x7f43500d2050 2024-09-16T15:39:17.931 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.928+0000 7f43457fa640 1 -- 172.21.15.98:0/904069479 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 7) ==== 101440+0+0 (secure 0 0 0) 0x7f434001a070 con 0x7f43500d2050 2024-09-16T15:39:17.931 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.929+0000 7f43457fa640 1 --2- 172.21.15.98:0/904069479 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f433c078a00 0x7f433c07aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T15:39:17.932 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.929+0000 7f43457fa640 1 -- 172.21.15.98:0/904069479 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f434009aaa0 con 0x7f43500d2050 2024-09-16T15:39:17.932 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.929+0000 7f4354eee640 1 --2- 172.21.15.98:0/904069479 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f433c078a00 0x7f433c07aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T15:39:17.932 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.930+0000 7f4354eee640 1 --2- 172.21.15.98:0/904069479 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f433c078a00 0x7f433c07aec0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f434c00bb50 tx=0x7f434c00b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T15:39:17.935 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:17.934+0000 7f43457fa640 1 -- 172.21.15.98:0/904069479 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196735 (secure 0 0 0) 0x7f4340062af0 con 0x7f43500d2050 2024-09-16T15:39:18.156 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:18.154+0000 7f4357152640 1 -- 172.21.15.98:0/904069479 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f43500cbaf0 con 0x7f43500d2050 2024-09-16T15:39:18.156 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:18.154+0000 7f43457fa640 1 -- 172.21.15.98:0/904069479 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+3917 (secure 0 0 0) 0x7f4340067520 con 0x7f43500d2050 2024-09-16T15:39:18.157 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-16T15:39:18.157 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":18,"btime":"2024-09-16T15:38:45:071661+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4804,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/1917138590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":1917138590},{"type":"v1","addr":"172.21.15.135:6836","nonce":1917138590}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4807,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2813663234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":2813663234},{"type":"v1","addr":"172.21.15.135:6837","nonce":2813663234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4848,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6834/2449820374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":2449820374},{"type":"v1","addr":"172.21.15.98:6834","nonce":2449820374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":5223,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/4101112182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6833","nonce":4101112182},{"type":"v1","addr":"172.21.15.98:6835","nonce":4101112182}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18}],"filesystems":[]} 2024-09-16T15:39:18.157 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 18 2024-09-16T15:39:18.159 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:18.157+0000 7f4357152640 1 -- 172.21.15.98:0/904069479 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f433c078a00 msgr2=0x7f433c07aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:39:18.159 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:18.157+0000 7f4357152640 1 --2- 172.21.15.98:0/904069479 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f433c078a00 0x7f433c07aec0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f434c00bb50 tx=0x7f434c00b2e0 comp rx=0 tx=0).stop 2024-09-16T15:39:18.159 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:18.157+0000 7f4357152640 1 -- 172.21.15.98:0/904069479 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f43500d2050 msgr2=0x7f43500c9e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T15:39:18.159 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:18.157+0000 7f4357152640 1 --2- 172.21.15.98:0/904069479 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f43500d2050 0x7f43500c9e40 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f434000d720 tx=0x7f434000dbe0 comp rx=0 tx=0).stop 2024-09-16T15:39:18.159 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:18.157+0000 7f4357152640 1 -- 172.21.15.98:0/904069479 shutdown_connections 2024-09-16T15:39:18.159 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:18.157+0000 7f4357152640 1 --2- 172.21.15.98:0/904069479 >> [v2:172.21.15.135:6800/699234772,v1:172.21.15.135:6801/699234772] conn(0x7f433c078a00 0x7f433c07aec0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:39:18.159 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:18.157+0000 7f4357152640 1 --2- 172.21.15.98:0/904069479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f435015e0d0 0x7f435015d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:39:18.159 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:18.157+0000 7f4357152640 1 --2- 172.21.15.98:0/904069479 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f43500d2050 0x7f43500c9e40 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:39:18.160 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:18.157+0000 7f4357152640 1 --2- 172.21.15.98:0/904069479 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7f43500d1440 0x7f43500a1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T15:39:18.160 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:18.157+0000 7f4357152640 1 -- 172.21.15.98:0/904069479 >> 172.21.15.98:0/904069479 conn(0x7f43500d3fe0 msgr2=0x7f43500cfb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T15:39:18.160 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:18.157+0000 7f4357152640 1 -- 172.21.15.98:0/904069479 shutdown_connections 2024-09-16T15:39:18.160 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-16T15:39:18.157+0000 7f4357152640 1 -- 172.21.15.98:0/904069479 wait complete. 2024-09-16T15:39:18.170 DEBUG:tasks.cephfs.filesystem:already dead... 2024-09-16T15:39:18.170 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-16T15:39:18.170 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-16T15:39:18.171 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T15:39:18.181 INFO:tasks.ceph.mds.a:Stopped 2024-09-16T15:39:18.181 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-16T15:39:18.181 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T15:39:18.231 INFO:tasks.ceph.mds.c:Stopped 2024-09-16T15:39:18.232 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-16T15:39:18.232 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T15:39:18.241 INFO:tasks.ceph.mds.b:Stopped 2024-09-16T15:39:18.242 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-16T15:39:18.242 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T15:39:18.292 INFO:tasks.ceph.mds.d:Stopped 2024-09-16T15:39:18.292 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-16T15:39:18.292 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-16T15:39:18.292 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T15:39:18.327 INFO:tasks.ceph.osd.0:Stopped 2024-09-16T15:39:18.327 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-16T15:39:18.327 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T15:39:18.410 INFO:tasks.ceph.osd.1:Stopped 2024-09-16T15:39:18.410 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-16T15:39:18.410 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T15:39:18.453 INFO:tasks.ceph.osd.2:Stopped 2024-09-16T15:39:18.453 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-16T15:39:18.453 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T15:39:18.485 INFO:tasks.ceph.osd.3:Stopped 2024-09-16T15:39:18.485 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-16T15:39:18.485 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T15:39:18.520 INFO:tasks.ceph.osd.4:Stopped 2024-09-16T15:39:18.521 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-16T15:39:18.521 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T15:39:18.597 INFO:tasks.ceph.osd.5:Stopped 2024-09-16T15:39:18.597 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-16T15:39:18.597 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T15:39:18.669 INFO:tasks.ceph.osd.6:Stopped 2024-09-16T15:39:18.670 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-16T15:39:18.670 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T15:39:18.739 INFO:tasks.ceph.osd.7:Stopped 2024-09-16T15:39:18.740 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-16T15:39:18.740 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-16T15:39:18.740 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T15:39:18.766 INFO:tasks.ceph.mgr.y:Stopped 2024-09-16T15:39:18.766 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-16T15:39:18.767 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T15:39:18.808 INFO:tasks.ceph.mgr.x:Stopped 2024-09-16T15:39:18.808 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-16T15:39:18.808 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-16T15:39:18.808 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T15:39:18.819 INFO:tasks.ceph.mon.a:Stopped 2024-09-16T15:39:18.820 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-16T15:39:18.820 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T15:39:18.859 INFO:tasks.ceph.mon.b:Stopped 2024-09-16T15:39:18.860 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-16T15:39:18.860 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T15:39:18.911 INFO:tasks.ceph.mon.c:Stopped 2024-09-16T15:39:18.911 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-16T15:39:18.911 DEBUG:teuthology.orchestra.run.smithi098:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | head -n 1 2024-09-16T15:39:18.954 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi098.front.sepia.ceph.com 2024-09-16T15:39:18.955 DEBUG:teuthology.orchestra.run.smithi098:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-16T15:39:19.145 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi098.front.sepia.ceph.com 2024-09-16T15:39:19.145 DEBUG:teuthology.orchestra.run.smithi098:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-16T15:39:19.231 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi098.front.sepia.ceph.com 2024-09-16T15:39:19.231 DEBUG:teuthology.orchestra.run.smithi098:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-16T15:39:19.297 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi098.front.sepia.ceph.com 2024-09-16T15:39:19.298 DEBUG:teuthology.orchestra.run.smithi098:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-16T15:39:19.379 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi135.front.sepia.ceph.com 2024-09-16T15:39:19.380 DEBUG:teuthology.orchestra.run.smithi135:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-16T15:39:19.518 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi135.front.sepia.ceph.com 2024-09-16T15:39:19.519 DEBUG:teuthology.orchestra.run.smithi135:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-16T15:39:19.591 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi135.front.sepia.ceph.com 2024-09-16T15:39:19.591 DEBUG:teuthology.orchestra.run.smithi135:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-16T15:39:19.667 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi135.front.sepia.ceph.com 2024-09-16T15:39:19.667 DEBUG:teuthology.orchestra.run.smithi135:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-16T15:39:19.718 INFO:tasks.ceph:Archiving mon data... 2024-09-16T15:39:19.719 DEBUG:teuthology.misc:Transferring archived files from smithi098:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/avan-2024-09-16_15:21:40-fs:volumes-wip-athakkar-testing-2024-09-16-1454-distro-default-smithi/7907356/data/mon.a.tgz 2024-09-16T15:39:19.719 DEBUG:teuthology.orchestra.run.smithi098:> mktemp 2024-09-16T15:39:19.735 INFO:teuthology.orchestra.run.smithi098.stdout:/tmp/tmp.IBs2avqSAG 2024-09-16T15:39:19.735 DEBUG:teuthology.orchestra.run.smithi098:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.IBs2avqSAG 2024-09-16T15:39:19.880 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 0666 /tmp/tmp.IBs2avqSAG 2024-09-16T15:39:19.963 DEBUG:teuthology.orchestra.remote:smithi098:/tmp/tmp.IBs2avqSAG is 367KB 2024-09-16T15:39:20.059 DEBUG:teuthology.orchestra.run.smithi098:> rm -fr /tmp/tmp.IBs2avqSAG 2024-09-16T15:39:20.074 DEBUG:teuthology.misc:Transferring archived files from smithi135:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/avan-2024-09-16_15:21:40-fs:volumes-wip-athakkar-testing-2024-09-16-1454-distro-default-smithi/7907356/data/mon.b.tgz 2024-09-16T15:39:20.074 DEBUG:teuthology.orchestra.run.smithi135:> mktemp 2024-09-16T15:39:20.091 INFO:teuthology.orchestra.run.smithi135.stdout:/tmp/tmp.tv20SE8sVM 2024-09-16T15:39:20.091 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.tv20SE8sVM 2024-09-16T15:39:20.254 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 0666 /tmp/tmp.tv20SE8sVM 2024-09-16T15:39:20.409 DEBUG:teuthology.orchestra.remote:smithi135:/tmp/tmp.tv20SE8sVM is 504KB 2024-09-16T15:39:20.506 DEBUG:teuthology.orchestra.run.smithi135:> rm -fr /tmp/tmp.tv20SE8sVM 2024-09-16T15:39:20.521 DEBUG:teuthology.misc:Transferring archived files from smithi135:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/avan-2024-09-16_15:21:40-fs:volumes-wip-athakkar-testing-2024-09-16-1454-distro-default-smithi/7907356/data/mon.c.tgz 2024-09-16T15:39:20.521 DEBUG:teuthology.orchestra.run.smithi135:> mktemp 2024-09-16T15:39:20.575 INFO:teuthology.orchestra.run.smithi135.stdout:/tmp/tmp.qGfDUBmq8E 2024-09-16T15:39:20.576 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.qGfDUBmq8E 2024-09-16T15:39:20.726 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 0666 /tmp/tmp.qGfDUBmq8E 2024-09-16T15:39:20.808 DEBUG:teuthology.orchestra.remote:smithi135:/tmp/tmp.qGfDUBmq8E is 504KB 2024-09-16T15:39:20.878 DEBUG:teuthology.orchestra.run.smithi135:> rm -fr /tmp/tmp.qGfDUBmq8E 2024-09-16T15:39:20.893 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-16T15:39:20.893 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-16T15:39:20.896 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-16T15:39:20.979 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-16T15:39:21.013 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-16T15:39:21.013 INFO:tasks.ceph:Archiving crash dumps... 2024-09-16T15:39:21.015 DEBUG:teuthology.misc:Transferring archived files from smithi098:/var/lib/ceph/crash to /home/teuthworker/archive/avan-2024-09-16_15:21:40-fs:volumes-wip-athakkar-testing-2024-09-16-1454-distro-default-smithi/7907356/remote/smithi098/crash 2024-09-16T15:39:21.016 DEBUG:teuthology.orchestra.run.smithi098:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-16T15:39:21.046 DEBUG:teuthology.misc:Transferring archived files from smithi135:/var/lib/ceph/crash to /home/teuthworker/archive/avan-2024-09-16_15:21:40-fs:volumes-wip-athakkar-testing-2024-09-16-1454-distro-default-smithi/7907356/remote/smithi135/crash 2024-09-16T15:39:21.047 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-16T15:39:21.077 INFO:tasks.ceph:Shutting down logrotate 2024-09-16T15:39:21.077 DEBUG:teuthology.orchestra.run.smithi098:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T15:39:21.091 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T15:39:21.180 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-16T15:39:21.206 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-16T15:39:21.230 INFO:tasks.ceph:Compressing logs... 2024-09-16T15:39:21.231 DEBUG:teuthology.orchestra.run.smithi098:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-16T15:39:21.249 DEBUG:teuthology.orchestra.run.smithi135:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-16T15:39:21.272 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-16T15:39:21.272 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50099.log 2024-09-16T15:39:21.272 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.30139.log 2024-09-16T15:39:21.310 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36380.log 2024-09-16T15:39:21.310 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-16T15:39:21.310 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.36380.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-09-16T15:39:21.310 INFO:teuthology.orchestra.run.smithi135.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.36380.log.gz 2024-09-16T15:39:21.310 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36340.log 2024-09-16T15:39:21.310 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42225.log 2024-09-16T15:39:21.310 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.36340.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-16T15:39:21.310 INFO:teuthology.orchestra.run.smithi135.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.36340.log.gz 2024-09-16T15:39:21.311 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.1.42225.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-16T15:39:21.311 INFO:teuthology.orchestra.run.smithi135.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42225.log.gz 2024-09-16T15:39:21.311 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36540.log 2024-09-16T15:39:21.311 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-osd.4.log: 91.9% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-09-16T15:39:21.311 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36580.log/var/log/ceph/ceph.audit.log: 2024-09-16T15:39:21.311 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.36540.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-16T15:39:21.311 INFO:teuthology.orchestra.run.smithi135.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.36540.log.gz 2024-09-16T15:39:21.311 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.36580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42230.log 2024-09-16T15:39:21.311 INFO:teuthology.orchestra.run.smithi135.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.36580.log.gz 2024-09-16T15:39:21.311 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36500.log 2024-09-16T15:39:21.311 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-mon.c.log: /var/log/ceph/ceph-client.1.42230.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42230.log.gz 2024-09-16T15:39:21.311 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.43193.log 2024-09-16T15:39:21.311 INFO:teuthology.orchestra.run.smithi135.stderr: 93.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-16T15:39:21.311 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log/var/log/ceph/ceph-client.admin.36500.log: 2024-09-16T15:39:21.312 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.1.43193.log: gzip -5 --verbose 86.6% -- /var/log/ceph/ceph-osd.5.log -- replaced with /var/log/ceph/ceph-client.admin.36500.log.gz 2024-09-16T15:39:21.312 INFO:teuthology.orchestra.run.smithi135.stderr: 2024-09-16T15:39:21.312 INFO:teuthology.orchestra.run.smithi135.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.43193.log.gz 2024-09-16T15:39:21.312 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-16T15:39:21.312 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36420.log 2024-09-16T15:39:21.312 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-09-16T15:39:21.312 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.36420.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-16T15:39:21.312 INFO:teuthology.orchestra.run.smithi135.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.36420.log.gz 2024-09-16T15:39:21.312 INFO:teuthology.orchestra.run.smithi135.stderr: 90.9% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-16T15:39:21.312 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-mds.d.log: 92.1% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-09-16T15:39:21.312 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36460.log 2024-09-16T15:39:21.312 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-16T15:39:21.312 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.36460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.42626.log 2024-09-16T15:39:21.313 INFO:teuthology.orchestra.run.smithi135.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.36460.log.gz 2024-09-16T15:39:21.313 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36298.log 2024-09-16T15:39:21.313 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.3.42626.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.42626.log.gz 2024-09-16T15:39:21.316 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.43197.log 2024-09-16T15:39:21.316 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.36298.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.36298.log.gz 2024-09-16T15:39:21.316 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.42630.log 2024-09-16T15:39:21.316 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.1.43197.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.43197.log.gz 2024-09-16T15:39:21.316 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.3.42630.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.42630.log.gz 2024-09-16T15:39:21.351 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.50099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44106.log 2024-09-16T15:39:21.351 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45408.log 2024-09-16T15:39:21.351 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph.tmp-client.admin.30139.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50099.log.gz 2024-09-16T15:39:21.351 INFO:teuthology.orchestra.run.smithi098.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.30139.log.gz 2024-09-16T15:39:21.351 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.44106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49286.log 2024-09-16T15:39:21.351 INFO:teuthology.orchestra.run.smithi098.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44106.log.gz 2024-09-16T15:39:21.351 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.45408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47438.log 2024-09-16T15:39:21.352 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.49286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49855.log 2024-09-16T15:39:21.352 INFO:teuthology.orchestra.run.smithi098.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.49286.log.gz 2024-09-16T15:39:21.352 INFO:teuthology.orchestra.run.smithi098.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.45408.log.gz 2024-09-16T15:39:21.352 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.47438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44064.log 2024-09-16T15:39:21.352 INFO:teuthology.orchestra.run.smithi098.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47438.log.gz 2024-09-16T15:39:21.352 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47625.log 2024-09-16T15:39:21.352 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.49855.log: /var/log/ceph/ceph-client.admin.44064.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49855.log.gz 2024-09-16T15:39:21.352 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43686.log 2024-09-16T15:39:21.352 INFO:teuthology.orchestra.run.smithi098.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44064.log.gz 2024-09-16T15:39:21.352 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.47625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48782.log 2024-09-16T15:39:21.352 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.43686.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47625.log.gz 2024-09-16T15:39:21.352 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48446.log 2024-09-16T15:39:21.352 INFO:teuthology.orchestra.run.smithi098.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43686.log.gz 2024-09-16T15:39:21.352 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.48782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43359.log 2024-09-16T15:39:21.353 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.48446.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48782.log.gz 2024-09-16T15:39:21.353 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47228.log 2024-09-16T15:39:21.353 INFO:teuthology.orchestra.run.smithi098.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48446.log.gz 2024-09-16T15:39:21.353 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.43359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43854.log 2024-09-16T15:39:21.353 INFO:teuthology.orchestra.run.smithi098.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43359.log.gz 2024-09-16T15:39:21.353 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.47228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50141.log 2024-09-16T15:39:21.353 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.43854.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.47228.log.gz 2024-09-16T15:39:21.353 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48824.log 2024-09-16T15:39:21.353 INFO:teuthology.orchestra.run.smithi098.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43854.log.gz 2024-09-16T15:39:21.353 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.50141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49496.log 2024-09-16T15:39:21.353 INFO:teuthology.orchestra.run.smithi098.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50141.log.gz 2024-09-16T15:39:21.353 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.48824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44622.log 2024-09-16T15:39:21.353 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.49496.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48824.log.gz 2024-09-16T15:39:21.353 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50496.log 2024-09-16T15:39:21.353 INFO:teuthology.orchestra.run.smithi098.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.49496.log.gz 2024-09-16T15:39:21.354 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.44622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43556.log 2024-09-16T15:39:21.354 INFO:teuthology.orchestra.run.smithi098.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44622.log.gz 2024-09-16T15:39:21.354 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.50496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51317.log 2024-09-16T15:39:21.354 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.43556.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50496.log.gz 2024-09-16T15:39:21.354 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45240.log 2024-09-16T15:39:21.354 INFO:teuthology.orchestra.run.smithi098.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43556.log.gz 2024-09-16T15:39:21.354 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.51317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48051.log 2024-09-16T15:39:21.354 INFO:teuthology.orchestra.run.smithi098.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.51317.log.gz 2024-09-16T15:39:21.354 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.45240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47798.log 2024-09-16T15:39:21.354 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.48051.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45240.log.gz 2024-09-16T15:39:21.354 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46923.log 2024-09-16T15:39:21.354 INFO:teuthology.orchestra.run.smithi098.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.48051.log.gz 2024-09-16T15:39:21.354 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.47798.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-16T15:39:21.354 INFO:teuthology.orchestra.run.smithi098.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47798.log.gz 2024-09-16T15:39:21.354 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.46923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44285.log 2024-09-16T15:39:21.355 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-osd.1.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46923.log.gz 2024-09-16T15:39:21.355 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49538.log 2024-09-16T15:39:21.355 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.44285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46686.log 2024-09-16T15:39:21.355 INFO:teuthology.orchestra.run.smithi098.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44285.log.gz 2024-09-16T15:39:21.355 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.49538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49580.log 2024-09-16T15:39:21.355 INFO:teuthology.orchestra.run.smithi098.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.49538.log.gz 2024-09-16T15:39:21.355 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.46686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49777.log 2024-09-16T15:39:21.355 INFO:teuthology.orchestra.run.smithi098.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.46686.log.gz 2024-09-16T15:39:21.355 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46560.log 2024-09-16T15:39:21.355 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.49580.log: /var/log/ceph/ceph-client.admin.49777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48698.log 2024-09-16T15:39:21.355 INFO:teuthology.orchestra.run.smithi098.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.49580.log.gz 2024-09-16T15:39:21.355 INFO:teuthology.orchestra.run.smithi098.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49777.log.gz 2024-09-16T15:39:21.355 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.46560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44839.log 2024-09-16T15:39:21.355 INFO:teuthology.orchestra.run.smithi098.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46560.log.gz 2024-09-16T15:39:21.355 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.48698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43938.log 2024-09-16T15:39:21.356 INFO:teuthology.orchestra.run.smithi098.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.48698.log.gz 2024-09-16T15:39:21.356 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.44839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44620.log 2024-09-16T15:39:21.356 INFO:teuthology.orchestra.run.smithi098.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44839.log.gz 2024-09-16T15:39:21.356 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43315.log 2024-09-16T15:39:21.356 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.43938.log: /var/log/ceph/ceph-client.admin.44620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46728.log 2024-09-16T15:39:21.356 INFO:teuthology.orchestra.run.smithi098.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.43938.log.gz 2024-09-16T15:39:21.356 INFO:teuthology.orchestra.run.smithi098.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44620.log.gz 2024-09-16T15:39:21.356 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.43315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45198.log 2024-09-16T15:39:21.356 INFO:teuthology.orchestra.run.smithi098.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43315.log.gz 2024-09-16T15:39:21.356 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.46728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44619.log 2024-09-16T15:39:21.356 INFO:teuthology.orchestra.run.smithi098.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.46728.log.gz 2024-09-16T15:39:21.356 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44280.log 2024-09-16T15:39:21.356 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.45198.log: /var/log/ceph/ceph-client.admin.44619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46812.log 2024-09-16T15:39:21.356 INFO:teuthology.orchestra.run.smithi098.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.45198.log.gz 2024-09-16T15:39:21.357 INFO:teuthology.orchestra.run.smithi098.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44619.log.gz 2024-09-16T15:39:21.357 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.44280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48404.log 2024-09-16T15:39:21.357 INFO:teuthology.orchestra.run.smithi098.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.44280.log.gz 2024-09-16T15:39:21.357 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49202.log 2024-09-16T15:39:21.357 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.46812.log: /var/log/ceph/ceph-client.admin.48404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49244.log 2024-09-16T15:39:21.357 INFO:teuthology.orchestra.run.smithi098.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46812.log.gz 2024-09-16T15:39:21.357 INFO:teuthology.orchestra.run.smithi098.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48404.log.gz 2024-09-16T15:39:21.357 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.49202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36505.log 2024-09-16T15:39:21.357 INFO:teuthology.orchestra.run.smithi098.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49202.log.gz 2024-09-16T15:39:21.357 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47540.log 2024-09-16T15:39:21.357 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.49244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46770.log 2024-09-16T15:39:21.357 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.36505.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.49244.log.gz 2024-09-16T15:39:21.357 INFO:teuthology.orchestra.run.smithi098.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.36505.log.gz 2024-09-16T15:39:21.357 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.47540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49328.log 2024-09-16T15:39:21.357 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- 87.3% /var/log/ceph/ceph-client.admin.44840.log 2024-09-16T15:39:21.358 INFO:teuthology.orchestra.run.smithi098.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47540.log.gz 2024-09-16T15:39:21.358 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.46770.log: /var/log/ceph/ceph-client.admin.49328.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46770.log.gz 2024-09-16T15:39:21.358 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.46339.log 2024-09-16T15:39:21.358 INFO:teuthology.orchestra.run.smithi098.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49328.log.gz 2024-09-16T15:39:21.358 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51670.log 2024-09-16T15:39:21.358 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.44840.log: /var/log/ceph/ceph-client.2.46339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43896.log 2024-09-16T15:39:21.358 INFO:teuthology.orchestra.run.smithi098.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.46339.log.gz 2024-09-16T15:39:21.358 INFO:teuthology.orchestra.run.smithi098.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44840.log.gz 2024-09-16T15:39:21.358 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.51670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43231.log 2024-09-16T15:39:21.358 INFO:teuthology.orchestra.run.smithi098.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51670.log.gz 2024-09-16T15:39:21.358 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.43896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44022.log 2024-09-16T15:39:21.358 INFO:teuthology.orchestra.run.smithi098.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.43896.log.gz 2024-09-16T15:39:21.358 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37249.log 2024-09-16T15:39:21.358 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.43231.log: /var/log/ceph/ceph-client.admin.44022.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43231.log.gz 2024-09-16T15:39:21.359 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50897.log 2024-09-16T15:39:21.359 INFO:teuthology.orchestra.run.smithi098.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44022.log.gz 2024-09-16T15:39:21.359 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45546.log 2024-09-16T15:39:21.359 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.37249.log: /var/log/ceph/ceph-client.admin.50897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51065.log 2024-09-16T15:39:21.359 INFO:teuthology.orchestra.run.smithi098.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.37249.log.gz 2024-09-16T15:39:21.359 INFO:teuthology.orchestra.run.smithi098.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.50897.log.gz 2024-09-16T15:39:21.359 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.45546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47396.log 2024-09-16T15:39:21.359 INFO:teuthology.orchestra.run.smithi098.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45546.log.gz 2024-09-16T15:39:21.359 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.51065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50328.log 2024-09-16T15:39:21.359 INFO:teuthology.orchestra.run.smithi098.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.51065.log.gz 2024-09-16T15:39:21.359 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51712.log 2024-09-16T15:39:21.359 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.47396.log: /var/log/ceph/ceph-client.admin.50328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50813.log 2024-09-16T15:39:21.360 INFO:teuthology.orchestra.run.smithi098.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47396.log.gz 2024-09-16T15:39:21.360 INFO:teuthology.orchestra.run.smithi098.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.50328.log.gz 2024-09-16T15:39:21.360 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.51712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36464.log 2024-09-16T15:39:21.360 INFO:teuthology.orchestra.run.smithi098.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51712.log.gz 2024-09-16T15:39:21.360 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49120.log 2024-09-16T15:39:21.360 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.50813.log: /var/log/ceph/ceph-client.admin.36464.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50813.log.gz 2024-09-16T15:39:21.360 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49124.log 2024-09-16T15:39:21.360 INFO:teuthology.orchestra.run.smithi098.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.36464.log.gz 2024-09-16T15:39:21.360 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.46343.log 2024-09-16T15:39:21.360 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.0.49120.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.49120.log.gz 2024-09-16T15:39:21.360 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.0.49124.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.49124.log.gz 2024-09-16T15:39:21.360 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43514.log 2024-09-16T15:39:21.361 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45901.log 2024-09-16T15:39:21.361 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.2.46343.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.46343.log.gz 2024-09-16T15:39:21.361 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.43514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50370.log 2024-09-16T15:39:21.361 INFO:teuthology.orchestra.run.smithi098.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43514.log.gz 2024-09-16T15:39:21.361 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.0.45901.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.45901.log.gz 2024-09-16T15:39:21.361 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51443.log 2024-09-16T15:39:21.361 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.50370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44939.log 2024-09-16T15:39:21.361 INFO:teuthology.orchestra.run.smithi098.stderr: 87.6%/var/log/ceph/ceph-client.admin.51443.log: -- replaced with /var/log/ceph/ceph-client.admin.50370.log.gz 2024-09-16T15:39:21.361 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50183.log 2024-09-16T15:39:21.361 INFO:teuthology.orchestra.run.smithi098.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51443.log.gz 2024-09-16T15:39:21.361 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.44939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51149.log 2024-09-16T15:39:21.361 INFO:teuthology.orchestra.run.smithi098.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44939.log.gz 2024-09-16T15:39:21.361 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.50183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47168.log 2024-09-16T15:39:21.362 INFO:teuthology.orchestra.run.smithi098.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.50183.log.gz 2024-09-16T15:39:21.362 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.51149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44938.log 2024-09-16T15:39:21.362 INFO:teuthology.orchestra.run.smithi098.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51149.log.gz 2024-09-16T15:39:21.362 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.47168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36656.log 2024-09-16T15:39:21.362 INFO:teuthology.orchestra.run.smithi098.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47168.log.gz 2024-09-16T15:39:21.362 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.44938.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-16T15:39:21.362 INFO:teuthology.orchestra.run.smithi098.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44938.log.gz 2024-09-16T15:39:21.362 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.36656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50771.log 2024-09-16T15:39:21.362 INFO:teuthology.orchestra.run.smithi098.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.36656.log.gz 2024-09-16T15:39:21.362 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51233.log 2024-09-16T15:39:21.362 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.50771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49955.log 2024-09-16T15:39:21.362 INFO:teuthology.orchestra.run.smithi098.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.50771.log.gz 2024-09-16T15:39:21.362 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.51233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47001.log 2024-09-16T15:39:21.362 INFO:teuthology.orchestra.run.smithi098.stderr: 89.0% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-16T15:39:21.363 INFO:teuthology.orchestra.run.smithi098.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.51233.log.gz 2024-09-16T15:39:21.363 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.49955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45366.log 2024-09-16T15:39:21.363 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.47001.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.49955.log.gz 2024-09-16T15:39:21.363 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43053.log 2024-09-16T15:39:21.363 INFO:teuthology.orchestra.run.smithi098.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.47001.log.gz 2024-09-16T15:39:21.363 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.45366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49664.log 2024-09-16T15:39:21.363 INFO:teuthology.orchestra.run.smithi098.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45366.log.gz 2024-09-16T15:39:21.363 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45156.log 2024-09-16T15:39:21.363 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.43053.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43053.log.gz 2024-09-16T15:39:21.363 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.49664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50235.log 2024-09-16T15:39:21.363 INFO:teuthology.orchestra.run.smithi098.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.49664.log.gz 2024-09-16T15:39:21.363 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48656.log 2024-09-16T15:39:21.363 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.45156.log: /var/log/ceph/ceph-client.admin.50235.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.45156.log.gz 2024-09-16T15:39:21.364 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51191.log 2024-09-16T15:39:21.364 INFO:teuthology.orchestra.run.smithi098.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50235.log.gz 2024-09-16T15:39:21.364 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.48656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43980.log 2024-09-16T15:39:21.364 INFO:teuthology.orchestra.run.smithi098.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48656.log.gz 2024-09-16T15:39:21.364 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.51191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36351.log 2024-09-16T15:39:21.364 INFO:teuthology.orchestra.run.smithi098.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51191.log.gz 2024-09-16T15:39:21.364 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47925.log 2024-09-16T15:39:21.364 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.43980.log: /var/log/ceph/ceph-client.admin.36351.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43980.log.gz 2024-09-16T15:39:21.364 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47270.log 2024-09-16T15:39:21.364 INFO:teuthology.orchestra.run.smithi098.stderr: 78.9% -- replaced with /var/log/ceph/ceph-client.admin.36351.log.gz 2024-09-16T15:39:21.364 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47967.log 2024-09-16T15:39:21.364 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.47925.log: /var/log/ceph/ceph-client.admin.47270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44287.log 2024-09-16T15:39:21.364 INFO:teuthology.orchestra.run.smithi098.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47925.log.gz 2024-09-16T15:39:21.364 INFO:teuthology.orchestra.run.smithi098.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47270.log.gz 2024-09-16T15:39:21.365 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.47967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51401.log 2024-09-16T15:39:21.365 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36703.log 2024-09-16T15:39:21.365 INFO:teuthology.orchestra.run.smithi098.stderr: 87.6%/var/log/ceph/ceph-client.admin.44287.log: -- replaced with /var/log/ceph/ceph-client.admin.47967.log.gz 2024-09-16T15:39:21.365 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.51401.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44287.log.gz 2024-09-16T15:39:21.365 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44621.log 2024-09-16T15:39:21.365 INFO:teuthology.orchestra.run.smithi098.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51401.log.gz 2024-09-16T15:39:21.365 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44279.log 2024-09-16T15:39:21.365 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.36703.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.36703.log.gz 2024-09-16T15:39:21.365 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.44621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51023.log 2024-09-16T15:39:21.365 INFO:teuthology.orchestra.run.smithi098.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44621.log.gz 2024-09-16T15:39:21.365 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44934.log 2024-09-16T15:39:21.365 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.44279.log: /var/log/ceph/ceph-client.admin.51023.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44279.log.gz 2024-09-16T15:39:21.365 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50412.log 2024-09-16T15:39:21.366 INFO:teuthology.orchestra.run.smithi098.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.51023.log.gz 2024-09-16T15:39:21.366 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44286.log 2024-09-16T15:39:21.366 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.44934.log: /var/log/ceph/ceph-client.admin.50412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46035.log 2024-09-16T15:39:21.366 INFO:teuthology.orchestra.run.smithi098.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44934.log.gz 2024-09-16T15:39:21.366 INFO:teuthology.orchestra.run.smithi098.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50412.log.gz 2024-09-16T15:39:21.366 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.44286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36176.log 2024-09-16T15:39:21.366 INFO:teuthology.orchestra.run.smithi098.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.44286.log.gz 2024-09-16T15:39:21.366 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45282.log 2024-09-16T15:39:21.366 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.46035.log: /var/log/ceph/ceph-client.admin.36176.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46035.log.gz 2024-09-16T15:39:21.366 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-09-16T15:39:21.366 INFO:teuthology.orchestra.run.smithi098.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36176.log.gz 2024-09-16T15:39:21.366 INFO:teuthology.orchestra.run.smithi098.stderr:gzip/var/log/ceph/ceph-client.admin.45282.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.48740.log 2024-09-16T15:39:21.366 INFO:teuthology.orchestra.run.smithi098.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45282.log.gz 2024-09-16T15:39:21.366 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44617.log 2024-09-16T15:39:21.366 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43472.log 2024-09-16T15:39:21.367 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.48740.log: /var/log/ceph/ceph-client.admin.44617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47716.log 2024-09-16T15:39:21.367 INFO:teuthology.orchestra.run.smithi098.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.48740.log.gz 2024-09-16T15:39:21.367 INFO:teuthology.orchestra.run.smithi098.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44617.log.gz 2024-09-16T15:39:21.367 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.43472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44940.log 2024-09-16T15:39:21.367 INFO:teuthology.orchestra.run.smithi098.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43472.log.gz 2024-09-16T15:39:21.367 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.47716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46518.log 2024-09-16T15:39:21.367 INFO:teuthology.orchestra.run.smithi098.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.47716.log.gz 2024-09-16T15:39:21.367 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48362.log 2024-09-16T15:39:21.367 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.44940.log: /var/log/ceph/ceph-client.admin.46518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49412.log 2024-09-16T15:39:21.367 INFO:teuthology.orchestra.run.smithi098.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.44940.log.gz 2024-09-16T15:39:21.367 INFO:teuthology.orchestra.run.smithi098.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46518.log.gz 2024-09-16T15:39:21.367 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.48362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50538.log 2024-09-16T15:39:21.367 INFO:teuthology.orchestra.run.smithi098.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48362.log.gz 2024-09-16T15:39:21.367 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.49412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36660.log 2024-09-16T15:39:21.367 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.50538.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.49412.log.gz 2024-09-16T15:39:21.368 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43273.log 2024-09-16T15:39:21.368 INFO:teuthology.orchestra.run.smithi098.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50538.log.gz 2024-09-16T15:39:21.368 INFO:teuthology.orchestra.run.smithi098.stderr:gzip/var/log/ceph/ceph-client.admin.36660.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.45114.log 2024-09-16T15:39:21.368 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.43273.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.36660.log.gz 2024-09-16T15:39:21.368 INFO:teuthology.orchestra.run.smithi098.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43273.log.gz 2024-09-16T15:39:21.368 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36562.log 2024-09-16T15:39:21.368 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48614.log 2024-09-16T15:39:21.368 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.45114.log: /var/log/ceph/ceph-client.admin.36562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48530.log 2024-09-16T15:39:21.368 INFO:teuthology.orchestra.run.smithi098.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.45114.log.gz 2024-09-16T15:39:21.368 INFO:teuthology.orchestra.run.smithi098.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.36562.log.gz 2024-09-16T15:39:21.368 INFO:teuthology.orchestra.run.smithi098.stderr:gzip/var/log/ceph/ceph-client.admin.48614.log: -5 --verbose -- /var/log/ceph/ceph-client.0.45896.log 2024-09-16T15:39:21.368 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.48530.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48614.log.gz 2024-09-16T15:39:21.368 INFO:teuthology.orchestra.run.smithi098.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.48530.log.gz 2024-09-16T15:39:21.368 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-16T15:39:21.369 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44282.log 2024-09-16T15:39:21.369 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.0.45896.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.45896.log.gz 2024-09-16T15:39:21.369 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50729.log 2024-09-16T15:39:21.369 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.44282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43812.log 2024-09-16T15:39:21.369 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.50729.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.44282.log.gz 2024-09-16T15:39:21.369 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36267.log 2024-09-16T15:39:21.369 INFO:teuthology.orchestra.run.smithi098.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.50729.log.gz 2024-09-16T15:39:21.369 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.43812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36711.log 2024-09-16T15:39:21.369 INFO:teuthology.orchestra.run.smithi098.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.43812.log.gz 2024-09-16T15:39:21.369 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.36267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50286.log 76.9% -- replaced with /var/log/ceph/ceph-client.admin.36267.log.gz 2024-09-16T15:39:21.370 INFO:teuthology.orchestra.run.smithi098.stderr: 2024-09-16T15:39:21.370 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.36711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36712.log 2024-09-16T15:39:21.370 INFO:teuthology.orchestra.run.smithi098.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.36711.log.gz 2024-09-16T15:39:21.370 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.50286.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-16T15:39:21.370 INFO:teuthology.orchestra.run.smithi098.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50286.log.gz 2024-09-16T15:39:21.370 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51569.log 2024-09-16T15:39:21.370 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.36712.log: /var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49622.log 2024-09-16T15:39:21.370 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.51569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48932.log 2024-09-16T15:39:21.370 INFO:teuthology.orchestra.run.smithi098.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.36712.log.gz 2024-09-16T15:39:21.370 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.49622.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.51569.log.gz 2024-09-16T15:39:21.370 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49997.log 2024-09-16T15:39:21.370 INFO:teuthology.orchestra.run.smithi098.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.49622.log.gz 2024-09-16T15:39:21.370 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43149.log 2024-09-16T15:39:21.370 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.48932.log: /var/log/ceph/ceph-client.admin.49997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46602.log 2024-09-16T15:39:21.370 INFO:teuthology.orchestra.run.smithi098.stderr: 87.2%/var/log/ceph/ceph-client.admin.43149.log: -- replaced with /var/log/ceph/ceph-client.admin.48932.log.gz 2024-09-16T15:39:21.371 INFO:teuthology.orchestra.run.smithi098.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.49997.log.gz 2024-09-16T15:39:21.371 INFO:teuthology.orchestra.run.smithi098.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43149.log.gz 2024-09-16T15:39:21.371 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48274.log 2024-09-16T15:39:21.371 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36957.log 2024-09-16T15:39:21.371 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.46602.log: /var/log/ceph/ceph-client.admin.48274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42922.log 2024-09-16T15:39:21.371 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.36957.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46602.log.gz 2024-09-16T15:39:21.371 INFO:teuthology.orchestra.run.smithi098.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48274.log.gz 2024-09-16T15:39:21.371 INFO:teuthology.orchestra.run.smithi098.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.36957.log.gz 2024-09-16T15:39:21.371 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48009.log 2024-09-16T15:39:21.371 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43644.log 2024-09-16T15:39:21.371 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.42922.log: /var/log/ceph/ceph-client.admin.48009.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-16T15:39:21.371 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.43644.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42922.log.gz 2024-09-16T15:39:21.371 INFO:teuthology.orchestra.run.smithi098.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48009.log.gz 2024-09-16T15:39:21.372 INFO:teuthology.orchestra.run.smithi098.stderr:gzip 87.5% -5 -- replaced with /var/log/ceph/ceph-client.admin.43644.log.gz --verbose 2024-09-16T15:39:21.372 INFO:teuthology.orchestra.run.smithi098.stderr: -- /var/log/ceph/ceph.log 2024-09-16T15:39:21.372 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48866.log 2024-09-16T15:39:21.372 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-mgr.y.log: /var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36231.log 2024-09-16T15:39:21.372 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.48866.log: 83.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-16T15:39:21.372 INFO:teuthology.orchestra.run.smithi098.stderr: 90.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47583.log 2024-09-16T15:39:21.372 INFO:teuthology.orchestra.run.smithi098.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48866.log.gz 2024-09-16T15:39:21.372 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.36231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36604.log 2024-09-16T15:39:21.372 INFO:teuthology.orchestra.run.smithi098.stderr: 74.8% -- replaced with /var/log/ceph/ceph-client.admin.36231.log.gz 2024-09-16T15:39:21.372 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.47583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47882.log 2024-09-16T15:39:21.372 INFO:teuthology.orchestra.run.smithi098.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47583.log.gz 2024-09-16T15:39:21.372 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.36604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50855.log 2024-09-16T15:39:21.372 INFO:teuthology.orchestra.run.smithi098.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.36604.log.gz 2024-09-16T15:39:21.372 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.47882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47312.log 2024-09-16T15:39:21.373 INFO:teuthology.orchestra.run.smithi098.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47882.log.gz 2024-09-16T15:39:21.373 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.50855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48179.log 2024-09-16T15:39:21.373 INFO:teuthology.orchestra.run.smithi098.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50855.log.gz 2024-09-16T15:39:21.373 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.47312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47840.log 2024-09-16T15:39:21.373 INFO:teuthology.orchestra.run.smithi098.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47312.log.gz/var/log/ceph/ceph-client.admin.48179.log: 2024-09-16T15:39:21.373 INFO:teuthology.orchestra.run.smithi098.stderr: 87.4% 92.2% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-16T15:39:21.373 INFO:teuthology.orchestra.run.smithi098.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48179.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47354.log 2024-09-16T15:39:21.373 INFO:teuthology.orchestra.run.smithi098.stderr: 2024-09-16T15:39:21.373 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.47840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48093.log 2024-09-16T15:39:21.373 INFO:teuthology.orchestra.run.smithi098.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47840.log.gz 2024-09-16T15:39:21.373 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.47354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44288.log 2024-09-16T15:39:21.373 INFO:teuthology.orchestra.run.smithi098.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47354.log.gz 2024-09-16T15:39:21.374 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49454.log 2024-09-16T15:39:21.374 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.48093.log: /var/log/ceph/ceph-client.admin.44288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47480.log 2024-09-16T15:39:21.374 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.49454.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48093.log.gz 2024-09-16T15:39:21.374 INFO:teuthology.orchestra.run.smithi098.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44288.log.gz 2024-09-16T15:39:21.374 INFO:teuthology.orchestra.run.smithi098.stderr:gzip 87.1% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.49454.log.gz -- 2024-09-16T15:39:21.374 INFO:teuthology.orchestra.run.smithi098.stderr: /var/log/ceph/ceph-client.admin.43421.log 2024-09-16T15:39:21.374 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37158.log 2024-09-16T15:39:21.374 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.47480.log: /var/log/ceph/ceph-client.admin.43421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49370.log 2024-09-16T15:39:21.374 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.37158.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.47480.log.gz 2024-09-16T15:39:21.374 INFO:teuthology.orchestra.run.smithi098.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43421.log.gz 2024-09-16T15:39:21.374 INFO:teuthology.orchestra.run.smithi098.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.37158.log.gz 2024-09-16T15:39:21.375 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48572.log 2024-09-16T15:39:21.376 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44608.log 2024-09-16T15:39:21.376 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.49370.log: /var/log/ceph/ceph-client.admin.48572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44937.log 2024-09-16T15:39:21.376 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.44608.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.49370.log.gz 2024-09-16T15:39:21.376 INFO:teuthology.orchestra.run.smithi098.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.48572.log.gz 2024-09-16T15:39:21.376 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50981.log 2024-09-16T15:39:21.376 INFO:teuthology.orchestra.run.smithi098.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44608.log.gz 2024-09-16T15:39:21.376 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46644.log 2024-09-16T15:39:21.376 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.44937.log: /var/log/ceph/ceph-client.admin.50981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51275.log 2024-09-16T15:39:21.376 INFO:teuthology.orchestra.run.smithi098.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.44937.log.gz 2024-09-16T15:39:21.376 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.46644.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.50981.log.gz 2024-09-16T15:39:21.376 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36434.log 2024-09-16T15:39:21.376 INFO:teuthology.orchestra.run.smithi098.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46644.log.gz 2024-09-16T15:39:21.377 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51107.log 2024-09-16T15:39:21.377 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.51275.log: /var/log/ceph/ceph-client.admin.36434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36713.log 2024-09-16T15:39:21.377 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.51107.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.36434.log.gz 2024-09-16T15:39:21.377 INFO:teuthology.orchestra.run.smithi098.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.51275.log.gz 2024-09-16T15:39:21.377 INFO:teuthology.orchestra.run.smithi098.stderr: 87.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44624.log 2024-09-16T15:39:21.377 INFO:teuthology.orchestra.run.smithi098.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51107.log.gz 2024-09-16T15:39:21.377 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.36713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48135.log 2024-09-16T15:39:21.377 INFO:teuthology.orchestra.run.smithi098.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.36713.log.gz 2024-09-16T15:39:21.377 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36715.log 2024-09-16T15:39:21.377 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.44624.log: /var/log/ceph/ceph-client.admin.48135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50939.log 2024-09-16T15:39:21.377 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.36715.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44624.log.gz 2024-09-16T15:39:21.377 INFO:teuthology.orchestra.run.smithi098.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48135.log.gz 2024-09-16T15:39:21.377 INFO:teuthology.orchestra.run.smithi098.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.36715.log.gz 2024-09-16T15:39:21.377 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50039.log 2024-09-16T15:39:21.378 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51527.log 2024-09-16T15:39:21.378 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.50939.log: /var/log/ceph/ceph-client.admin.50039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36295.log 2024-09-16T15:39:21.378 INFO:teuthology.orchestra.run.smithi098.stderr: 87.3%/var/log/ceph/ceph-client.admin.51527.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50039.log.gz -- replaced with /var/log/ceph/ceph-client.admin.50939.log.gz 2024-09-16T15:39:21.378 INFO:teuthology.orchestra.run.smithi098.stderr: 2024-09-16T15:39:21.378 INFO:teuthology.orchestra.run.smithi098.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.51527.log.gz 2024-09-16T15:39:21.378 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44623.log 2024-09-16T15:39:21.378 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49913.log 2024-09-16T15:39:21.378 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.36295.log: /var/log/ceph/ceph-client.admin.44623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47091.log 2024-09-16T15:39:21.378 INFO:teuthology.orchestra.run.smithi098.stderr: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.36295.log.gz 2024-09-16T15:39:21.378 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.49913.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.44623.log.gz 2024-09-16T15:39:21.378 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36323.log 2024-09-16T15:39:21.378 INFO:teuthology.orchestra.run.smithi098.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49913.log.gz 2024-09-16T15:39:21.378 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48223.log 2024-09-16T15:39:21.378 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.47091.log: /var/log/ceph/ceph-client.admin.36323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43770.log 2024-09-16T15:39:21.378 INFO:teuthology.orchestra.run.smithi098.stderr: 78.7% -- replaced with /var/log/ceph/ceph-client.admin.36323.log.gz 2024-09-16T15:39:21.378 INFO:teuthology.orchestra.run.smithi098.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47091.log.gz 2024-09-16T15:39:21.379 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.48223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48488.log 2024-09-16T15:39:21.379 INFO:teuthology.orchestra.run.smithi098.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48223.log.gz 2024-09-16T15:39:21.379 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51359.log 2024-09-16T15:39:21.379 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.43770.log: /var/log/ceph/ceph-client.admin.48488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43602.log 2024-09-16T15:39:21.379 INFO:teuthology.orchestra.run.smithi098.stderr: 87.0%/var/log/ceph/ceph-client.admin.51359.log: -- replaced with /var/log/ceph/ceph-client.admin.43770.log.gz 2024-09-16T15:39:21.379 INFO:teuthology.orchestra.run.smithi098.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48488.log.gz 2024-09-16T15:39:21.379 INFO:teuthology.orchestra.run.smithi098.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51359.log.gz 2024-09-16T15:39:21.379 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-16T15:39:21.379 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44278.log 2024-09-16T15:39:21.379 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.43602.log: /var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-09-16T15:39:21.379 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.44278.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43602.log.gz 2024-09-16T15:39:21.379 INFO:teuthology.orchestra.run.smithi098.stderr: 87.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43728.log 2024-09-16T15:39:21.379 INFO:teuthology.orchestra.run.smithi098.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44278.log.gz 2024-09-16T15:39:21.379 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45324.log 2024-09-16T15:39:21.379 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.43728.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.43728.log.gz 2024-09-16T15:39:21.379 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48320.log 2024-09-16T15:39:21.380 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.45324.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45324.log.gz 2024-09-16T15:39:21.380 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51629.log 2024-09-16T15:39:21.380 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.48320.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48320.log.gz 2024-09-16T15:39:21.380 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46476.log 2024-09-16T15:39:21.380 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.51629.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.51629.log.gz 2024-09-16T15:39:21.380 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51485.log 2024-09-16T15:39:21.380 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.46476.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46476.log.gz 2024-09-16T15:39:21.380 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50454.log 2024-09-16T15:39:21.380 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.51485.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51485.log.gz 2024-09-16T15:39:21.380 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.50454.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50454.log.gz 2024-09-16T15:39:21.381 INFO:teuthology.orchestra.run.smithi135.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-16T15:39:21.381 INFO:teuthology.orchestra.run.smithi098.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-16T15:39:21.386 INFO:teuthology.orchestra.run.smithi135.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-16T15:39:21.389 INFO:teuthology.orchestra.run.smithi098.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-16T15:39:21.389 INFO:teuthology.orchestra.run.smithi098.stderr: 94.4% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-09-16T15:39:21.395 INFO:teuthology.orchestra.run.smithi135.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-16T15:39:21.401 INFO:teuthology.orchestra.run.smithi135.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-16T15:39:21.412 INFO:teuthology.orchestra.run.smithi135.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-16T15:39:21.415 INFO:teuthology.orchestra.run.smithi135.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-16T15:39:21.425 INFO:teuthology.orchestra.run.smithi135.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-16T15:39:21.427 INFO:teuthology.orchestra.run.smithi135.stderr: 2024-09-16T15:39:21.427 INFO:teuthology.orchestra.run.smithi135.stderr:real 0m0.141s 2024-09-16T15:39:21.427 INFO:teuthology.orchestra.run.smithi135.stderr:user 0m0.692s 2024-09-16T15:39:21.427 INFO:teuthology.orchestra.run.smithi135.stderr:sys 0m0.041s 2024-09-16T15:39:21.431 INFO:teuthology.orchestra.run.smithi098.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-16T15:39:21.460 INFO:teuthology.orchestra.run.smithi098.stderr: 93.3% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-09-16T15:39:21.470 INFO:teuthology.orchestra.run.smithi098.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-16T15:39:21.490 INFO:teuthology.orchestra.run.smithi098.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-16T15:39:21.492 INFO:teuthology.orchestra.run.smithi098.stderr: 2024-09-16T15:39:21.493 INFO:teuthology.orchestra.run.smithi098.stderr:real 0m0.231s 2024-09-16T15:39:21.493 INFO:teuthology.orchestra.run.smithi098.stderr:user 0m0.918s 2024-09-16T15:39:21.493 INFO:teuthology.orchestra.run.smithi098.stderr:sys 0m0.148s 2024-09-16T15:39:21.493 INFO:tasks.ceph:Archiving logs... 2024-09-16T15:39:21.493 DEBUG:teuthology.misc:Transferring archived files from smithi098:/var/log/ceph to /home/teuthworker/archive/avan-2024-09-16_15:21:40-fs:volumes-wip-athakkar-testing-2024-09-16-1454-distro-default-smithi/7907356/remote/smithi098/log 2024-09-16T15:39:21.494 DEBUG:teuthology.orchestra.run.smithi098:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-16T15:39:21.792 DEBUG:teuthology.misc:Transferring archived files from smithi135:/var/log/ceph to /home/teuthworker/archive/avan-2024-09-16_15:21:40-fs:volumes-wip-athakkar-testing-2024-09-16-1454-distro-default-smithi/7907356/remote/smithi135/log 2024-09-16T15:39:21.793 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-16T15:39:21.913 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-16T15:39:21.924 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-16T15:39:21.924 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-16T15:39:21.927 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-16T15:39:22.005 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-16T15:39:22.014 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-16T15:39:22.014 DEBUG:teuthology.orchestra.run.smithi098:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T15:39:22.017 DEBUG:teuthology.orchestra.run.smithi135:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T15:39:22.029 INFO:teuthology.orchestra.run.smithi098.stderr:bash: line 1: ntpq: command not found 2024-09-16T15:39:22.031 INFO:teuthology.orchestra.run.smithi135.stderr:bash: line 1: ntpq: command not found 2024-09-16T15:39:22.033 INFO:teuthology.orchestra.run.smithi098.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-16T15:39:22.033 INFO:teuthology.orchestra.run.smithi098.stdout:=============================================================================== 2024-09-16T15:39:22.033 INFO:teuthology.orchestra.run.smithi098.stdout:^* hv01.front.sepia.ceph.com 3 6 377 22 +13us[ +17us] +/- 43ms 2024-09-16T15:39:22.033 INFO:teuthology.orchestra.run.smithi098.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 20 -297us[ -297us] +/- 76ms 2024-09-16T15:39:22.033 INFO:teuthology.orchestra.run.smithi098.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 19 +312us[ +312us] +/- 79ms 2024-09-16T15:39:22.033 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T15:39:22.036 INFO:teuthology.orchestra.run.smithi135.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-16T15:39:22.036 INFO:teuthology.orchestra.run.smithi135.stdout:=============================================================================== 2024-09-16T15:39:22.036 INFO:teuthology.orchestra.run.smithi135.stdout:^* hv01.front.sepia.ceph.com 3 6 377 21 +13us[ +22us] +/- 43ms 2024-09-16T15:39:22.036 INFO:teuthology.orchestra.run.smithi135.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 21 -290us[ -281us] +/- 76ms 2024-09-16T15:39:22.036 INFO:teuthology.orchestra.run.smithi135.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 20 +314us[ +314us] +/- 79ms 2024-09-16T15:39:22.036 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T15:39:22.037 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-16T15:39:22.046 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-16T15:39:22.046 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-16T15:39:22.054 DEBUG:teuthology.orchestra.run.smithi098:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-16T15:39:22.140 DEBUG:teuthology.orchestra.run.smithi135:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-16T15:39:22.203 DEBUG:teuthology.orchestra.run.smithi098:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-16T15:39:22.231 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T15:39:22.231 DEBUG:teuthology.orchestra.run.smithi135:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-16T15:39:22.258 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T15:39:22.258 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-16T15:39:22.268 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-16T15:39:22.275 INFO:teuthology.task.internal:Duration was 510.516961 seconds 2024-09-16T15:39:22.276 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-16T15:39:22.284 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-16T15:39:22.284 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-16T15:39:22.287 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-16T15:39:22.323 INFO:teuthology.orchestra.run.smithi098.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-16T15:39:22.338 INFO:teuthology.orchestra.run.smithi135.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-16T15:39:22.613 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-16T15:39:22.613 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi098.front.sepia.ceph.com 2024-09-16T15:39:22.613 DEBUG:teuthology.orchestra.run.smithi098:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-16T15:39:22.673 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi135.front.sepia.ceph.com 2024-09-16T15:39:22.673 DEBUG:teuthology.orchestra.run.smithi135:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-16T15:39:22.702 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-16T15:39:22.702 DEBUG:teuthology.orchestra.run.smithi098:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-16T15:39:22.715 DEBUG:teuthology.orchestra.run.smithi135:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-16T15:39:22.768 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-16T15:39:22.768 DEBUG:teuthology.orchestra.run.smithi098:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-16T15:39:22.780 DEBUG:teuthology.orchestra.run.smithi135:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-16T15:39:22.911 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-16T15:39:22.921 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-16T15:39:22.921 DEBUG:teuthology.orchestra.run.smithi098:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-16T15:39:22.947 DEBUG:teuthology.orchestra.run.smithi135:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-16T15:39:22.971 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-16T15:39:22.981 DEBUG:teuthology.orchestra.run.smithi098:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-16T15:39:22.989 DEBUG:teuthology.orchestra.run.smithi135:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-16T15:39:23.009 INFO:teuthology.orchestra.run.smithi098.stdout:kernel.core_pattern = core 2024-09-16T15:39:23.035 INFO:teuthology.orchestra.run.smithi135.stdout:kernel.core_pattern = core 2024-09-16T15:39:23.048 DEBUG:teuthology.orchestra.run.smithi098:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-16T15:39:23.077 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T15:39:23.077 DEBUG:teuthology.orchestra.run.smithi135:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-16T15:39:23.103 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T15:39:23.103 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-16T15:39:23.113 INFO:teuthology.task.internal:Transferring archived files... 2024-09-16T15:39:23.113 DEBUG:teuthology.misc:Transferring archived files from smithi098:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/avan-2024-09-16_15:21:40-fs:volumes-wip-athakkar-testing-2024-09-16-1454-distro-default-smithi/7907356/remote/smithi098 2024-09-16T15:39:23.114 DEBUG:teuthology.orchestra.run.smithi098:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-16T15:39:23.151 DEBUG:teuthology.misc:Transferring archived files from smithi135:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/avan-2024-09-16_15:21:40-fs:volumes-wip-athakkar-testing-2024-09-16-1454-distro-default-smithi/7907356/remote/smithi135 2024-09-16T15:39:23.151 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-16T15:39:23.183 INFO:teuthology.task.internal:Removing archive directory... 2024-09-16T15:39:23.183 DEBUG:teuthology.orchestra.run.smithi098:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-16T15:39:23.188 DEBUG:teuthology.orchestra.run.smithi135:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-16T15:39:23.234 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-16T15:39:23.245 INFO:teuthology.task.internal:Not uploading archives. 2024-09-16T15:39:23.246 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-16T15:39:23.255 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-16T15:39:23.255 DEBUG:teuthology.orchestra.run.smithi098:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-16T15:39:23.257 DEBUG:teuthology.orchestra.run.smithi135:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-16T15:39:23.269 INFO:teuthology.orchestra.run.smithi098.stdout: 266064 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 16 15:39 /home/ubuntu/cephtest 2024-09-16T15:39:23.288 INFO:teuthology.orchestra.run.smithi135.stdout: 265336 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 16 15:39 /home/ubuntu/cephtest 2024-09-16T15:39:23.290 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-16T15:39:23.299 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-16T15:39:23.322 INFO:teuthology.run:Summary data: description: fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/finisher_per_module}} duration: 510.5169608592987 flavor: default owner: scheduled_avan@teuthology success: true 2024-09-16T15:39:23.322 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-16T15:39:23.419 INFO:teuthology.run:pass